-
Notifications
You must be signed in to change notification settings - Fork 103
Insights: flashinfer-ai/flashinfer
September 13, 2024 – September 20, 2024
Overview
-
- 2 Merged pull requests
- 0 Open pull requests
- 2 Closed issues
- 2 New issues
Loading
Could not load contribution data
Please try again later
Loading
2 Pull requests merged by 1 person
-
minor: add out parameter for rmsnorm and gemma_rmsnorm
#503 merged
Sep 19, 2024 -
minor: refine norm
#498 merged
Sep 13, 2024
2 Issues closed by 1 person
-
Does FlashInfer support variable-length inputs?
#501 closed
Sep 19, 2024 -
Add an `out` argument to `rmsnorm`, `gemma_rmsnorm`
#500 closed
Sep 19, 2024
2 Issues opened by 2 people
-
Does Flashinfer support 8-bit attention calculation?
#502 opened
Sep 19, 2024 -
confused about get_lse usage in single_decode with large kv length
#499 opened
Sep 14, 2024
3 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
How to use low-bit KV Cache in flashinfer?
#125 commented on
Sep 14, 2024 • 0 new comments -
[Tentative] Adding 192 head dim (step_size = 12)
#454 commented on
Sep 19, 2024 • 0 new comments -
chore(main): release 0.2.0
#476 commented on
Sep 19, 2024 • 0 new comments