-
Notifications
You must be signed in to change notification settings - Fork 27
Insights: SHI-Labs/NATTEN
Overview
-
- 3 Merged pull requests
- 1 Open pull request
- 15 Closed issues
- 0 New issues
Could not load contribution data
Please try again later
3 Pull requests merged by 2 people
-
Bug fixes
#169 merged
Oct 2, 2024 -
Enable KV parallelism by default, bug fixes
#167 merged
Oct 1, 2024 -
Update functional.py
#168 merged
Oct 1, 2024
1 Pull request opened by 1 person
-
Support torch.compile
#170 opened
Oct 3, 2024
15 Issues closed by 1 person
-
Failed to install natten on Python 3.9(Windows)
#127 closed
Oct 1, 2024 -
Inverted register attention
#131 closed
Oct 1, 2024 -
Set different window sizes and dilations for different tokens
#136 closed
Oct 1, 2024 -
circular/wrapping attention
#142 closed
Oct 1, 2024 -
Is NATTEN Fused NA v0.17 faster than Flash Attention 2
#143 closed
Oct 1, 2024 -
Linear Attention
#144 closed
Oct 1, 2024 -
Customise Kernel Size?
#146 closed
Oct 1, 2024 -
How to perform NA only at specific locations
#151 closed
Oct 1, 2024 -
Natten 0.17.0 on MBP M1 Silicon
#140 closed
Oct 1, 2024 -
Issues in windows with torch version 1.X.X.
#148 closed
Oct 1, 2024 -
Incorporating into mainline pytorch?
#149 closed
Oct 1, 2024 -
whether different precision calculations are used inside the na2d_qk function
#160 closed
Oct 1, 2024 -
Why is the size of rpb [2K-1,2K-1] inconsistent to kernel size [K,K]?
#165 closed
Oct 1, 2024 -
issue while training using DDP
#166 closed
Oct 1, 2024 -
backward pass of na3d() is very slow
#157 closed
Oct 1, 2024
3 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
NATTEN failure: cutlass error: Error Internal at: 102
#163 commented on
Oct 1, 2024 • 0 new comments -
Temporary cmake files are installed
#152 commented on
Oct 1, 2024 • 0 new comments -
MPS support
#102 commented on
Oct 1, 2024 • 0 new comments