Skip to content

Issues: pytorch-labs/attention-gym

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

40 Open 30 Closed
40 Open 30 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

flexattn with qwen2
#81 opened Nov 18, 2024 by NonvolatileMemory
4
Flex attention with dropout
#77 opened Nov 13, 2024 by zbh2047
3
Flex attention - gaps in profiler
#76 opened Nov 11, 2024 by tugot17
7
Rope2d
#75 opened Nov 11, 2024 by bhack
7
How to implement Bidirectional Alibi with padding using flex attention?
#74 opened Nov 7, 2024 by sphmel
4
Is there any chance to call backward function dircetly instead of using pytorch autograd mechanism?
#73 opened Nov 7, 2024 by MayDomine
3
Block Size when Q_LEN and KV_LEN are different
#71 opened Nov 4, 2024 by johng149
NotImplementedError: There was no rule registered for HOP flex_attention and mode
#70 opened Nov 2, 2024 by LeoXinhaoLee
2
How to manually check if one position or row has correct masking?
#66 opened Oct 28, 2024 by Leo-T-Zang
2
Selection of BLOCK_SIZE in create_block_mask
#65 opened Oct 23, 2024 by tsrikris
1
How to reason about efficiency of different score/mask mod functions
#63 opened Oct 22, 2024 by alex-hh
3
FlexAttention Output Differs from SDPA
#62 opened Oct 22, 2024 by chayut-t
4
How to do KV Cache with FlexAttention and BlockMask by slicing?
#60 opened Oct 21, 2024 by Leo-T-Zang
4
A simple adaption to Jax
#59 opened Oct 21, 2024 by zinccat
3
What is the best practice to save and load a BlockMask object?
#58 opened Oct 20, 2024 by complexfilter
1
Optimal ordering with block mask
#56 opened Oct 19, 2024 by francois-rozet
9
What is the expected gpu memory performance drop wrt flash attention with block masks?
#54 opened Oct 19, 2024 by arilato
2
FlexAttention results do not match FlashAttention results
#50 opened Oct 7, 2024 by tilmto
3
Two errors: (1) NameError: ModularIndexing is not defined & (2) LoweringException: AttributeError: 'View' object has no attribute 'get_stride'
#45 opened Sep 23, 2024 by tobiasvanderwerff
10
Distributed Attention Methods question Further information is requested
#44 opened Sep 20, 2024 by tsrikris
2
CUDA OOM Issue When Using Approx Tanh with softcapping score mod
#43 opened Sep 18, 2024 by kebijuelun
5
[Feature request] End-to-end transformer example with flex attention enhancement New feature or request
#42 opened Sep 16, 2024 by vladkvit
1
How to avoid re-compute mask
#34 opened Sep 5, 2024 by NonvolatileMemory
7
Dynamic shape compilation support for flex attention with block mask
#33 opened Aug 28, 2024 by SamGalanakis
1
Support varied input sequence lengths with a fixed block mask question Further information is requested
#31 opened Aug 27, 2024 by tilmto
5
ProTip! Follow long discussions with comments:>50.