Commit e8c7300

committed

Add packed segment attention fast path

1 parent d4deabe commit e8c7300Copy full SHA for e8c7300

6 files changed

.agents/scripts
- grug_gpu_attention_bench.py
- megatron_te_attention_bench.py
docs
- debug-log-grug-attention-correctness.md
lib/levanter
- src/levanter/grug
  - attention.py
  - flex_attention.py
- tests/grug
  - test_attention.py

Comments

(0)