Commit 7484d47
authored
fix(cute): pass mDynamicCausal to kernel and init is_split_kv in SM80/SM120 FA4 forward (#178)
- Pass mDynamicCausal in the FlashAttentionForwardSm80/Sm120 kernel
launch and add it to the kernel signature (was referenced in the
kernel body but never passed, causing NameError on first call).
- Initialize self.is_split_kv = False in __init__ (read in four places
but never assigned, causing AttributeError on first call).
Fixes vllm-project/vllm#51776
Signed-off-by: SayHelloToWorld <SayHelloToWorld@users.noreply.github.com>
Co-authored-by: SayHelloToWorld <SayHelloToWorld@users.noreply.github.com>1 parent 617264c commit 7484d47
1 file changed
Lines changed: 3 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
626 | 626 | | |
627 | 627 | | |
628 | 628 | | |
| 629 | + | |
629 | 630 | | |
630 | 631 | | |
631 | 632 | | |
| |||
793 | 794 | | |
794 | 795 | | |
795 | 796 | | |
| 797 | + | |
796 | 798 | | |
797 | 799 | | |
798 | 800 | | |
| |||
833 | 835 | | |
834 | 836 | | |
835 | 837 | | |
| 838 | + | |
836 | 839 | | |
837 | 840 | | |
838 | 841 | | |
| |||
0 commit comments