Skip to content

fix(attn): remove invalid attention param#305

Merged
rebel-jiwoopark merged 1 commit intodevfrom
jiwoo/fix_attn_param
Jan 28, 2026
Merged

fix(attn): remove invalid attention param#305
rebel-jiwoopark merged 1 commit intodevfrom
jiwoo/fix_attn_param

Conversation

@rebel-jiwoopark
Copy link
Copy Markdown
Collaborator

🚀 Summary of Changes

Fix attention backend because blocksparse_param was removed from the attention parameters starting in v0.10


📌 Related Issues / Tickets

  • Resolves #
  • Related to #

✅ Type of Change

  • ✨ Feature (feature)
  • 🧠 Model support (model)
  • 🧬 Core engine changes (core)
  • 🛠 Bug fix (bug-fix)
  • ⚙️ Performance improvement (perf)
  • 🔁 Refactor or code cleanup (refactor)
  • 📄 Documentation (docs)
  • ❓ Other (other): please describe

🧪 How to Test

  1. Run ...
    google/gemma-2-2b-it

📸 Screenshots / Logs (if applicable)


📋 Checklist

  • PR title follows Conventional Commits format
  • This PR is linked to an existing issue
  • The test method is described, and the expected result is clearly stated
  • Relevant documentation has been updated (if applicable)

💬 Notes


@rebel-jiwoopark rebel-jiwoopark self-assigned this Jan 28, 2026
@rebel-jiwoopark rebel-jiwoopark added the torch.compile torch.compile based implementation label Jan 28, 2026
@rebel-jiwoopark rebel-jiwoopark merged commit 2bed0a5 into dev Jan 28, 2026
16 checks passed
@rebel-jiwoopark rebel-jiwoopark deleted the jiwoo/fix_attn_param branch January 28, 2026 09:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

torch.compile torch.compile based implementation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants