enhance multiheadattention features #6375

Open

Labels

opened

on Oct 27, 2025

rotary embedding as another input
norm for k v affine
MQA and GQA

Metadata

Assignees

No one assigned

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests