[Feature]: FA4 Attention Sinks

[pbarker-synth]

🚀 The feature, motivation and pitch

In order to run GPT-OSS-120b efficiently on the blackwell architecture it requires attention sink support in FA4

Alternatives

Eager attention :(

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.