Skip to content

v1.14.1-release

Choose a tag to compare

View all tags
@Anerudhan Anerudhan released this 05 Sep 04:42
· 3 commits to main since this release
v1.14.1
1a7b4b7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

📢 cuDNN Frontend v1.14.1 — Release Notes

🚀 Improvements

🔹 SDPA

  • Improved support checks for Hopper backward propagation (bprop) to fix a bug (introduced in 9.11 and fixed in 9.13) affecting certain large head-dimension combinations of d_qk and d_v.
  • Added support for sink parameter for SDPA opertation. Refer new samples
    • fp16_fwd_with_sink_token.cpp
      • fp16_bwd_with_sink_token.cpp

🔹 Pointwise

  • Added beta support for configurable beta for swish

🔹 Other Updates

  • See PR #163 and #165 for custom DLPack path

✅ Recommended Action: Upgrade to cuDNN Frontend v1.14.1 for full compatibility with cuDNN 9.13.0+, improved SDPA support, additional normalization support, and deviceless graph compilation features.

Assets 2
Loading