Skip to content

feat: Add support for compute capability 12.1 (Grace Blackwell) - #785

Merged
lmxyy merged 2 commits into
nunchaku-ai:mainfrom
multippt:feat/sm121
Nov 16, 2025
Merged

feat: Add support for compute capability 12.1 (Grace Blackwell)#785
lmxyy merged 2 commits into
nunchaku-ai:mainfrom
multippt:feat/sm121

Conversation

@multippt

@multippt multippt commented Oct 27, 2025

Copy link
Copy Markdown
Contributor

Motivation

When installing nunchaku on DGX Spark using the Grace Blackwell GB10 chip, installation would fail with the following error

AssertionError: Unsupported SM 121

Modifications

Whitelist Cuda GPU Compute Capability 12.1

Checklist

  • Code is formatted using Pre-Commit hooks.
  • Relevant unit tests are added in the tests directory following the guidance in Contribution Guide.
  • Documentation and example scripts in examples are updated if necessary.
  • Throughput/latency benchmarks and quality evaluations are included where applicable.
  • For reviewers: If you're only helping merge the main branch and haven't contributed code to this PR, please remove yourself as a co-author when merging.
  • Please feel free to join our Slack, Discord or WeChat to discuss your PR.

@lmxyy

lmxyy commented Oct 27, 2025

Copy link
Copy Markdown
Collaborator

Did you verify the code is runnable after adding this flag?

@multippt

multippt commented Oct 27, 2025

Copy link
Copy Markdown
Contributor Author

Did you verify the code is runnable after adding this flag?

Yes, on the DGX Spark device, validated using the test scripts and also on ComfyUI with ComfyUI-Nunchaku custom node.

Sample svdq-fp4_r128-qwen-image-edit-lightningv1.0-4steps.safetensors, render duration 16.28s (2.65s/it), there's a performance improvement versus the equivalent vanilla ComfyUI QwenImageEdit + 4-step LoRA workflow.

@multippt multippt changed the title Add support for compute capability 12.1 (Grace Blackwell) Add support for cuda capability 12.1 (Grace Blackwell) Oct 30, 2025
@multippt multippt changed the title Add support for cuda capability 12.1 (Grace Blackwell) Add support for compute capability 12.1 (Grace Blackwell) Oct 30, 2025
@kandy

kandy commented Nov 15, 2025

Copy link
Copy Markdown

Can confirm that this fixing issue for DGX Spark

@lmxyy lmxyy changed the title Add support for compute capability 12.1 (Grace Blackwell) feat: Add support for compute capability 12.1 (Grace Blackwell) Nov 16, 2025

@lmxyy lmxyy left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me.

@lmxyy
lmxyy merged commit 4f91dd9 into nunchaku-ai:main Nov 16, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants