Skip to content

Conversation

@kisseternity
Copy link

What does this PR do ?

This PR adds conditional checks to _warmup_jit_function in initialize.py to ensure JIT fusions (Bias+GeLU/SwiGLU and Bias+Dropout+Add) are only warmed up when they are enabled via arguments (e.g., checks args.bias_gelu_fusion, args.bias_dropout_fusion). This prevents unnecessary warmup execution when users explicitly disable these fusions using flags like --no-bias-gelu-fusion.

Pre-checks

  • [done ] I want this PR in a versioned release and have added the appropriate Milestone (e.g., Core 0.8)
  • [done ] I have added relevant unit tests
  • [done ] I have added relevant functional tests
  • [done ] I have added proper typing to my code Typing guidelines
  • [done ] I have added relevant documentation
  • [done ] I have run the autoformatter.sh on my PR

@copy-pr-bot
Copy link

copy-pr-bot bot commented Jan 6, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant