Search results

Support M-Bridge Checkpoints for vLLM export

enhancementNew feature or requestNew feature or request

Status: Open.

#543 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Dec 22, 2025

·  

26.02

Inference with Megatron Bridge checkpoint deployed with PyTriton fails with "RuntimeError: Cannot run the event loop while another loop is running"

bugSomething isn't workingSomething isn't working

Status: Open.

#529 In NVIDIA-NeMo/Export-Deploy;

· marta-sd opened on Dec 3, 2025

Copy changes in PR 501 and 505 to scripts under new llm dir

bugSomething isn't workingSomething isn't working

Status: Open.

Bug

#504 In NVIDIA-NeMo/Export-Deploy;

· athitten opened on Nov 6, 2025

·  

25.11

is nemo export-deploy going to support exporting fp8 checkpoints (HF)?

questionFurther information is requestedFurther information is requested

Status: Open.

#460 In NVIDIA-NeMo/Export-Deploy;

· snowmanwwg opened on Oct 17, 2025

Export and Deploy PTQed Megatron-Bridge Models

enhancementNew feature or requestNew feature or request

Status: Open.

#457 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Oct 17, 2025

Find a way to Make TRT-LLM work with CUDA 13

bugSomething isn't workingSomething isn't working

Status: Open.

#451 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Oct 15, 2025

Static engine is deprecated, use dynamic engine

enhancementNew feature or requestNew feature or request

Status: Open.

#450 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Oct 15, 2025

Enable request batching in Ray Deployments

enhancementNew feature or requestNew feature or request

Status: Open.

#442 In NVIDIA-NeMo/Export-Deploy;

· pthombre opened on Oct 8, 2025

Create separate scripts for all the deployment paths

enhancementNew feature or requestNew feature or request

Status: Open.

#438 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Oct 6, 2025

Check params like use_greedy and repetition_penalty for NemoQueryLLMPyTorch class

bugSomething isn't workingSomething isn't working

Status: Open.

#434 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Oct 4, 2025

Stopword support for in-framework deployment

enhancementNew feature or requestNew feature or request

Status: Open.

#430 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Oct 1, 2025

Go over the docs and update the support matrices

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#425 In NVIDIA-NeMo/Export-Deploy;

· oyilmaz-nvidia opened on Oct 1, 2025