Search results

[Bug]: [pyexecutor] SM121 appears to be unintentionally excluded from MLA block-reuse and chunked-prefill allowlists

bugSomething isn't workingSomething isn't working

Inference runtime<NV>General operational aspects of TRTLLM execution not in other categories.<NV>General operational aspects of TRTLLM execution not in other categories.

Status: Open.

#15344 In NVIDIA/TensorRT-LLM;

· DhineshPonnarasan opened on Jun 13, 2026

[Feature]: Add TRTLLM-gen FMHA Dense paged GQA generation cubins for P16

Customized kernels<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#15339 In NVIDIA/TensorRT-LLM;

· elwhyjay opened on Jun 13, 2026

[Parity with vLLM, SGLang, ATOM]: Public Nightly NGC docker images too

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#15328 In NVIDIA/TensorRT-LLM;

· functionstackx opened on Jun 12, 2026

[Feature]: Expose per-request scheduling priority in the trtllm-serve OpenAI frontend

LLM API<NV>High-level LLM Python API & tools (e.g., trtllm-llmapi-launch) for TRTLLM inference/workflows.<NV>High-level LLM Python API & tools (e.g., trtllm-llmapi-launch) for TRTLLM inference/workflows.

Status: Open.

#15327 In NVIDIA/TensorRT-LLM;

· sopwg612 opened on Jun 12, 2026

[Bug]: Qwen3.5-397B-A17B (bf16) OOMs host RAM on the PyTorch backend; AutoDeploy loads fine on the same node

bugSomething isn't workingSomething isn't working

MemoryMemory utilization in TRTLLM: leak/OOM handling, footprint optimization, memory profiling.Memory utilization in TRTLLM: leak/OOM handling, footprint optimization, memory profiling.

Pytorch<NV>Pytorch backend related issues<NV>Pytorch backend related issues

Status: Open.

#15296 In NVIDIA/TensorRT-LLM;

· KyleShao1016 opened on Jun 12, 2026

[Bug]: GLM-5.1-FP8 produces corrupted output under tool-use on H200 (deepseek_v3.2 FP8 path)

bugSomething isn't workingSomething isn't working

Customized kernels<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.<NV>Specialized/modified CUDA kernels in TRTLLM for LLM ops, beyond standard TRT. Dev & perf.

Pytorch<NV>Pytorch backend related issues<NV>Pytorch backend related issues

Status: Open.

#15295 In NVIDIA/TensorRT-LLM;

· KyleShao1016 opened on Jun 12, 2026

[Feature]: AutoDeploy: Remove host sync for MTP + overlap scheduler + mixed prefill/decode batches

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#15289 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Jun 12, 2026

[Feature Request] AutoDeploy: enable DeepSeek R1 MTP

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

Speculative Decoding<NV>MTP/Eagle/Medusa/Lookahead/Prompt-Lookup-Decoding/Draft-Target-Model/ReDrafter<NV>MTP/Eagle/Medusa/Lookahead/Prompt-Lookup-Decoding/Draft-Target-Model/ReDrafter

Status: Open.

#15277 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Jun 11, 2026

[auto-dev]: Auto discovery of auto-dev skills

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#15218 In NVIDIA/TensorRT-LLM;

· galagam opened on Jun 10, 2026

[Doc]: Broken AutoDeploy README link to llm_args.py

Doc<NV>TRTLLM's textual/illustrative materials: API refs, guides, tutorials. Improvement & clarity.<NV>TRTLLM's textual/illustrative materials: API refs, guides, tutorials. Improvement & clarity.

Status: Open.

#15191 In NVIDIA/TensorRT-LLM;

· peter941221 opened on Jun 10, 2026

[Doc]: Broken relative links in example READMEs

Doc<NV>TRTLLM's textual/illustrative materials: API refs, guides, tutorials. Improvement & clarity.<NV>TRTLLM's textual/illustrative materials: API refs, guides, tutorials. Improvement & clarity.

Status: Open.

#15189 In NVIDIA/TensorRT-LLM;

· peter941221 opened on Jun 10, 2026

[Feature]: AutoDeploy pipeline cache test coverage

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#15186 In NVIDIA/TensorRT-LLM;

· nvchenghaoz opened on Jun 10, 2026