Search results

tensorrtllm_backend doesn't work with remote repos

bugSomething isn't workingSomething isn't working

Status: Open.

#727 In triton-inference-server/tensorrtllm_backend;

· ShuaiShao93 opened on Mar 19, 2025

Failed to launch triton server with Qwen2-VL

Status: Open.

#724 In triton-inference-server/tensorrtllm_backend;

· shjas94 opened on Mar 16, 2025

build.sh not able to run due to python dependency issues

Status: Open.

#723 In triton-inference-server/tensorrtllm_backend;

· BenjaminBraunDev opened on Mar 11, 2025

Fail to test DraftTarget model with triton server tensorrtllm backend

bugSomething isn't workingSomething isn't working

Status: Open.

#720 In triton-inference-server/tensorrtllm_backend;

· gloritygithub11 opened on Mar 10, 2025

I want the dll version for Windows of tensorrt_llmbackend

Status: Open.

#719 In triton-inference-server/tensorrtllm_backend;

· dhkdnduq opened on Mar 8, 2025

How to load lora weights when launching tritonserver

Status: Open.

#718 In triton-inference-server/tensorrtllm_backend;

· shinesmilels opened on Mar 7, 2025

Can't recursively update tensorrt_llm submodule 3rdparty directory links

Status: Open.

#717 In triton-inference-server/tensorrtllm_backend;

· BenjaminBraunDev opened on Mar 4, 2025

TensorRT-LLM Backend with multiple LLMs (not to be confused with multi-model)

Status: Open.

#714 In triton-inference-server/tensorrtllm_backend;

· dduck999 opened on Feb 27, 2025

Missing lookAheadRuntimeConfig in Triton Server with TensorRT-LLM backend HTTP Request

bugSomething isn't workingSomething isn't working

Status: Open.

#711 In triton-inference-server/tensorrtllm_backend;

· shaylapid opened on Feb 18, 2025

Tritonserver Fails to Start with TensorRT-LLM Backend with lookahead_decoding mode - Assertion Failure in lookaheadDecodingLayer.cpp

bugSomething isn't workingSomething isn't working

Status: Open.

#710 In triton-inference-server/tensorrtllm_backend;

· shaylapid opened on Feb 18, 2025

Langgraph support

Status: Open.

#709 In triton-inference-server/tensorrtllm_backend;

· GGN1994 opened on Feb 18, 2025

Failed to build TensorRT-LLM whisper Decoder

bugSomething isn't workingSomething isn't working

Status: Open.

#707 In triton-inference-server/tensorrtllm_backend;

· muhammad-faizan-122 opened on Feb 14, 2025