Search results

GPU VRAM Leak with Python Backend BLS Requests to ORT Backend

Status: Open.

#301 In triton-inference-server/onnxruntime_backend;

· WoodieDudy opened on Mar 21, 2025

OpenVINO CPU Execution Accelerator Fails with "Device with 'NPU' name is not registered" Error

Status: Open.

#300 In triton-inference-server/onnxruntime_backend;

· alib1513 opened on Mar 20, 2025

Limited GPU Memory Utilization in ColBERT Deployment

Status: Open.

#293 In triton-inference-server/onnxruntime_backend;

· nauyan opened on Jan 17, 2025

Parallel warmup when using multiple GPUs

Status: Open.

#292 In triton-inference-server/onnxruntime_backend;

· asaff1 opened on Jan 12, 2025

Built-in support for (custom?) decryption of model weights

Status: Open.

#279 In triton-inference-server/onnxruntime_backend;

· vadimkantorov opened on Oct 28, 2024

Deploy TTS model with Triton and onnx backend, failed:Protobuf parsing failed

Status: Open.

#272 In triton-inference-server/onnxruntime_backend;

· AnasAlmana opened on Sep 25, 2024

[Question] Multiple model inputs and GPU allocations

Status: Open.

#269 In triton-inference-server/onnxruntime_backend;

· msyulia opened on Aug 29, 2024

load_model fail cause gpu memory leak

Status: Open.

#268 In triton-inference-server/onnxruntime_backend;

· zjd1988 opened on Aug 27, 2024

How do I get all possible input and output names?

Status: Open.

#267 In triton-inference-server/onnxruntime_backend;

· zhmiao opened on Aug 22, 2024

Triton ONNX runtime backend slower than onnxruntime python client on CPU

Status: Open.

#265 In triton-inference-server/onnxruntime_backend;

· Mitix-EPI opened on Aug 19, 2024

OpenVINO EP doesn't respect threading parameters

Status: Open.

#260 In triton-inference-server/onnxruntime_backend;

· mbahri opened on Jul 6, 2024

UNAVAILABLE: Unsupported: Triton TRITONBACKEND API version: X does not support 'onnxruntime' TRITONBACKEND API version X

Status: Open.

#259 In triton-inference-server/onnxruntime_backend;

· pultarmi opened on Jun 28, 2024