Search results

model_analyzer container gets Connection refused (111)

Status: Open.

#958 In triton-inference-server/model_analyzer;

· ElsayedMMohammed opened on Jan 13, 2025

Facing issue in config search with Batch Size, Dynamic Batching, and Sequence Length

Status: Open.

#957 In triton-inference-server/model_analyzer;

· harsh-boloai opened on Jan 13, 2025

[Question]: Is the Server Only GPU memory usage included in the gpu usage for the specific models?

Status: Open.

#955 In triton-inference-server/model_analyzer;

· SDJustus opened on Jan 3, 2025

model_analyzer profile with mig : DCGM initialization error

Status: Open.

#954 In triton-inference-server/model_analyzer;

· jason-i-vv opened on Dec 25, 2024

TritonModelAnalyzerException: [StatusCode.UNAVAILABLE] failed to connect to all addresses; Failed to connect to remote host: Timeout occurred: FD Shutdown

Status: Open.

#950 In triton-inference-server/model_analyzer;

· C-Dhayananthan opened on Nov 26, 2024

Latency report file from perf analyzer is not found

Status: Open.

#937 In triton-inference-server/model_analyzer;

· shreyassks opened on Oct 8, 2024

Invalid genai-perf command line for LLM model type

Status: Open.

#935 In triton-inference-server/model_analyzer;

· vlad-vinogradov-47 opened on Oct 2, 2024

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf8 in position 0: invalid start byte

Status: Open.

#931 In triton-inference-server/model_analyzer;

· Anas0x45 opened on Sep 12, 2024

model_analyzer.model_analyzer_exceptions.TritonModelAnalyzerException: The first 2 attempts to acquire measurements have failed.

Status: Open.

#920 In triton-inference-server/model_analyzer;

· gizarchik opened on Jul 26, 2024

DCGM initialization error

Status: Open.

#910 In triton-inference-server/model_analyzer;

· minhhoai1001 opened on Jul 9, 2024

wrong with --triton-launch-mode=remote

Status: Open.

#908 In triton-inference-server/model_analyzer;

· RheaRia opened on Jul 4, 2024

How to analyze large models like llama 3 70B that requires model parallelism?

Status: Open.

#907 In triton-inference-server/model_analyzer;

· ccchow opened on Jun 28, 2024