Search results

Standardized Sweep Numbers

priority-medium

Status: Open.

Feature

#156 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Sweep Mode Improvements - get closer to approaching peak-throughput

load-requestload-request workstreamload-request workstream

priority-high

Status: Open.

Feature

#155 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Standardize dataset profiles for reasoning benchmarking

priority-high

Status: Open.

Feature

#154 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Support Audio to text multi-modal benchmarking in GuideLLM

priority-high

Status: Open.

Feature

#153 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Support VL Model Benchmarking

multi-modalSupport for benchmarking new multi-modal modelsSupport for benchmarking new multi-modal models

priority-high

Status: Open.

#152 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Event loop is closed error.

bugSomething isn't workingSomething isn't working

priority-high

Status: Open.

Bug

#147 In neuralmagic/guidellm;

· phalani-paladugu opened on May 5, 2025

support for multi-turn qa dataset

priority-medium

Status: Open.

Feature

#138 In neuralmagic/guidellm;

· ashishkamra opened on Apr 25, 2025

GuideLLM Sweep Benchmark: Low KV Cache Utilization and Limited QPS on H100 GPUs

Status: Open.

#136 In neuralmagic/guidellm;

· kaushikmitr opened on Apr 25, 2025

GuideLLM DS Generation Engine #26

Status: Open.

#134 In neuralmagic/guidellm;

· SharonGil opened on Apr 24, 2025

Add Docker and Kubernetes Support for GuideLLM Benchmarking

Status: Open.

Feature

#119 In neuralmagic/guidellm;

· wangchen615 opened on Apr 17, 2025

Sweep mode with --max-seconds fails ungracefully if calculated RPS is too low

priority-low

Status: Open.

Bug

#115 In neuralmagic/guidellm;

· sjmonson opened on Apr 15, 2025

[Bug] Possibly incorrect output dump ? (The actual data appears to be fine)

good first issueGood for newcomersGood for newcomers

priority-medium

Status: Open.

Bug

#114 In neuralmagic/guidellm;

· thameem-abbas opened on Apr 15, 2025