Search results

Use vLLM Native Simulator for KV-Cache simulation

Status: Open.

#599 In llm-d/llm-d-inference-sim;

· mayabar opened on Jul 29, 2026

openai api streaming incompatibility with vllm when hitting max_model_len

Status: Open.

#596 In llm-d/llm-d-inference-sim;

· yamt opened on Jul 29, 2026

Simulate additional features in multi-media encode mode

Status: Open.

#388 In llm-d/llm-d-inference-sim;

· mayabar opened on Mar 12, 2026

·  

Future

Chunk size in streaming

Status: Open.

#308 In llm-d/llm-d-inference-sim;

· irar2 opened on Jan 21, 2026

·  

Future

Add support for cache hit threshold

lifecycle/rotten

Status: Open.

#300 In llm-d/llm-d-inference-sim;

· mayabar opened on Jan 7, 2026

·  

Future

Integrate BLIS as a High-Fidelity vLLM Performance Model in llm-d-inference-sim

lifecycle/rotten

Status: Open.

#285 In llm-d/llm-d-inference-sim;

· sriumcp opened on Dec 15, 2025

Move sample response datasets under llm-d HF organization

Status: Open.

#206 In llm-d/llm-d-inference-sim;

· mayabar opened on Sep 30, 2025

·  

Future

Support --max-num-batched-tokens configuration parameter

enhancementNew feature or requestNew feature or request

lifecycle/stale

Status: Open.

#83 In llm-d/llm-d-inference-sim;

· mayabar opened on Jul 10, 2025

·  

Future