v0.0.55

fix: disable EAGLE3 speculative decoding for gpt-oss-120b

Streaming responses were consistently dropping the last 1-2 tokens due to a vLLM v0.12.0 EAGLE3 bug. Non-streaming was unaffected.

v0.0.54

fix: update gpt-oss image

v0.0.53

Update model configs, remove GLM-4.7, add gpt-oss-single

v0.0.52

Full Changelog: v0.0.51...v0.0.52

v0.0.50

Changes

• Update nearaidev/vllm-proxy-rs image digest across GLM-5, small-models, and Qwen3.5-122B configs (#3)
• Remove unrecognized vLLM args (--max-cudagraph-capture-size, --stream-interval) from gpt-oss-120b (#4)

v0.0.49

Changes

• Increase nginx proxy_read_timeout from 300s to 3600s across all CVM configs — fixes timeout errors for long-context inference requests (100K+ tokens) where prefill exceeds 5 minutes (#1)
• Update gpt-oss vLLM image to newer version (#2)

v0.0.48

• Update gpt-oss vllm image digest

v0.0.47

• Update vllm-proxy-rs to d46dd03 (attestation cache, GPU evidence serialization, retry on failure)

v0.0.46

• fix: update all vllm/vllm-openai images to new digest to address CUDA/NCCL crashes
• fix: reduce gpt-oss-120b GPU memory utilization to 0.90

v0.0.45

• fix: reduce gpt-oss-120b GPU memory utilization from 0.95 to 0.90 to address CUDA OOM crashes