Skip to content

[codex] Update serving SOTA loop framework docs#71

Merged
BBuf merged 5 commits into
mainfrom
codex/tokenspeed-sota-loop-docs
Jun 26, 2026
Merged

[codex] Update serving SOTA loop framework docs#71
BBuf merged 5 commits into
mainfrom
codex/tokenspeed-sota-loop-docs

Conversation

@BBuf

@BBuf BBuf commented Jun 26, 2026

Copy link
Copy Markdown
Owner

Summary

  • Add TokenSpeed and TensorRT-LLM PR optimization history folders with Qwen3.5 and Kimi bilingual diff-backed dossiers.
  • Extend llm-serving-auto-benchmark and llm-torch-profiler-analysis for TokenSpeed/TensorRT-LLM flows, official-container runbooks, cookbook configs, and normalized comparison output.
  • Update sglang-sota-humanize-loop so SGLang is the fixed target while comparison_frameworks is caller-controlled, including vLLM-only comparison support.
  • Refresh the root README and SGLang SOTA SVG to describe selected comparison frameworks instead of a fixed SGLang/vLLM/TRT-LLM set.

Validation

  • xmllint --noout docs/assets/sglang-sota-performance-loop.svg
  • git diff --check --cached
  • python3 skills/llm-serving-auto-benchmark/scripts/validate_cookbook_configs.py skills/llm-serving-auto-benchmark/configs/cookbook-llm
  • python3 -m unittest discover tests
  • python3 model-pr-optimization-history/scripts/query.py --list

Notes

This keeps compiled-output review out of the SOTA loop, per request, and focuses the loop on selected serving competitors, profiler evidence, and PR-history-backed source choices.

@BBuf
BBuf marked this pull request as ready for review June 26, 2026 15:24
@BBuf
BBuf merged commit 9eba646 into main Jun 26, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant