[Benchmark] Add benchmark functional test framework with Qwen3 test case#1145

Merged

Caozhou1995 merged 22 commits into

flagos-ai:mainfrom

zihugithub:add-benchmark

Mar 19, 2026

Commits on Mar 11, 2026

[CICD] Add benchmark functional tests for DeepSeek
zihugithub
committed
debug0
zihugithub
committed
debug0
zihugithub
committed
[Benchmark] Enable throughput logging for DeepSeek benchmark test
zihugithub
committed
debug1
zihugithub
committed

Commits on Mar 12, 2026

[Benchmark] Add benchmark functional tests for Aquila and Mixtral
zihugithub
committed
[Benchmark] Update gold values for Aquila and Mixtral benchmark tests
zihugithub
committed
[Benchmark] Add benchmark functional tests for DeepSeek, Aquila and Mixtral
zihugithub
committed
[Benchmark] Fix code formatting in check_results.py
zihugithub
committed
[Benchmark] Replace Aquila, DeepSeek and Mixtral benchmark tests with Qwen3
zihugithub
committed

Commits on Mar 13, 2026

Add benchmark data upload step to backend after successful tests
zihugithub
committed
[Benchmark] Add benchmark output parser and update metrics upload.
zihugithub
committed

Commits on Mar 16, 2026

[Benchmark] Update post-benchmark-report action parameters
zihugithub
committed
Fix ruff formatting in parse_benchmark_output.py
zihugithub
committed
Add jq installation step before benchmark data upload
zihugithub
committed

Commits on Mar 17, 2026

[Benchmark] Support platform/device-classified gold values for benchmark tests
zihugithub
committed

Commits on Mar 18, 2026

Merge branch 'main' into add-benchmark
zihugithub
authored
Fix pre-commit check issues
zihugithub
committed
Add Megatron-LM installation step to benchmark pipeline
zihugithub
committed
update parse_benchmark_output.py
zihugithub
committed

Commits on Mar 19, 2026

Update benchmark metrics output to nested object format
zihugithub
committed
Fix pre-commit check issues
zihugithub
committed