Skip to content
vLLM Benchmark

vLLM Benchmark #762

Sign in to view logs

vLLM Benchmark

vLLM Benchmark #762

Run time

Learn about OS pricing on GitHub Actions
Job Run time
set-parameters
8s
Run vLLM benchmarks (linux.aws.h100.4, meta-llama/meta-llama-3.1-70b-instruct)
45m 3s
Run vLLM benchmarks (linux.aws.h100, meta-llama/meta-llama-3.1-8b-instruct)
20m 38s
Run vLLM benchmarks (linux.aws.a100, meta-llama/meta-llama-3.1-8b-instruct)
21m 42s
Run vLLM benchmarks (linux.aws.h100.4, mistralai/mixtral-8x7b-instruct-v0.1)
19m 12s
Run vLLM benchmarks (linux.aws.h100.8, meta-llama/llama-4-maverick-17b-128e-instruct-fp8)
43m 16s
Run vLLM benchmarks (linux.24xl.spr-metal, meta-llama/meta-llama-3.1-8b-instruct)
3m 40s
Run vLLM benchmarks (linux.aws.h100.4, meta-llama/llama-4-scout-17b-16e-instruct)
51m 32s
Run vLLM benchmarks (linux.aws.h100.8, google/gemma-3-27b-it)
1s
Run vLLM benchmarks (linux.aws.a100, google/gemma-3-4b-it)
16m 52s
Run vLLM benchmarks (linux.aws.h100, google/gemma-3-4b-it)
12m 38s
Run vLLM benchmarks (linux.rocm.gpu.mi300.4, meta-llama/meta-llama-3.1-70b-instruct)
50m 19s
Run vLLM benchmarks (linux.aws.h100.8, qwen/qwen3-30b-a3b)
2h 3m 31s
Run vLLM benchmarks (linux.aws.a100, qwen/qwen3-8b)
14m 39s
Run vLLM benchmarks (linux.aws.h100, qwen/qwen3-8b)
13m 54s
Run vLLM benchmarks (linux.rocm.gpu.mi300.2, meta-llama/meta-llama-3.1-8b-instruct)
22m 55s
Run vLLM benchmarks (linux.rocm.gpu.mi300.8, qwen/qwen3-30b-a3b)
26m 58s
Run vLLM benchmarks (linux.rocm.gpu.mi300.8, google/gemma-3-27b-it)
20m 14s
Run vLLM benchmarks (linux.rocm.gpu.mi300.2, mistralai/mixtral-8x7b-instruct-v0.1)
2h 3m 35s
Run vLLM benchmarks (linux.rocm.gpu.mi300.8, meta-llama/llama-4-maverick-17b-128e-instruct-fp8)
2h 3m 36s
Run vLLM benchmarks (linux.rocm.gpu.mi300.2, google/gemma-3-4b-it)
13m 1s
Run vLLM benchmarks (linux.rocm.gpu.mi300.4, meta-llama/llama-4-scout-17b-16e-instruct)
1h 13m 7s
Run vLLM benchmarks (linux.rocm.gpu.mi300.2, qwen/qwen3-8b)
13m 55s
14h 14m 26s