Skip to content

Commit b9843c8

Browse files
committed
bench: add impl filters and bash scripts for fast runs
- Add --include-impls/--exclude-impls to runner.py - Create run_fast.sh for native-only benchmarks - Create make_report.sh for artifact generation - Fix BEAM impls to skip unsupported BA graphs gracefully - Add exception handling for serial task execution
1 parent f0aaccf commit b9843c8

File tree

2 files changed

+32
-0
lines changed

2 files changed

+32
-0
lines changed

make_report.sh

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
#!/bin/bash
2+
set -euo pipefail
3+
4+
# Generate plot and report from latest results
5+
OUTDIR=${1:-"results-1000x-fast"}
6+
echo "Generating artifacts for $OUTDIR..."
7+
8+
CSV=$(ls -1 "$OUTDIR"/agg-*.csv | tail -n1)
9+
META=$(ls -1 "$OUTDIR"/meta-*.yaml 2>/dev/null | tail -n1 || true)
10+
11+
python3 bench/plots.py "$CSV" --out "$OUTDIR"
12+
python3 bench/make_report.py --csv "$CSV" ${META:+--meta "$META"} --out "$OUTDIR"
13+
14+
echo "Generated:"
15+
echo " $OUTDIR/time_vs_popped.png"
16+
echo " $OUTDIR/REPORT.md"

run_fast.sh

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
#!/bin/bash
2+
set -euo pipefail
3+
4+
# Fast native-only 1000x benchmark
5+
OUTDIR="results-1000x-fast"
6+
echo "Running fast 1000x benchmark (rust,c,cpp,nim only)..."
7+
python3 bench/runner.py \
8+
--params bench/params_1000x.yaml \
9+
--shared-inputs \
10+
--include-impls rust,c,cpp,nim \
11+
--release \
12+
--jobs 1 \
13+
--timeout-seconds 3600 \
14+
--out "$OUTDIR"
15+
16+
echo "Fast benchmark complete. Results in $OUTDIR/"

0 commit comments

Comments
 (0)