Skip to content

Commit a7a0f68

Browse files
committed
bench: record initial native baseline
1 parent 6b2446e commit a7a0f68

4 files changed

Lines changed: 576 additions & 9 deletions

File tree

README.mbt.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -92,14 +92,16 @@ moon info
9292
```
9393

9494
The ASan entry point is `scripts/run-asan`. The performance gate is
95-
`scripts/bench-gate`; it requires a clean committed baseline so its manifest
96-
can contain a real commit SHA. See [`benchmarks/README.md`](benchmarks/README.md).
95+
`scripts/bench-gate`. Its committed
96+
[`benchmarks/baseline.json`](benchmarks/baseline.json) binds the fixed
97+
workloads and 20 raw samples to clean commit
98+
`29f4ff26dcb507715a0bfdacd58a0a3b48f3c776`. See
99+
[`benchmarks/README.md`](benchmarks/README.md).
97100

98101
The generated per-item upstream inventory is
99102
[`docs/upstream-coverage.json`](docs/upstream-coverage.json). Public interfaces
100103
are reviewed through every `pkg.generated.mbti`; DTLS record ciphers, PRF/key
101104
schedule helpers, crypto providers, parsers, and replay state remain internal.
102105

103-
The project is dual-licensed under MIT or Apache-2.0. It remains pre-1.0 until
104-
the first clean release commit can provide the benchmark baseline's truthful
105-
commit identity.
106+
The project is dual-licensed under MIT or Apache-2.0. It remains pre-1.0 while
107+
the reviewed public API is intentionally experimental.

UPSTREAM.md

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -111,8 +111,6 @@ The repository contains:
111111
stubs while disabling the bundled allocator;
112112
- seven native release benchmarks and a self-testing interleaved regression
113113
gate;
114+
- a five-warmup, twenty-sample raw benchmark baseline tied to clean commit
115+
`29f4ff26dcb507715a0bfdacd58a0a3b48f3c776`;
114116
- generated `.mbti` files for public-interface review.
115-
116-
`benchmarks/baseline.json` must be recorded from the first clean release
117-
commit; this repository currently has no commit from which a truthful
118-
baseline SHA can be recorded.

benchmarks/README.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,11 @@
44
The gate checks the benchmark source hash, so workload changes require a
55
reviewed baseline update.
66

7+
The current manifest was recorded from clean commit
8+
`29f4ff26dcb507715a0bfdacd58a0a3b48f3c776` with five warmups and twenty
9+
samples. It retains the runner fingerprint (machine, CPU model, and optional
10+
runner ID), aggregates, and complete raw benchmark output.
11+
712
Record a baseline only from a clean commit:
813

914
```sh
@@ -27,5 +32,9 @@ fixed-workload throughput falls by more than 20%. Set
2732
`RTC_BENCH_RUNNER_ID` to a stable dedicated-runner identifier before both
2833
recording and comparing.
2934

35+
Both worktrees use the MoonBit toolchain installed in the current environment.
36+
The manifest intentionally does not record or require a specific MoonBit
37+
version.
38+
3039
Use `scripts/bench-gate self-test` to validate parsing and threshold logic
3140
without running benchmarks.

0 commit comments

Comments
 (0)