Skip to content

Commit d6c169b

Browse files
committed
bench: record initial native baseline
1 parent b4cb086 commit d6c169b

4 files changed

Lines changed: 575 additions & 9 deletions

File tree

README.mbt.md

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -92,15 +92,16 @@ moon info
9292
```
9393

9494
The ASan entry point is `scripts/run-asan.mjs`. The performance gate is
95-
`scripts/bench-gate.mjs`; it requires a clean committed baseline so its
96-
manifest can contain a real commit SHA. See
95+
`scripts/bench-gate.mjs`. Its committed
96+
[`benchmarks/baseline.json`](benchmarks/baseline.json) binds the fixed
97+
workloads and 20 raw samples to clean commit
98+
`29f4ff26dcb507715a0bfdacd58a0a3b48f3c776`. See
9799
[`benchmarks/README.md`](benchmarks/README.md).
98100

99101
The generated per-item upstream inventory is
100102
[`docs/upstream-coverage.json`](docs/upstream-coverage.json). Public interfaces
101103
are reviewed through every `pkg.generated.mbti`; DTLS record ciphers, PRF/key
102104
schedule helpers, crypto providers, parsers, and replay state remain internal.
103105

104-
The project is dual-licensed under MIT or Apache-2.0. It remains pre-1.0 until
105-
the first clean release commit can provide the benchmark baseline's truthful
106-
commit identity.
106+
The project is dual-licensed under MIT or Apache-2.0. It remains pre-1.0 while
107+
the reviewed public API is intentionally experimental.

UPSTREAM.md

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -111,8 +111,6 @@ The repository contains:
111111
stubs while disabling the bundled allocator;
112112
- seven native release benchmarks and a self-testing interleaved regression
113113
gate;
114+
- a five-warmup, twenty-sample raw benchmark baseline tied to clean commit
115+
`29f4ff26dcb507715a0bfdacd58a0a3b48f3c776`;
114116
- generated `.mbti` files for public-interface review.
115-
116-
`benchmarks/baseline.json` must be recorded from the first clean release
117-
commit; this repository currently has no commit from which a truthful
118-
baseline SHA can be recorded.

benchmarks/README.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,11 @@
44
The gate checks the benchmark source hash, so workload changes require a
55
reviewed baseline update.
66

7+
The current manifest was recorded from clean commit
8+
`29f4ff26dcb507715a0bfdacd58a0a3b48f3c776` with five warmups and twenty
9+
samples. It retains the runner fingerprint (machine, CPU model, and optional
10+
runner ID), aggregates, and complete raw benchmark output.
11+
712
Record a baseline only from a clean commit:
813

914
```sh
@@ -27,5 +32,9 @@ fixed-workload throughput falls by more than 20%. Set
2732
`RTC_BENCH_RUNNER_ID` to a stable dedicated-runner identifier before both
2833
recording and comparing.
2934

35+
Both worktrees use the MoonBit toolchain installed in the current environment.
36+
The manifest intentionally does not record or require a specific MoonBit
37+
version.
38+
3039
Use `scripts/bench-gate.mjs self-test` to validate parsing and threshold logic
3140
without running benchmarks.

0 commit comments

Comments
 (0)