Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions cpp/benchmarks/bench_utils.h
Original file line number Diff line number Diff line change
Expand Up @@ -180,6 +180,13 @@ inline double thresholdForMetric(const std::string& name) {
if (name.find("binary_size") != std::string::npos) {
return 10.0;
}
// Per-step growth is a single-digit-KB metric, so a single feature addition
// (e.g. VLM image support adding ~4 KB/step for new content-block storage)
// reads as a 50%+ swing. Use a wider band so legitimate feature additions
// don't fail the gate while still catching true 2x-style regressions.
if (name == "memory_per_step_growth_kb") {
return 75.0;
}
// All other metrics: 15% threshold
return 15.0;
}
Expand Down
Loading