Skip to content

perf(pipeline): Add sustained benchmark validation - #28

Merged
rahulbsw merged 2 commits into
mainfrom
docs/streamforge-launch-campaign-assets
Jul 25, 2026
Merged

perf(pipeline): Add sustained benchmark validation#28
rahulbsw merged 2 commits into
mainfrom
docs/streamforge-launch-campaign-assets

Conversation

@rahulbsw

Copy link
Copy Markdown
Owner

Summary

  • add partition-ordered processing and exact delivery accounting for trustworthy
    throughput validation
  • replace startup-inclusive measurements with separate ingress, output, and
    metrics-validator jobs plus sustained repetitions
  • refresh the Criterion and on-demand throughput workflows with structured
    evidence artifacts
  • consolidate the documentation and rebuild GitHub Pages as a curated
    open-source product site
  • add branded site assets, link validation, benchmark methodology, and a
    demo-recording runbook

Why

The earlier throughput path mixed environment startup, data ingress,
processing, and validation. This change makes the environment warm before
timing, validates exact input/output counts, and records reproducible evidence
without presenting a universal throughput claim.

Validation

  • cargo test --all: 474 passed, 0 failed, 30 ignored
  • cargo clippy --all-targets --offline -- -D warnings: passed
  • cargo fmt --all -- --check: passed
  • benchmark helper unit tests: 6 passed
  • benchmark shell syntax and JSON schema validation: passed
  • Podman Compose configuration: passed; Kafka remains bound to 127.0.0.1
    and the benchmark network is internal
  • local Jekyll build and generated-site internal-link validation: passed
  • sustained local benchmark: three 120-second repetitions with exact
    record-count validation and zero processing errors; intentionally not
    promoted as a public headline result because the run was ingress-limited

Follow-up

Run the same sustained harness on a cost-capped AWS ECS-on-EC2 environment
provisioned as code, with no service exposed to the public internet.

Add partition-ordered processing and exact delivery accounting, introduce the sustained benchmark job harness, and consolidate the public documentation and GitHub Pages experience.

Co-Authored-By: claude-flow <ruv@ruv.net>
Resolve RUSTSEC-2026-0204 by locking crossbeam-epoch to the minimum patched release, 0.9.20.

Co-Authored-By: claude-flow <ruv@ruv.net>
@github-actions github-actions Bot added the dependencies Pull requests that update a dependency file label Jul 25, 2026
@rahulbsw rahulbsw changed the title perf(pipeline): add sustained benchmark validation perf(pipeline): Add sustained benchmark validation Jul 25, 2026
@rahulbsw rahulbsw added security Security-related changes skip-size-check Bypass PR size check for intentionally large PRs enhancement New feature or request labels Jul 25, 2026
@rahulbsw
rahulbsw marked this pull request as ready for review July 25, 2026 17:07
@rahulbsw
rahulbsw merged commit c2ab4e3 into main Jul 25, 2026
65 of 71 checks passed
rahulbsw added a commit that referenced this pull request Jul 25, 2026
…-assets

perf(pipeline): Add sustained benchmark validation
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/config area/core area/dsl area/kafka benchmarks ci/cd component/docker dependencies Pull requests that update a dependency file documentation Improvements or additions to documentation enhancement New feature or request examples infrastructure needs-review performance security Security-related changes size/XL skip-size-check Bypass PR size check for intentionally large PRs tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant