Skip to content

perf(benchmarks): Add AWS sustained baseline - #32

Merged
rahulbsw merged 7 commits into
mainfrom
benchmark/aws
Jul 25, 2026
Merged

perf(benchmarks): Add AWS sustained baseline#32
rahulbsw merged 7 commits into
mainfrom
benchmark/aws

Conversation

@rahulbsw

Copy link
Copy Markdown
Owner

Summary

  • add a cost-bounded Terraform and ECS-on-EC2 benchmark environment with no public ingress or public IPs
  • correct container startup dependencies and preserve the Confluent Python runtime
  • publish a schema-v3 sustained AWS baseline: 106,692.65 msg/s median across three 120-second engine-saturated repetitions
  • consolidate benchmark documentation and add the validated headline to GitHub Pages

Validation

  • exact 16,200,000 ingress, consumed, produced, delivered, and independently observed output records per repetition
  • zero processing or delivery errors; 0.0580% coefficient of variation
  • benchmark helper tests: 8 passed
  • Rust suite: 474 passed, 0 failed, 30 ignored
  • Terraform fmt and validate passed before provisioning
  • ECR scan completed with zero critical findings
  • Terraform destroyed 45 resources; direct inventories show zero live benchmark resources

Security and cost

  • private subnet only; no IGW, NAT, load balancer, SSH, public IP, or public CIDR rule
  • one bounded c7i.2xlarge host with hard expiry
  • estimated run cost below $1 before taxes and account discounts

The result is a StreamForge baseline, not a matched Java comparison. The Java/Rust comparison remains pending.

@github-actions github-actions Bot added documentation Improvements or additions to documentation area/core component/docker size/XL labels Jul 25, 2026
@rahulbsw rahulbsw changed the title perf(benchmarks): add private AWS sustained baseline perf(benchmarks): Add private AWS sustained baseline Jul 25, 2026
@rahulbsw rahulbsw added security Security-related changes skip-size-check Bypass PR size check for intentionally large PRs labels Jul 25, 2026
@rahulbsw rahulbsw changed the title perf(benchmarks): Add private AWS sustained baseline perf(benchmarks): Add AWS sustained baseline Jul 25, 2026
@rahulbsw
rahulbsw merged commit 6134305 into main Jul 25, 2026
36 of 40 checks passed
@rahulbsw
rahulbsw deleted the benchmark/aws branch July 25, 2026 22:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/core component/docker documentation Improvements or additions to documentation security Security-related changes size/XL skip-size-check Bypass PR size check for intentionally large PRs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant