Add benchmark suite with GitHub Actions workflow

[adelrodriguez]

This pull request adds a comprehensive benchmark suite for the tryharder package using the mitata benchmarking library.

Key Features

• GitHub Actions workflow that runs benchmarks weekly on Mondays and supports manual triggers
• Three benchmark suites covering core functionality, orchestration patterns, and policy behaviors
• Structured reporting that generates JSON artifacts and markdown summaries with performance metrics
• Deterministic benchmarks that import from the built dist package and avoid timer-based operations

Benchmark Coverage

The suite includes benchmarks for:

• Core runSync and run operations with success and error scenarios
• Orchestration methods like all, allSettled, and flow with various task dependencies
• Policy builders including retry, timeout, signal, and wrap functionality
• Baseline comparisons against direct function calls and native Promise operations

Infrastructure

• Benchmarks run on Bun 1.3.1 with dependency caching and 20-minute timeout
• Results are uploaded as GitHub artifacts and displayed in workflow summaries
• Output includes performance metrics (avg ns/iter, Hz, sample counts) organized by functional groups
• Comprehensive test coverage for the reporting and normalization logic

[coderabbitai]

Warning

Rate limit exceeded

@adelrodriguez has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 20 minutes and 50 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 7a6f8b18-aaa1-42f1-9d44-a2db81640826

📥 Commits

Reviewing files that changed from the base of the PR and between 0bfe1ed and bde9032.

⛔ Files ignored due to path filters (1)

• bun.lock is excluded by !**/*.lock

📒 Files selected for processing (14)

• .github/workflows/benchmarks.yml
• .gitignore
• bench/README.md
• bench/__tests__/report.test.ts
• bench/constants.ts
• bench/index.ts
• bench/report.ts
• bench/shared.ts
• bench/suites/core.bench.ts
• bench/suites/orchestration.bench.ts
• bench/suites/policies.bench.ts
• knip.json
• package.json
• tsconfig.json

Walkthrough

This pull request introduces a comprehensive benchmarking infrastructure for the project. It adds a GitHub Actions workflow that executes benchmarks weekly and on-demand, capturing results as artifacts. The implementation includes a shared benchmarking framework using mitata, three benchmark suites covering core operations, orchestration tasks, and policies, reporting utilities that generate JSON and Markdown summaries, and comprehensive test coverage. Configuration files are updated to include benchmark sources in TypeScript compilation and add necessary development dependencies, while .gitignore is updated to exclude benchmark output artifacts.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch 03-07-add_benchmark_suite_with_github_actions_workflow

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[adelrodriguez]

• Add benchmark suite with GitHub Actions workflow #40 👈 (View in Graphite)
• Change race() methods to return PromiseLike instead of Promise #39
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7f523a0837

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d65d200b12

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".