Skip to content

ci: Support incremental and nightly mutation testing#62

Merged
geeknoid merged 1 commit into
mainfrom
mutants
Nov 24, 2025
Merged

ci: Support incremental and nightly mutation testing#62
geeknoid merged 1 commit into
mainfrom
mutants

Conversation

@geeknoid

@geeknoid geeknoid commented Nov 21, 2025

Copy link
Copy Markdown
Member

Addresses #60

@geeknoid geeknoid requested review from Copilot, martin-kolinek and sandersaares and removed request for Copilot November 21, 2025 20:04
@geeknoid geeknoid changed the title Support incremental and nightly mutation testing ci: Support incremental and nightly mutation testing Nov 21, 2025
Copilot AI review requested due to automatic review settings November 21, 2025 20:07
@codecov

codecov Bot commented Nov 21, 2025

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 100.0%. Comparing base (32e413b) to head (6e2903a).
⚠️ Report is 7 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff            @@
##             main      #62     +/-   ##
=========================================
  Coverage   100.0%   100.0%             
=========================================
  Files          33       52     +19     
  Lines        3291     6364   +3073     
=========================================
+ Hits         3291     6364   +3073     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a two-tiered mutation testing strategy: incremental testing on PRs and comprehensive nightly testing. The incremental approach on PRs tests only the diff to reduce CI time, while the new nightly workflow performs full mutation testing on a weekly schedule (or manually), but only when there have been commits in the last 24 hours.

  • Adds a new nightly workflow that runs full mutation testing weekly (Mondays at 5:30 AM UTC) with a gatekeeper to skip if no recent commits
  • Modifies the main workflow to run incremental mutation testing on PR diffs only, reducing testing time from potentially 90+ minutes to 45 minutes
  • Both workflows use the same tooling versions (cargo-mutants 25.3.1, Rust 1.91, sccache v0.12.0) for consistency

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.

File Description
.github/workflows/nightly.yml New workflow file that adds scheduled full mutation testing with a gatekeeper job to skip when no recent commits exist
.github/workflows/main.yml Modified mutation testing to be incremental by generating and testing only the PR diff, reducing execution time

Comment thread .github/workflows/nightly.yml Outdated
Comment thread .github/workflows/main.yml
Comment thread .github/workflows/nightly.yml Outdated
@geeknoid geeknoid force-pushed the mutants branch 2 times, most recently from 99e3a2e to 2421347 Compare November 21, 2025 20:26
@geeknoid

Copy link
Copy Markdown
Member Author

@copilot

Copilot AI commented Nov 21, 2025

Copy link
Copy Markdown
Contributor

@geeknoid I've opened a new pull request, #63, to work on those changes. Once the pull request is ready, I'll request review from you.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated 6 comments.

Comment thread .github/workflows/nightly.yml
Comment thread .github/workflows/nightly.yml Outdated
Comment thread .github/workflows/nightly.yml
Comment thread .github/workflows/nightly.yml Outdated
Comment thread .github/workflows/main.yml
Comment thread .github/workflows/nightly.yml
@geeknoid geeknoid merged commit d3ef284 into main Nov 24, 2025
18 checks passed
@geeknoid geeknoid deleted the mutants branch November 24, 2025 14:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants