Skip to content

ci: Introduce anti-regression-shield#6518

Draft
artemyarulin wants to merge 1 commit intomainfrom
tests/anti-regression-shield
Draft

ci: Introduce anti-regression-shield#6518
artemyarulin wants to merge 1 commit intomainfrom
tests/anti-regression-shield

Conversation

@artemyarulin
Copy link
Copy Markdown
Contributor

@artemyarulin artemyarulin commented Apr 26, 2026

Rework on previous python upstream tests.

  • First of all it's now called Anti-Regression Shield (patent pending) or shield in short 🛡️
  • It now includes tests:
    • Python: 37,966 🐍
    • Node: 4,906 🌐
    • PHP: 19,915 💩
    • Rust: 22,120 💠
  • It now detects crashes - panics, RuntimeError, stack overflow and others
  • Reports are now state of the art better looking, actionable, human and LLM friendly. So you can copy paste report to the agent and it will have everything in the context for debugging
  • This PR makes those tests to run automatically to run as part of CI. On average it takes an hour to build. It should be possible to reduce it to 30-40 minutes I'm sure
  • For outside contributors with PR from forks it's still possible to run a test via requesting build manually. Review the PR manually first, then go to https://github.com/wasmerio/anti-regression-shield/actions/workflows/pr.yml, press Run workflow, fill the form and build with normal reporting will happen. All PR jobs runs totally isolated with no tokens available, so it is safe. Having that feature would allows us to accept outside contribution with much easier flow, especially WASIX fixes that we got now and then
image

More info on Anti-Regression Shield (c) you can find in https://github.com/wasmerio/anti-regression-shield

@artemyarulin artemyarulin force-pushed the tests/anti-regression-shield branch 3 times, most recently from 0b5e9eb to 5b8a08c Compare April 26, 2026 18:29
@artemyarulin artemyarulin force-pushed the tests/anti-regression-shield branch from 5b8a08c to 5ff722e Compare April 26, 2026 18:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant