Skip to content

Conversation

@marioevz
Copy link
Member

🗒️ Description

There's been intermittent failures during the execution of our "tests-deployed" CI runs, e.g. https://github.com/ethereum/execution-spec-tests/actions/runs/16357127699/job/46217991982?pr=1922

This PR marks the longest tests as slow in order to skip them from these runs (run in every single PR) in order to alleviate the strain on our CI runners.

🔗 Related Issues or PRs

N/A.

✅ Checklist

  • All: Ran fast tox checks to avoid unnecessary CI fails, see also Code Standards and Enabling Pre-commit Checks:
    uvx --with=tox-uv tox -e lint,typecheck,spellcheck,markdownlint
  • All: PR title adheres to the repo standard - it will be used as the squash commit message and should start type(scope):.
  • All: Considered adding an entry to CHANGELOG.md.
  • All: Considered updating the online docs in the ./docs/ directory.
  • All: Set appropriate labels for the changes (only maintainers can apply labels).

@marioevz marioevz requested a review from felix314159 July 18, 2025 16:35
@marioevz marioevz added type:bug Something isn't working scope:tests Scope: Changes EL client test cases in `./tests` scope:ci Scope: Continuous Integration labels Jul 18, 2025
Copy link
Collaborator

@spencer-tb spencer-tb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Quick approve from me!

@marioevz marioevz merged commit 0fdd974 into main Jul 18, 2025
14 checks passed
@marioevz marioevz deleted the mark-more-slow-tests branch July 18, 2025 17:40
kclowes pushed a commit to kclowes/execution-spec-tests that referenced this pull request Oct 20, 2025
* fix(tests): Mark slowest deployed tests as slow

* fix(tests): Update test_scenarios.py with coveraged missed reason
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

scope:ci Scope: Continuous Integration scope:tests Scope: Changes EL client test cases in `./tests` type:bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants