chore(benchmark): don't fill benchmark tests by default

[spencer-tb]

🗒️ Description

Updates EEST to not fill benchmark tests by default.

🔗 Related Issues or PRs

#1919

✅ Checklist

• All: Ran fast tox checks to avoid unnecessary CI fails, see also Code Standards and Enabling Pre-commit Checks:

  uvx --with=tox-uv tox -e lint,typecheck,spellcheck,markdownlint

• All: PR title adheres to the repo standard - it will be used as the squash commit message and should start type(scope):.
• All: Considered adding an entry to CHANGELOG.md.
• All: Considered updating the online docs in the ./docs/ directory.
• All: Set appropriate labels for the changes (only maintainers can apply labels).

[spencer-tb]

Please check if I have missed anything. It looks like this is all we need!
Seems its running the benchmark tests in tox :P

[spencer-tb]

I'm considering doing the same for -m slow...

[marioevz]

Couple of questions:

• How do we run benchmark tests then?
• Does it still work if we add another -m in the command line?

[spencer-tb]

I added a better solution by modifying the benchmark conftest!

[marioevz]

Really good idea! Just a couple of suggestions that would make it even easier to use IMO.

[spencer-tb]

Filling with the --gas-benchmark-values now only fills benchmark tests. Similar for adding the -m benchmark marker.
Added the optimizations you mentioned too! Thanks :)

[marioevz]

Some more comments!

[spencer-tb]

I think I addressed your other comments.

Nice way to test:

uv run fill --fork Prague -m benchmark --clean --co | grep Module
uv run fill --fork Prague --gas-benchmark-values 1 --clean --co | grep Module
uv run fill --fork Prague --clean --co | grep Module

[marioevz]

Awesome, thanks!