running `uv run fill --collect-only` fails when the fixtures folder does not already exist

[felix314159]

Someone who just cloned the repo and follow some guide might run:

• uv venv --python 3.12
• uv sync --all-extras
• uv run fill --collect-only

However, the last command fails with pluggyTeardownRaisedWarning: FileNotFoundError: The directory fixtures does not exist. if the folder fixtures does not already exist in the root of the repo. Since it by default doesn't exist, a fix would be to create the folder, if it doesn't exist, when fill() from fill.py is run.

[LouisTsai-Csie]

Hi @felix314159 ,

I also encounter the problem today, but I solve the issue by manually creating the fixtures/ folder. I then run the command documented in the README

uv run fill -k "push0 and delegatecall" tests/shanghai/ -m state_test -v

And then I got the following error:

__________________ TestPush0CallContext.test_push0_contract_during_call_contexts[fork_Shanghai-state_test-delegatecall] ___________________
../../../.pyenv/versions/3.10.9/lib/python3.10/encodings/idna.py:163: in encode
    raise UnicodeError("label empty or too long")
E   UnicodeError: label empty or too long

The above exception was the direct cause of the following exception:
tests/shanghai/eip3855_push0/test_push0.py:145: in test_push0_contract_during_call_contexts
    state_test(env=env, pre=pre, post=post, tx=tx)
src/pytest_plugins/filler/filler.py:675: in __init__
    fixture = self.generate(
src/ethereum_test_specs/state.py:199: in generate
    return self.make_state_test_fixture(t8n, fork, eips, slow=is_slow_test(request))
src/ethereum_test_specs/state.py:132: in make_state_test_fixture
    transition_tool_output = t8n.evaluate(
src/ethereum_clis/transition_tool.py:531: in evaluate
    return self._evaluate_server(
src/ethereum_clis/transition_tool.py:348: in _evaluate_server
    response = self._server_post(
src/ethereum_clis/transition_tool.py:290: in _server_post
    response = Session().post(
.venv/lib/python3.10/site-packages/requests/sessions.py:637: in post
    return self.request("POST", url, data=data, json=json, **kwargs)
.venv/lib/python3.10/site-packages/requests/sessions.py:579: in request
    settings = self.merge_environment_settings(
.venv/lib/python3.10/site-packages/requests/sessions.py:760: in merge_environment_settings
    env_proxies = get_environ_proxies(url, no_proxy=no_proxy)
.venv/lib/python3.10/site-packages/requests/utils.py:832: in get_environ_proxies
    if should_bypass_proxies(url, no_proxy=no_proxy):
.venv/lib/python3.10/site-packages/requests/utils.py:816: in should_bypass_proxies
    bypass = proxy_bypass(parsed.hostname)
../../../.pyenv/versions/3.10.9/lib/python3.10/urllib/request.py:2654: in proxy_bypass
    return proxy_bypass_macosx_sysconf(host)
../../../.pyenv/versions/3.10.9/lib/python3.10/urllib/request.py:2631: in proxy_bypass_macosx_sysconf
    return _proxy_bypass_macosx_sysconf(host, proxy_settings)
../../../.pyenv/versions/3.10.9/lib/python3.10/urllib/request.py:2599: in _proxy_bypass_macosx_sysconf
    hostIP = socket.gethostbyname(hostonly)
E   UnicodeError: encoding with 'idna' codec failed (UnicodeError: label empty or too long)
___________________ TestPush0CallContext.test_push0_contract_during_call_contexts[fork_Cancun-state_test-delegatecall] ____________________
../../../.pyenv/versions/3.10.9/lib/python3.10/encodings/idna.py:163: in encode
    raise UnicodeError("label empty or too long")
E   UnicodeError: label empty or too long

I review the documentation and try many methods, but the error persists. Could anyone please help me with the issue? I would like to contribute to some test case, thank you!

The following is my machine configuration:

[felix314159]

Hi @LouisTsai-Csie ,
I can't reproduce your issue. I am using Python 3.10.12 and you are using 3.10.9. You could try running

uv python install 3.10.12
uv python pin 3.10.12

and re-running your command, but I don't think this will resolve the issue. I also am using Ubuntu 24.04.2 LTS ARM instead of macOS.

---

This is my output when running your command, maybe it helps you with debugging:

user@user:~/Documents/execution-spec-tests$ uv run fill -k "push0 and delegatecall" tests/shanghai/ -m state_test -v
==================================== test session starts =====================================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /home/user/Documents/execution-spec-tests/.venv/bin/python3
Generating fixtures for: Frontier, Homestead, Byzantium, Constantinople, ConstantinopleFix, Istanbul, Berlin, BerlinToLondonAt5, London, Paris, ParisToShanghaiAtTime15k, Shanghai, ShanghaiToCancunAtTime15k, Cancun
Only generating fixtures with stable/deployed forks: Specify an upcoming fork via --until=fork to add forks under development.
ethereum-spec-evm-resolver 0.0.5
solc: 0.8.24
cachedir: .pytest_cache
EELS resolutions file: /home/user/Documents/execution-spec-tests/eels_resolutions.json
metadata: {'Python': '3.10.12', 'Platform': 'Linux-6.8.0-53-generic-aarch64-with-glibc2.39', 'Packages': {'pytest': '7.4.4', 'pluggy': '1.5.0'}, 'Plugins': {'cov': '4.1.0', 'html': '4.1.1', 'metadata': '3.1.1', 'xdist': '3.6.1', 'json-report': '1.5.0', 'custom-report': '1.0.1', 'typeguard': '4.3.0'}, 'Tools': {'EELS Resolutions': '/home/user/Documents/execution-spec-tests/eels_resolutions.json', 't8n': 'ethereum-spec-evm-resolver 0.0.5', 'solc': '0.8.24'}, 'Command-line args': '<code>fill -k "push0 and delegatecall" tests/shanghai/ -m state_test -v</code>'}
rootdir: /home/user/Documents/execution-spec-tests
configfile: pytest.ini
plugins: cov-4.1.0, html-4.1.1, metadata-3.1.1, xdist-3.6.1, json-report-1.5.0, custom-report-1.0.1, typeguard-4.3.0
collected 692 items / 678 deselected / 14 selected                                           

tests/shanghai/eip3855_push0/test_push0.py::TestPush0CallContext::test_push0_contract_during_call_contexts[fork_Shanghai-state_test-delegatecall] FILLED [1/2]
tests/shanghai/eip3855_push0/test_push0.py::TestPush0CallContext::test_push0_contract_during_call_contexts[fork_Cancun-state_test-delegatecall] FILLED [2/2]

- Generated html report: file:///home/user/Documents/execution-spec-tests/fixtures/.meta/report_fill.html -
=  No tests executed - the test fixtures in "fixtures/" may now be executed against a client  =
============================= 2 passed, 678 deselected in 10.96s =============================

[LouisTsai-Csie]

Thank you for your quick response!
It seems I missed something like running the t8n server.
Is there anything I should do before running the command in the documentation?
https://ethereum.github.io/execution-spec-tests/main/getting_started/installation/

[felix314159]

Your issue has nothing to do with the original issue of this thread. Please create a new issue for this discussion, it would also be a good idea to provide more context (do other fill commands work? e.g. what is the output of uv run fill) so that we can help you.

[LouisTsai-Csie]

Ok, I will do that, thank you

[gurukamath]

@LouisTsai-Csie Perhaps #1231 is the same issue you are encountering

[LouisTsai-Csie]

@gurukamath It fixes my problem, thank you all!