Does hatch test randomise test order by default?

[mcarans]

I switched to run tests using hatch test instead of my own hatch test:test and I see randomly is used from the output, but I cannot see anywhere in my config where I have activated it. Is it the default in Hatch?

1 > hatch test
=================================================================================================================================== test session starts ===================================================================================================================================
platform linux -- Python 3.12.3, pytest-8.2.2, pluggy-1.5.0
Using --randomly-seed=631327657
rootdir: /home/mcarans/Code/hdx-python-api
configfile: .config/pytest.ini
plugins: typeguard-4.3.0, cov-5.0.0, randomly-3.15.0, rerunfailures-14.0, mock-3.14.0, xdist-3.6.1
```

[ofek]

No https://hatch.pypa.io/latest/config/internal/testing/#randomize-test-order

The plugins that you see just shows what is available.

[mcarans]

Hmm, that is strange. I was investigating tests that started to fail and found that it was due to state being maintained between tests. I had cleared the state in some but not all places. The tests all passed when running my own hatch test:test and in pytest in a virtualenv locally, but failed with hatch test. The failing tests would pass individually when run using hatch test leading me to believe that hatch test changed the order.

Obviously it's not good to have tests fail when run in a different order so I'm happy to have fixed it, but I'm baffled why it happened since you say that hatch test does not in fact randomise the order.