Open
Description
[opened by @szokeasaurusrex]
There are multiple problems with this test:
- The test is flaky (specifically on Python 3.10)
- The flakes appear related to asserting that
stdout
andstderr
is empty
- The flakes appear related to asserting that
- The test appears to be checking multiple things. It is unclear which of these is important
- e.g. maybe we should not assert anything about
stdout
andstderr
- e.g. maybe we should not assert anything about
- The test is generally difficult to understand
- The test takes a very long time to run because it is parameterized with many different combinations and all the tests are forked
- Maybe we can reduce the combinations we check and stop forking the test