Investigate the flake in the E2E tests

[illright]

This run has failed on main, that's unacceptable:

https://github.com/aabounegm/cast/runs/6322279300?check_suite_focus=true

[illright]

For now, I side-stepped the issue by adding up to two retries to that flaky test. Couldn't really figure out what was causing it to fail