Skip to content

Improve e2e test reliability #2611

Open
@ShaunKav

Description

@ShaunKav

We've had some cases on our devicecloud runners where mid-test the VM restarts and causes the test to fail. I got onto the devicecloud team and got the following advice:

Thanks for flagging this.
It's a known performance issue for newer iOS simulator builds.
In the short term, there's a couple of options:

  1. try different sims/OS versions, iPhone 16 + iOS 18 has been working well for us internally
  2. add the --retry 2 flag to the CLI to enable automatic retries, this helps counteract flakiness issues

In the medium term, we started the process of upgrading our iOS infrastructure and there's always a chance of a patch from Apple!

Metadata

Metadata

Assignees

Labels

CI/CDA task related to our CI/CD pipelinesMobileMobile ticket.QAA ticket relating to quality/testing/E2E

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions