Skip to content

Rework PET job in test.yml workflow #1010

@rockbmb

Description

@rockbmb

This repository contains a testing workflow in ./.github/workflows/test.yml, which includes the Polkadot Ecosystem Test suite (presently disabled).

The PET job in this workflow is currently as follows:

- name: Running ecosystem tests
uses: nick-fields/retry@v3
with:
timeout_minutes: 90
max_attempts: 3
command: cd ecosystem-tests && yarn test

This is not ideal, because with PET having recently gone beyond 100+ individual test suites, a single failure, which can happen for various reasons (RPC timeouts are frequent), will cause the above step to be retried from the beginning.

To mitigate this, each individual test suite should run independently of the others, and the timeout/retry mechanisms should apply individually.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions