Skip to content

Flaky Test Cases in ON-PR and ON-NIGHTLY Workflows #3121

@chandrasekaranpradeep

Description

@chandrasekaranpradeep

In tt-forge-fe, we have ON-PR workflow for checking regression and ON-NIGHTLY workflow for reporting. In both pipelines we are testing ONNX and PaddlePaddle models in which some of the model tests are flaky (i.e., job fails but when we retrigger the job it will pass). The flaky cases contain both test failures and crashing.

This issue was created for posting the flaky cases that we are noticing in the ON-PR and ON-NIGHTLY pipelines as comments. In the below sheet you can find the flaky cases that were noticed.

Sheet Link: https://docs.google.com/spreadsheets/d/1YE3vO1ClKndX-W8Xol6S3JGnEgeR3hScmr3IDbEA4l8/edit?usp=sharing

cc: @nvukobratTT

Metadata

Metadata

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions