Skip to content

Conversation

@mengfei25
Copy link
Contributor

  1. use nightly as reference
  2. performance gates PR
  3. fix torchbench deps

disable_build
disable_ut
disable_distributed

@mengfei25 mengfei25 requested a review from chuanqi129 October 28, 2025 03:21
@chuanqi129 chuanqi129 changed the title [CI] Modify CI tests [CI] Add CI gating based on E2E performance test results check Oct 28, 2025
@mengfei25 mengfei25 requested a review from chuanqi129 October 30, 2025 07:04
@mengfei25
Copy link
Contributor Author

Performance is not very stable, there are some fluctuation, I test several times and some models maybe dropped ~15%.
Such as https://github.com/intel/torch-xpu-ops/actions/runs/18935790442

@chuanqi129
Copy link
Contributor

Performance is not very stable, there are some fluctuation, I test several times and some models maybe dropped ~15%. Such as https://github.com/intel/torch-xpu-ops/actions/runs/18935790442

How much models? Can we ignore the unstable models in the check? @mengfei25

@mengfei25
Copy link
Contributor Author

mengfei25 commented Nov 3, 2025

Added performance check, and highlight them in PR comments if regression

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants