-
Notifications
You must be signed in to change notification settings - Fork 62
[CI] Add CI gating based on E2E performance test results check #2224
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
Performance is not very stable, there are some fluctuation, I test several times and some models maybe dropped ~15%. |
How much models? Can we ignore the unstable models in the check? @mengfei25 |
|
Added performance check, and highlight them in PR comments if regression |
disable_build
disable_ut
disable_distributed