-
Notifications
You must be signed in to change notification settings - Fork 70
Dynamo model list for different scopes #2762
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR adds Dynamo model lists for different benchmark test scopes (p0, p1, p2) across three model suites: TorchBench, TIMM, and HuggingFace. The lists are organized by priority/scope level to support different testing configurations.
Changes:
- Added TorchBench model lists for training and inference modes in p2 scope
- Added TIMM and HuggingFace model lists for p0, p1, and p2 scopes
- Created structured text files with numbered model entries for benchmark testing
Reviewed changes
Copilot reviewed 10 out of 10 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
| .ci/benchmarks/p2/torchbench_models_list_train.txt | 28 TorchBench models for training scope in p2 tests |
| .ci/benchmarks/p2/torchbench_models_list_infer.txt | 35 TorchBench models for inference scope in p2 tests |
| .ci/benchmarks/p2/timm_models_list.txt | 27 TIMM models with batch sizes for p2 scope |
| .ci/benchmarks/p2/huggingface_models_list.txt | 6 HuggingFace models with batch sizes for p2 scope |
| .ci/benchmarks/p1/torchbench_models_list.txt | 29 TorchBench models for p1 scope |
| .ci/benchmarks/p1/timm_models_list.txt | 20 TIMM models with batch sizes for p1 scope |
| .ci/benchmarks/p1/huggingface_models_list.txt | 20 HuggingFace models with batch sizes for p1 scope |
| .ci/benchmarks/p0/torchbench_models_list.txt | 16 TorchBench models for p0 scope |
| .ci/benchmarks/p0/timm_models_list.txt | 16 TIMM models with batch sizes for p0 scope |
| .ci/benchmarks/p0/huggingface_models_list.txt | 16 HuggingFace models with batch sizes for p0 scope |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| mobilenetv3_large_100 512 | ||
| poolformer_m36 128 | ||
| regnety_002 1024 | ||
| res2net101_26w_4s |
Copilot
AI
Jan 22, 2026
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The model entry 'res2net101_26w_4s' is missing a batch size parameter, while all other entries in the file include one (e.g., '128', '512'). For consistency and to prevent potential parsing errors, add a batch size value.
| res2net101_26w_4s | |
| res2net101_26w_4s 128 |
Performance outliers, please check!
|
Performance outliers, please check!
|
Add dynamo model list for different test scopes.