-
Notifications
You must be signed in to change notification settings - Fork 335
Dynamically generate FP8 configs for Fuji #1186
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Golden configs still need to be updated -- will run additional testing later and update accordingly |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will be great if we can limit the number of golden configs.
This PR aims to simplify the usage of FP8 for Fuji models. It removes the necessary edits previously required to enable FP8 support and now dynamically generates FP8 configs alongside single-host configs. This also extends FP8 support beyond GCP instance types.
Usage: