Skip to content

Conversation

ordabayevy
Copy link
Contributor

A callback that logs the loss scale during mixed-precision training.

Copy link
Contributor

@sjfleming sjfleming left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me

@ordabayevy ordabayevy merged commit 9c94f96 into main Sep 20, 2024
6 checks passed
@ordabayevy ordabayevy deleted the loss-scale-monitor branch September 20, 2024 17:43
@ordabayevy
Copy link
Contributor Author

@sjfleming thanks for reviewing!

magrenimish pushed a commit that referenced this pull request May 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants