Skip to content

Conversation

@mmuckley
Copy link
Contributor

This adds annealing to the main training file. I didn't test this addition end-to-end, but I did try to trace through the code paths appropriately to make sure all necessary edits are there. In particular:

  • The update properly reads annealing configs.
  • The update loads the checkpoint for starting annealing, as well as continuation for existing annealing runs.
  • The update adjusts the optimizer to match the parameters used for annealing runs (specifically, using a linear decay).
  • The update adds the linear decay optimizer.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Aug 14, 2025
Copy link
Contributor

@ballasnicolas ballasnicolas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Copy link
Contributor

@garridoq garridoq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mmuckley mmuckley merged commit 2edefcb into main Aug 15, 2025
2 checks passed
@mmuckley mmuckley deleted the mmuckley/20250814_add_annealing branch August 15, 2025 12:43
richardhoff88 pushed a commit to richardhoff88/vjepa2 that referenced this pull request Aug 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants