Open
Description
Update llama 3 and 2 to use hf ckpt, so users can use the trained model using .from_pretrained.
3.1 reference:
3.0 currently:
steps:
- Change the checkpointer FullModelMetaCheckpointer -> FullModelHFCheckpointer
- Update the download command to --ignore-patterns "original/consolidated.00.pth", instead of safetensors
- Update checkpoint files to .safetensors
- Launch training without errors
Activity