Take advantage of `save_state` robustness against specialized use-cases (`FSDP`, `DeepSpeed`, `Multi-GPU`, etc.) and implement save model-only feature. Implementation as well as details can be found in https://github.com/huggingface/accelerate/pull/3989 .
Take advantage of
save_staterobustness against specialized use-cases (FSDP,DeepSpeed,Multi-GPU, etc.) and implement save model-only feature.Implementation as well as details can be found in #3989 .