Replace HF_TRANSER with XET

[felipemello1]

🐛 Describe the bug

DeprecationWarning: The `HF_HUB_ENABLE_HF_TRANSFER` environment variable is deprecated as 'hf_transfer' is not used anymore. Please use `HF_XET_HIGH_PERFORMANCE` instead to enable high performance transfer with Xet. Visit https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#hfxethighperformance for more details.

This flag is used to enable faster downloads. We set it up here:

torchforge/src/forge/__init__.py

Line 16 in 9bce287

if os.environ.get("HF_HUB_ENABLE_HF_TRANSFER") is None:

The issue with XET is that i am not sure if it works well in our devmachines

Task:

• replace hf_transfer with the XET flag
• delete hf cache
• run forge in our devserver (make sure it downloads the model)

Versions

No response