Fine-tune and share models on the Hub. Take a base model, train it on your data, and publish the result for the community to use.
Fine-tuning is how we adapt foundation models to specific tasks. By sharing fine-tuned models—along with your training methodology—you're giving the community ready-to-use solutions and reproducible recipes they can learn from.
Use hugging-face-model-trainer/ for this quest. Key capabilities:
- SFT (Supervised Fine-Tuning) — Standard instruction tuning
- DPO (Direct Preference Optimization) — Alignment from preference data
- GRPO (Group Relative Policy Optimization) — Online RL training
- Cloud GPU training on HF Jobs—no local setup required
- Trackio integration for real-time monitoring
- GGUF conversion for local deployment
Your coding agent uses hf_jobs() to submit training scripts directly to HF infrastructure.
We'll announce the XP tiers for this quest soon.
- SKILL.md — Full skill documentation
- SFT Example — Production SFT template
- DPO Example — Production DPO template
- GRPO Example — Production GRPO template
- Training Methods — Method selection guide
- Hardware Guide — GPU selection