From 17f48a28d7f6508e8fb08f6b604a5d3f8481f432 Mon Sep 17 00:00:00 2001 From: Connor Treacy Date: Fri, 24 Oct 2025 17:33:23 +0100 Subject: [PATCH] Add README for distillation process with Llama 4 --- getting-started/distillation/README.md | 10 ++++++++++ 1 file changed, 10 insertions(+) create mode 100644 getting-started/distillation/README.md diff --git a/getting-started/distillation/README.md b/getting-started/distillation/README.md new file mode 100644 index 000000000..a101eb0eb --- /dev/null +++ b/getting-started/distillation/README.md @@ -0,0 +1,10 @@ +# Distillation with Llama 4 and Synthetic Data Kit + +*Copyright (c) Meta Platforms, Inc. and affiliates.* +This software may be used and distributed according to the terms of the Llama Community License Agreement.* + +Open In Colab + +This notebook will walk you through distilling model knowledge from Llama 4 into a smaller Llama 3.2 model using synthetic training data from Synthetic Data Kit. + +[View notebook](/getting-started/distillation/distillation.ipynb)