Skip to content

Commit 01a5a00

Browse files
authored
Update README with dataset formatting and training info
Added instructions for re-formatting datasets and training with TRL.
1 parent 9c5e55c commit 01a5a00

1 file changed

Lines changed: 19 additions & 0 deletions

File tree

README.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -63,6 +63,25 @@ trainer = SFTTrainer(
6363
trainer.train()
6464
```
6565

66+
Or if your dataset is already in a different template style, simply re-format on the fly direct within your training notebook.
67+
68+
```python
69+
```python
70+
from trl import SFTTrainer
71+
from datasets import load_dataset
72+
73+
!deepfabric format --repo "alwaysfurther/deepfabric-agent-tool-calling" -f trl_sft_tools -o dataset.jsonl
74+
dataset = load_dataset("json", data_files="dataset.jsonl", split="train")
75+
76+
# Train directly with TRL - no preprocessing needed
77+
trainer = SFTTrainer(
78+
model=model,
79+
train_dataset=dataset["train"],
80+
# ... your training config
81+
)
82+
trainer.train()
83+
```
84+
6685
**Reinforcement Learning from Process Supervision (GRPO)**: Train models to generate step-by-step reasoning with the `builtin://grpo` formatter. Ideal for mathematical reasoning, complex problem-solving, and transparent decision-making where each reasoning step can be verified and reinforced.
6786

6887
```python

0 commit comments

Comments
 (0)