Skip to content

Commit e182902

Browse files
committed
train loss cot; README
1 parent cf54eb4 commit e182902

2 files changed

Lines changed: 3 additions & 0 deletions

File tree

end-to-end-use-cases/coding/text2sql/tool/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -199,6 +199,9 @@ Let me think through this step by step:\n\n1. First, I need to consider...\n2. T
199199

200200
Uncomment the line `# FT_DATASET = "train_text2sql_cot_dataset.json"` in trl_sft.py to use the reasoning dataset for fine-tuning. Then run `python trl_sft.py`. After the fine-tuning completes, you'll see the fine-tuned model saved to `llama31-8b-text2sql-fine-tuned`, specified in `output_dir="llama31-8b-text2sql-fine-tuned"` of `TrainingArguments` in `trl_sft.py` - you may want to rename the `output_dir` folder to something else to avoid overwriting the previous fine-tuned model.
201201

202+
The train loss chart will look like this:
203+
![](fine_tuning/train_loss_cot.png)
204+
202205
### Evaluating the fine-tuned model (With Reasoning)
203206

204207
First, modify `llama_eval.sh` to use the fine-tuned model, which should match the `output_dir` in `TrainingArguments` in `trl_sft.py`:
102 KB
Loading

0 commit comments

Comments
 (0)