-
Notifications
You must be signed in to change notification settings - Fork 21
Open
Description
Hello, thanks for your great work!
I see that you try to mask the Observation line in your lora fine-tune code, but why you not use the masked label ? I think this line maybe "result["labels"] =ids"
"
FireAct/finetune/llama_lora/finetune.py
Line 146 in 94c6189
| result["labels"] = result["input_ids"].copy() |
Looking forward to your reply!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels