Skip to content

Commit 03bc603

Browse files
committed
Document lk_hybrid choice in --loss-fn help text
Addresses CodeRabbit review on #673: the --loss-fn help only described kl_div and ce; add the lk_hybrid option and point to --lk-loss-eta. Signed-off-by: GIREESH7963 <abburigireesh@gmail.com>
1 parent 2857b7c commit 03bc603

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

scripts/train.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -967,7 +967,8 @@ def parse_args():
967967
help=(
968968
"Loss function used during draft model training. "
969969
"'kl_div' = KL divergence (default). "
970-
"'ce' = cross-entropy."
970+
"'ce' = cross-entropy. "
971+
"'lk_hybrid' = adaptive KL/TV blend (see --lk-loss-eta)."
971972
),
972973
)
973974
parser.add_argument(

0 commit comments

Comments
 (0)