issues for sft saving path

[lolipopshock]

Basically the current finetune.py creates a new folder for each run (and the folder is dependent on the time); as a result, it makes the resume from checkpoint logic useless: the get_last_checkpoint_path(args) will always look at an empty folder.

open-instruct/open_instruct/finetune.py

Line 419 in f90f731

args.output_dir = os.path.join(args.output_dir, args.run_name)

[vwxyzjn]

This is a good point. For now you might have to dance around with it by adding something like a --resume_path. We will prob rework the resumption logic a bit later on.