-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Description
Error information:
Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1 [9/1761]
[rank1]: Traceback (most recent call last):
[rank1]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank1]: return _run_code(code, main_globals, None,
[rank1]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code
[rank1]: exec(code, run_globals)
[rank1]: File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>
[rank1]: train(args)
[rank1]: File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train
[rank1]: with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
[rank1]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'
Loading extension module cpu_adam...
Time to load cpu_adam op: 25.18068289756775 seconds
Adam Optimizer #0 is created with AVX512 arithmetic capability.
Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1
[rank2]: Traceback (most recent call last):
[rank2]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank2]: return _run_code(code, main_globals, None,
[rank2]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code
[rank2]: exec(code, run_globals)
[rank2]: File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>
[rank2]: train(args)
[rank2]: File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train
[rank2]: with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
[rank2]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'
Loading extension module cpu_adam...
Time to load cpu_adam op: 25.140525341033936 seconds
Adam Optimizer #0 is created with AVX512 arithmetic capability.
Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1
[rank0]: Traceback (most recent call last):
[rank0]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank0]: return _run_code(code, main_globals, None,
[rank0]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code
[rank0]: exec(code, run_globals)
[rank0]: File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>
[rank0]: train(args)
[rank0]: File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train
[rank0]: with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
[rank0]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'
Loading extension module cpu_adam...
Time to load cpu_adam op: 25.259499311447144 seconds
Adam Optimizer #0 is created with AVX512 arithmetic capability.
Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1
[rank3]: Traceback (most recent call last):
[rank3]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank3]: return _run_code(code, main_globals, None,
[rank3]: File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code
[rank3]: exec(code, run_globals)
[rank3]: File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>
[rank3]: train(args)
[rank3]: File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train
[rank3]: with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
[rank3]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'After finding the corresponding code, it seems that two files, prompts/qa.txt and prompts/dqa.txt, are needed. Could you provide these two files?
tasks = args.tasks.split("_")
prompt_template_names = ["dqa", "qa"]
prompt_templates = dict()
for prompt_template_name in prompt_template_names:
with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
prompt_templates[prompt_template_name] = f.read()Metadata
Metadata
Assignees
Labels
No labels