Skip to content

When I started the training, an error occurred: "No such file or directory: 'prompts/dqa.txt'". #5

@Ronald-Huang-CS

Description

@Ronald-Huang-CS

Error information:

Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1                                                                                                                        [9/1761]
[rank1]: Traceback (most recent call last):                                                                                                                                                                        
[rank1]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main                                                                                                                
[rank1]:     return _run_code(code, main_globals, None,                                                                                                                                                            
[rank1]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code                                                                                                                           
[rank1]:     exec(code, run_globals)                                                                                                                                                                               
[rank1]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>                                                                                                                                 
[rank1]:     train(args)                                                                                                                                                                                           
[rank1]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train                                                                                                                                    
[rank1]:     with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:                                                                                                                          
[rank1]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'
Loading extension module cpu_adam...
Time to load cpu_adam op: 25.18068289756775 seconds
Adam Optimizer #0 is created with AVX512 arithmetic capability.
Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1
[rank2]: Traceback (most recent call last):
[rank2]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank2]:     return _run_code(code, main_globals, None,
[rank2]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code
[rank2]:     exec(code, run_globals)
[rank2]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>
[rank2]:     train(args)
[rank2]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train
[rank2]:     with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
[rank2]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'
Loading extension module cpu_adam...
Time to load cpu_adam op: 25.140525341033936 seconds 
Adam Optimizer #0 is created with AVX512 arithmetic capability.
Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1
[rank0]: Traceback (most recent call last):
[rank0]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank0]:     return _run_code(code, main_globals, None,
[rank0]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code
[rank0]:     exec(code, run_globals)
[rank0]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>
[rank0]:     train(args)
[rank0]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train
[rank0]:     with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
[rank0]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'
Loading extension module cpu_adam...
Time to load cpu_adam op: 25.259499311447144 seconds 
Adam Optimizer #0 is created with AVX512 arithmetic capability.
Config: alpha=0.000002, betas=(0.900000, 0.950000), weight_decay=0.000000, adam_w=1
[rank3]: Traceback (most recent call last):
[rank3]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 196, in _run_module_as_main
[rank3]:     return _run_code(code, main_globals, None,
[rank3]:   File "/opt/anaconda3/envs/dev/lib/python3.10/runpy.py", line 86, in _run_code
[rank3]:     exec(code, run_globals)
[rank3]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 574, in <module>
[rank3]:     train(args)
[rank3]:   File "/home/hrq/project/UPFT/train/train_sft.py", line 119, in train
[rank3]:     with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
[rank3]: FileNotFoundError: [Errno 2] No such file or directory: 'prompts/dqa.txt'

After finding the corresponding code, it seems that two files, prompts/qa.txt and prompts/dqa.txt, are needed. Could you provide these two files?

    tasks = args.tasks.split("_")
    prompt_template_names = ["dqa", "qa"]
    prompt_templates = dict()
    for prompt_template_name in prompt_template_names:
        with open(os.path.join("prompts", prompt_template_name + '.txt'), 'r') as f:
            prompt_templates[prompt_template_name] = f.read()

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions