- when i run generate.sh of openreview, it outputs:
The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's attention_mask to obtain reliable results.
Setting pad_token_id to eos_token_id:50256 for open-end generation.
Is this right? Or I need to modify any parameter?
- When running generate.sh of openreview, I found that the output of each epoch was like below. Why are there so many instances of 0.0? Is this normal? And the FID is also very large.


If I could receive your reply, I would greatly appreciate it!
The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's
attention_maskto obtain reliable results.Setting
pad_token_idtoeos_token_id:50256 for open-end generation.Is this right? Or I need to modify any parameter?
If I could receive your reply, I would greatly appreciate it!