long-seq-alibi to run the code for ALIBI, it's quite simple cd gpt-fine-tuning pip install -e requirement.txt bash clm_pos_long_seq.sh Please read the bash script clm_pos_long_seq.sh, in which I set 4GPU training