Questions about the processing of the dataset

[YdaodiG]

Due diligence

• I have done my due diligence in trying to find the answer myself.

Topic

The PyTorch implementation

Question

Thank you for open sourcing this moshi fine-tuning repository, it helped us a lot! However, when I was researching the code, I found that the method sphn.dataset_jsonl imported in moshi-finetune/finetune/data/dataset.py, line about 200, was not clearly defined. After I checked it carefully in the conda environment, I could not find the specific implementation of this method, which means that the authors may have re-implemented this method, but I could not find the specific location. Can you share the implementation of this method? Thank you very much for your open source spirit!