Skip to content

MyCollator() Only Processes batch[0] #5

@zlin0

Description

@zlin0

Hi @shangeth, thanks for opensource your code! May I inquire about another question? In the MyCollator() function, you only handle batch[0]. Is there a specific reason for that?
https://github.com/skit-ai/SpeechLLM/blob/main/dataset.py#L18
waveform, pre_speech_prompt, post_speech_prompt, output_prompt, complete_prompt = batch[0]

Since this collator function is used by both training and validation, this row means that only the first sample in each mini-batch will be utilized. Or did I miss or misunderstand anything? Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions