Skip to content

test packed dataset with preference dataset #1606

Open
@felipemello1

Description

preference datasets, like stack exchange havent been tested with dataset.packed=True yet.

We should run it for a full epoch, make sure it works, and update it to accept packed=True

Metadata

Assignees

No one assigned

    Labels

    better engineeringTasks which help improve eng productivity e.g. building tools, cleaning up code, writing docscommunity help wantedWe would love the community's help completing this issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions