Commit 6ad8c3d
authored
Fix: Dataloader restarting on second resume (#3908)
PR fixing dataloader restarting on second resume:
#3907.
## Fix
datasets < 4.8.0.
## Note
It should be enough to do datasets < 5.0.0.
I have been a little more conservative to be consistent with
https://github.com/pytorch/torchtitan/blob/51c197c86d7c703da96f666d5a7dbd5432b4afbf/.ci/docker/requirements.txt#L21 parent 51c197c commit 6ad8c3d
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
17 | | - | |
| 17 | + | |
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
| |||
0 commit comments