DistributedSampler has the same seed randomization

[bogdansalyp]

TL;DR

DistributedSampler is always called with seed=0 -> no randomization in shuffle/split

[EugenHotaj]

I have an in-progress PR to fix this, but there's some distributed sampler issues the torchtune team are still looking into: #2266

[bogdansalyp]

I have an in-progress PR to fix this, but there's some distributed sampler issues the torchtune team are still looking into: #2266

oh, my bad, I'll close this issue and check the PR you have!

[bogdansalyp]

duplicate of #2266