The files used for sampling and the filtered files might get out of sync resulting in weird errors. see https://github.com/dask/dask-expr/pull/1029/files#r1568572292 for a crude fix that we should make better.