Skip to content

stats sampling doesn't work properly in case of partition pruning #1032

@phofl

Description

@phofl

The files used for sampling and the filtered files might get out of sync resulting in weird errors. see https://github.com/dask/dask-expr/pull/1029/files#r1568572292 for a crude fix that we should make better.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions