Umbrella for upstreaming distributed dynamic filtering — coordinator-mediated runtime filters that prune splits/rows across exchange boundaries and at higher levels of metadata, where today's in-fragment Velox dynamic filter pushdown (enable_dynamic_filtering) cannot reach.
Design: RFC-0022. Feature request: #7428.
Already implemented and benchmarked on an internal fork; landing as small parts and disabled by default. TPC-DS SF1000 partitioned Iceberg: ~48% splits pruned, −9.5% wall time reduction.
PRs:
Umbrella for upstreaming distributed dynamic filtering — coordinator-mediated runtime filters that prune splits/rows across exchange boundaries and at higher levels of metadata, where today's in-fragment Velox dynamic filter pushdown (
enable_dynamic_filtering) cannot reach.Design: RFC-0022. Feature request: #7428.
Already implemented and benchmarked on an internal fork; landing as small parts and disabled by default. TPC-DS SF1000 partitioned Iceberg: ~48% splits pruned, −9.5% wall time reduction.
PRs: