We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 0b14e61 commit bf00f9eCopy full SHA for bf00f9e
lib/zephyr/src/zephyr/shuffle.py
@@ -23,10 +23,6 @@
23
chunk's compressed bytes (typically a few MB). This bound is essential for
24
skewed shuffles where one reducer pulls disproportionate data and the
25
external-sort fan-in opens hundreds of chunk iterators at once.
26
-
27
-Compared to the previous Parquet-based layout this drops Arrow from the
28
-shuffle data plane, removes schema-evolution segment splits, and replaces
29
-row-group statistics with explicit byte ranges.
30
"""
31
32
from __future__ import annotations
0 commit comments