Skip to content
PR Build (Linux)

perf: stop using FFI in native shuffle read path #6316

Sign in to view logs

perf: stop using FFI in native shuffle read path

perf: stop using FFI in native shuffle read path #6316

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Lint
39s
Lint Java (Spark 3.4, JDK 11, Scala 2.12)
4m 10s
Build Native Library
2m 0s
Lint Java (Spark 3.5, JDK 17, Scala 2.12)
4m 1s
Lint Java (Spark 4.0, JDK 17)
4m 31s
ubuntu-latest/rust-test
3m 4s
Verify TPC-DS Results (hash)
8m 34s
Verify TPC-H Results
4m 34s
Verify TPC-DS Results (sort_merge)
7m 51s
Verify TPC-DS Results (broadcast)
6m 21s
Spark 3.4, JDK 11, Scala 2.12/auto [csv]
3m 2s
Spark 3.4, JDK 11, Scala 2.12/auto [expressions]
10m 51s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [parquet]
5m 22s
Spark 3.4, JDK 11, Scala 2.12/auto [fuzz]
12m 59s
Spark 3.4, JDK 11, Scala 2.12/auto [sql]
2m 55s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [exec]
10m 13s
Spark 3.5.6, JDK 17, Scala 2.13/auto [parquet]
5m 18s
Spark 3.5.6, JDK 17, Scala 2.13/auto [exec]
9m 37s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [shuffle]
7m 17s
Spark 3.5.5, JDK 17, Scala 2.13/auto [fuzz]
11m 13s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [sql]
3m 15s
Spark 3.5.5, JDK 17, Scala 2.13/auto [expressions]
9m 48s
Spark 4.0, JDK 17/auto [expressions]
10m 9s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [sql]
3m 13s
Spark 3.4, JDK 11, Scala 2.12/auto [exec]
10m 34s
Spark 3.5.6, JDK 17, Scala 2.13/auto [fuzz]
12m 0s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [expressions]
10m 12s
Spark 3.5.5, JDK 17, Scala 2.13/auto [exec]
9m 47s
Spark 4.0, JDK 17/auto [sql]
3m 54s
Spark 4.0, JDK 17/auto [shuffle]
8m 53s
Spark 4.0, JDK 17/auto [csv]
3m 5s
Spark 3.5.6, JDK 17, Scala 2.13/auto [sql]
3m 11s
Spark 3.5.5, JDK 17, Scala 2.13/auto [csv]
2m 55s
Spark 4.0, JDK 17/auto [parquet]
5m 33s
Spark 3.5.6, JDK 17, Scala 2.13/auto [shuffle]
9m 45s
Spark 3.5.5, JDK 17, Scala 2.13/auto [parquet]
5m 19s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [parquet]
5m 26s
Spark 3.5.5, JDK 17, Scala 2.13/auto [shuffle]
9m 11s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [fuzz]
12m 45s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [exec]
10m 19s
Spark 3.4, JDK 11, Scala 2.12/auto [parquet]
5m 24s
Spark 3.5, JDK 17, Scala 2.12/native_datafusion [csv]
2m 54s
Spark 4.0, JDK 17/auto [fuzz]
12m 21s
Spark 3.5.5, JDK 17, Scala 2.13/auto [sql]
3m 9s
Spark 3.5.6, JDK 17, Scala 2.13/auto [csv]
2m 55s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [csv]
2m 56s
Spark 3.5.6, JDK 17, Scala 2.13/auto [expressions]
9m 36s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [fuzz]
12m 43s
Spark 4.0, JDK 17/auto [exec]
10m 5s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [shuffle]
17m 50s
Spark 3.4, JDK 11, Scala 2.12/auto [shuffle]
17m 19s
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [expressions]
10m 46s
6h 21m 44s