Skip to content

[WIP] [CIP-20] Dynamically adjust partition write parallelism #7877

[WIP] [CIP-20] Dynamically adjust partition write parallelism

[WIP] [CIP-20] Dynamically adjust partition write parallelism #7877

Triggered via pull request May 14, 2025 16:55
Status Failure
Total duration 6h 0m 39s
Artifacts 19
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

sbt.yml

on: pull_request
Matrix: flink1
Matrix: flink2
Matrix: mr
Matrix: openapi-codegen-check
Matrix: service
Matrix: spark2
Matrix: spark3
Fit to window
Zoom out
Zoom in

Annotations

60 errors and 29 warnings
flink1 (8, 1.18)
Process completed with exit code 1.
flink1 (11, 1.18)
Process completed with exit code 1.
flink1 (11, 1.17)
Process completed with exit code 1.
flink1 (8, 1.17)
Process completed with exit code 1.
mr (8)
Process completed with exit code 1.
flink1 (11, 1.19)
Process completed with exit code 1.
flink1 (11, 1.16)
Process completed with exit code 1.
flink1 (8, 1.20)
Process completed with exit code 1.
flink1 (11, 1.20)
Process completed with exit code 1.
flink1 (8, 1.19)
Process completed with exit code 1.
flink2 (11, 2.0)
Process completed with exit code 1.
spark3 (3.3, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.2, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
flink2 (17, 2.0)
Process completed with exit code 1.
flink1 (8, 1.16)
Process completed with exit code 1.
spark3 (3.2, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
mr (11)
Process completed with exit code 1.
spark3 (3.4, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark2 (8, 2.4, 2.11.12)
Process completed with exit code 1.
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark2 (8, 2.4, 2.12.10)
Process completed with exit code 1.
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.1, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.2, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.3, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.0, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.0, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.4, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.1, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.2, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
service (8, 2.13.5)
Process completed with exit code 1.
service (11, 2.13.5)
Process completed with exit code 1.
service (17, 2.13.5)
Process completed with exit code 1.
service (11, 2.12.15)
The job running on runner GitHub Actions 798 has exceeded the maximum execution time of 360 minutes.
service (11, 2.12.15)
The operation was canceled.
service (17, 2.12.15)
The job running on runner GitHub Actions 570 has exceeded the maximum execution time of 360 minutes.
service (17, 2.12.15)
The operation was canceled.
service (8, 2.12.15)
The job running on runner GitHub Actions 254 has exceeded the maximum execution time of 360 minutes.
service (8, 2.12.15)
The operation was canceled.
flink1 (8, 1.18)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (11, 1.18)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (11, 1.17)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (8, 1.17)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
mr (8)
No files were found with the provided path: **/target/test/ **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (11, 1.19)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (11, 1.16)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (8, 1.20)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (11, 1.20)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (8, 1.19)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink2 (11, 2.0)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.3, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.2, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink2 (17, 2.0)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
flink1 (8, 1.16)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.2, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
mr (11)
No files were found with the provided path: **/target/test/ **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.4, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.3, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark2 (8, 2.4, 2.11.12)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.4, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.4, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.3, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
No files were found with the provided path: **/target/test-reports/** **/target/unit-tests.log. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
service-java-11-scala-2.13.5-unit-test-log Expired
27.5 MB
sha256:788b0614f1285900a15e18cb46758b2ee6326e0ea728ef2fd2776551d82bee54
service-java-17-scala-2.13.5-unit-test-log Expired
27.5 MB
sha256:1d7ac3edf20335d879e869ecea58e49018ace420e01eb20c9b799bb5db9d81c2
service-java-8-scala-2.13.5-unit-test-log Expired
27.5 MB
sha256:fdc9af376839e4c396f22f8a0d17fffe816b37222f64e83f7dcc9b75eddb2f7b
spark-2.4-java-8-scala-2.12.10-unit-test-log Expired
25.8 KB
sha256:e3fae6222a05ea835cc919a7b8d0981bb0b2593a726887f1207dc8c1dbdf09c7
spark-3.0-java-11-scala-2.12.10-unit-test-log Expired
44.5 KB
sha256:65d6812f55068a9d383b5a717f30bcec03ad16838957da1de0b70f5d8a2b7799
spark-3.0-java-8-scala-2.12.10-unit-test-log Expired
45.1 KB
sha256:b47fe7759fa8762294d04e528595774128e9d0fb9520ea0321e3b9565da28e35
spark-3.1-java-11-scala-2.12.10-unit-test-log Expired
45.6 KB
sha256:571a9227e50b100ba5fe96489d93fa48957b392c62e53a6b55c98fc3c2e859f0
spark-3.1-java-8-scala-2.12.10-unit-test-log Expired
46.4 KB
sha256:97085acc6f273fc6d0f5f4946910575835dc73a99a74c978f56f7f7cba770283
spark-3.2-java-11-scala-2.12.15-unit-test-log Expired
46 KB
sha256:a9484e063646db408947c646cfac2ec1594f57d9d6a5db61091541ad49479f53
spark-3.2-java-8-scala-2.12.15-unit-test-log Expired
46.6 KB
sha256:b2cc4b3a38ddc1e07c489c080c8b896cd28009f06fca5e80fcdbb85c5853ee21
spark-3.3-java-11-scala-2.12.15-unit-test-log Expired
46 KB
sha256:c630cdddf2fbebdc9ad8eccb721d627390e6b7d4bdd9b4ff28aeccd8edfcdd4d
spark-3.3-java-17-scala-2.12.15-unit-test-log Expired
45.3 KB
sha256:54dfbd99a256adb028f300a5a0706ecd09d99fe5fda6712d6c264c2b72033e68
spark-3.3-java-8-scala-2.12.15-unit-test-log Expired
46.7 KB
sha256:de4409746a958c92c9a71b6ba86fbd63d3fe6b6a02c1f59674076a01a6d366ad
spark-3.4-java-11-scala-2.12.17-unit-test-log Expired
46.3 KB
sha256:1d36e41da1650976bbce2e2bc00f7bd7d98294f1dbbe5867360a8bb241b0e375
spark-3.4-java-17-scala-2.12.17-unit-test-log Expired
45.6 KB
sha256:2f936f3f65f8febf3c6ff1dddc0e363e24aa5d157ef91ba4ea123c2b837300d5
spark-3.4-java-8-scala-2.12.17-unit-test-log Expired
46.8 KB
sha256:824d78c1341da4ff0ebacd33a2c71d4fc72d19ccb035a646f4cffacf8c3b4dde
spark-3.5-java-11-scala-2.12.18-unit-test-log Expired
46.7 KB
sha256:f681ea94268d2c47c83c99957c522739cb8148b0ad313f58753154929cfff076
spark-3.5-java-17-scala-2.12.18-unit-test-log Expired
46.1 KB
sha256:00bf767d1bc8e17c1e9d124405dbbb69fc0ec5ca3da5e7213084f4bac836744e
spark-3.5-java-8-scala-2.12.18-unit-test-log Expired
47.2 KB
sha256:340e507f6da2364735a63b881a599a2f7c3e78d638d54bafd994db816dc49c06