Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/sbt.yml
Original file line number Diff line number Diff line change
Expand Up @@ -165,7 +165,7 @@ jobs:
# Spark 3.4
- spark: '3.4'
scala-binary: '2.12'
scala: '2.12.17'
scala: '2.12.18'
- spark: '3.4'
scala-binary: '2.13'
scala: '2.13.8'
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-1.16
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-1.17
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-1.18
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-1.19
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-1.20
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-2.0
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-2.1
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-flink-2.2
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-mr
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ commons-configuration2/2.8.0//commons-configuration2-2.8.0.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-daemon/1.0.13//commons-daemon-1.0.13.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
commons-math3/3.1.1//commons-math3-3.1.1.jar
commons-net/3.9.0//commons-net-3.9.0.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-2.4
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-3.0
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-3.1
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-3.2
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-3.3
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-3.4
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-3.5
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-4.0
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-spark-4.1
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
RoaringBitmap/1.0.6//RoaringBitmap-1.0.6.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
guava/33.1.0-jre//guava-33.1.0-jre.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-client-tez
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ commons-configuration2/2.8.0//commons-configuration2-2.8.0.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang/2.6//commons-lang-2.6.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
commons-math3/3.1.1//commons-math3-3.1.1.jar
commons-net/3.9.0//commons-net-3.9.0.jar
Expand Down
2 changes: 1 addition & 1 deletion dev/deps/dependencies-server
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ classgraph/4.8.138//classgraph-4.8.138.jar
commons-cli/1.5.0//commons-cli-1.5.0.jar
commons-crypto/1.0.0//commons-crypto-1.0.0.jar
commons-io/2.17.0//commons-io-2.17.0.jar
commons-lang3/3.17.0//commons-lang3-3.17.0.jar
commons-lang3/3.20.0//commons-lang3-3.20.0.jar
commons-logging/1.1.3//commons-logging-1.1.3.jar
disruptor/3.4.4//disruptor-3.4.4.jar
failureaccess/1.0.2//failureaccess-1.0.2.jar
Expand Down
4 changes: 2 additions & 2 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@
the link to metrics.dropwizard.io in docs/monitoring.md.
-->
<codahale.metrics.version>4.2.25</codahale.metrics.version>
<commons-lang3.version>3.17.0</commons-lang3.version>
<commons-lang3.version>3.20.0</commons-lang3.version>
<commons-io.version>2.17.0</commons-io.version>
<commons-crypto.version>1.0.0</commons-crypto.version>
<!-- last version to support compilation in java 8. See https://errorprone.info/docs/installation#:~:text=you%20are%20using.-,JDK%208,-Error%20Prone%202.10.0 -->
Expand Down Expand Up @@ -1635,7 +1635,7 @@
<properties>
<lz4-java.group>org.lz4</lz4-java.group>
<lz4-java.version>1.8.0</lz4-java.version>
<scala.version>2.12.17</scala.version>
<scala.version>2.12.18</scala.version>
Copy link
Copy Markdown
Contributor Author

@cxzl25 cxzl25 Apr 14, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Commons-lang3 version 3.20.0 uses JDK25 build, and the previous version used JDK17. This causes an error when compiling the 3.20.0 version of scala with a lower version.

  bad constant pool index: 0 at pos: 5375
     while compiling: /home/runner/work/celeborn/celeborn/master/src/main/scala/org/apache/celeborn/service/deploy/master/InternalRpcEndpoint.scala
        during phase: globalPhase=jvm, enteringPhase=namer
     library version: version 2.12.15
    compiler version: version 2.12.15

https://github.com/apache/celeborn/actions/runs/24380964149/job/71204148341?pr=3663

https://github.com/scala/scala/pull/10397

<scala.binary.version>2.12</scala.binary.version>
<spark.version>3.4.4</spark.version>
<zstd-jni.version>1.5.2-5</zstd-jni.version>
Expand Down
4 changes: 2 additions & 2 deletions project/CelebornBuild.scala
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ object Dependencies {
val commonsCryptoVersion = "1.0.0"
val commonsIoVersion = "2.17.0"
val commonsLoggingVersion = "1.1.3"
val commonsLang3Version = "3.17.0"
val commonsLang3Version = "3.20.0"
val commonsCollectionsVersion = "3.2.2"
val findbugsVersion = "1.3.9"
val guavaVersion = "33.1.0-jre"
Expand Down Expand Up @@ -955,7 +955,7 @@ object Spark34 extends SparkClientProjects {
val sparkClientShadedProjectName = "celeborn-client-spark-3-shaded"

val lz4JavaVersion = "1.8.0"
val sparkProjectScalaVersion = "2.12.17"
val sparkProjectScalaVersion = "2.12.18"

val sparkVersion = "3.4.4"
val zstdJniVersion = "1.5.2-5"
Expand Down
Loading