Skip to content

Commit 6e2d3b9

Browse files
nastranastra
committed
[iceberg] Upgrade iceberg version to 1.10.0
1 parent e41f8b4 commit 6e2d3b9

File tree

4 files changed

+32
-30
lines changed

4 files changed

+32
-30
lines changed

‎docker/quickstart-flink/prepare_build.sh‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -170,12 +170,12 @@ main() {
170170
# Iceberg Support
171171
log_info "Downloading Iceberg connector JARs..."
172172

173-
# Download iceberg-flink-runtime for Flink 1.20 (version 1.9.1)
173+
# Download iceberg-flink-runtime for Flink 1.20 (version 1.10.0)
174174
download_jar \
175-
"https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-flink-runtime-1.20/1.9.1/iceberg-flink-runtime-1.20-1.9.1.jar" \
176-
"./lib/iceberg-flink-runtime-1.20-1.9.1.jar" \
175+
"https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-flink-runtime-1.20/1.10.0/iceberg-flink-runtime-1.20-1.10.0.jar" \
176+
"./lib/iceberg-flink-runtime-1.20-1.10.0.jar" \
177177
"" \
178-
"iceberg-flink-runtime-1.20-1.9.1"
178+
"iceberg-flink-runtime-1.20-1.10.0"
179179

180180

181181
# Prepare lake tiering JAR
@@ -201,7 +201,7 @@ verify_jars() {
201201
"flink-faker-0.5.3.jar"
202202
"hadoop-apache-3.3.5-2.jar"
203203
"paimon-flink-1.20-1.2.0.jar"
204-
"iceberg-flink-runtime-1.20-1.9.1.jar"
204+
"iceberg-flink-runtime-1.20-1.10.0.jar"
205205
)
206206

207207
local opt_jars=(
@@ -250,7 +250,7 @@ show_summary() {
250250
echo " ✓ Fluss Flink 1.20 connector"
251251
echo " ✓ Fluss Lake Paimon connector"
252252
echo " ✓ Fluss Lake Iceberg connector"
253-
echo " ✓ Iceberg Flink runtime 1.20 (v1.9.1)"
253+
echo " ✓ Iceberg Flink runtime 1.20 (v1.10.0)"
254254
echo " ✓ Paimon Flink 1.20 (v1.2.0)"
255255
echo " ✓ Hadoop Apache (v3.3.5-2)"
256256
echo " ✓ Flink Faker (v0.5.3)"

‎fluss-lake/fluss-lake-iceberg/src/main/resources/META-INF/NOTICE‎

Lines changed: 19 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -6,28 +6,30 @@ The Apache Software Foundation (http://www.apache.org/).
66

77
This project bundles the following dependencies under the Apache Software License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt)
88

9-
- org.apache.iceberg:iceberg-core:1.9.1
10-
- org.apache.iceberg:iceberg-api:1.9.1
11-
- org.apache.iceberg:iceberg-bundled-guava:1.9.1
12-
- org.apache.iceberg:iceberg-common:1.9.1
13-
- org.apache.iceberg:iceberg-data:1.9.1
14-
- org.apache.iceberg:iceberg-orc:1.9.1
15-
- org.apache.iceberg:iceberg-parquet:1.9.1
9+
- org.apache.iceberg:iceberg-core:1.10.0
10+
- org.apache.iceberg:iceberg-api:1.10.0
11+
- org.apache.iceberg:iceberg-bundled-guava:1.10.0
12+
- org.apache.iceberg:iceberg-common:1.10.0
13+
- org.apache.iceberg:iceberg-data:1.10.0
14+
- org.apache.iceberg:iceberg-orc:1.10.0
15+
- org.apache.iceberg:iceberg-parquet:1.10.0
1616
- org.apache.avro:avro:1.12.0
17-
- org.apache.parquet:parquet-avro:1.15.2
18-
- org.apache.parquet:parquet-column:1.15.2
19-
- org.apache.parquet:parquet-encoding:1.15.2
20-
- org.apache.parquet:parquet-hadoop:1.15.2
21-
- org.apache.parquet:parquet-format-structures:1.15.2
22-
- org.apache.parquet:parquet-jackson:1.15.2
23-
- org.apache.parquet:parquet-common:1.15.2
24-
- org.apache.orc:orc-core:nohive:1.9.5
25-
- org.apache.orc:orc-shims:1.9.5
17+
- org.apache.parquet:parquet-avro:1.16.0
18+
- org.apache.parquet:parquet-column:1.16.0
19+
- org.apache.parquet:parquet-encoding:1.16.0
20+
- org.apache.parquet:parquet-hadoop:1.16.0
21+
- org.apache.parquet:parquet-format-structures:1.16.0
22+
- org.apache.parquet:parquet-jackson:1.16.0
23+
- org.apache.parquet:parquet-common:1.16.0
24+
- org.apache.parquet:parquet-variant:1.16.0
25+
- org.apache.orc:orc-core:nohive:1.9.7
26+
- org.apache.orc:orc-shims:1.9.7
2627
- org.apache.commons:commons-lang3:3.18.0
2728
- org.apache.commons:commons-compress:1.21
28-
- org.apache.httpcomponents.client5:httpclient5:5.4.3
29+
- org.apache.httpcomponents.client5:httpclient5:5.5
2930
- org.apache.httpcomponents.core5:httpcore5:5.3.4
3031
- org.apache.httpcomponents.core5:httpcore5-h2:5.3.4
32+
- org.locationtech.jts:jts-core:1.20.0
3133
- com.fasterxml.jackson.core:jackson-core:2.15.3
3234
- com.fasterxml.jackson.core:jackson-databind:2.15.3
3335
- com.fasterxml.jackson.core:jackson-annotations:2.15.3

‎pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,7 @@
8989
<netty.version>4.1.104.Final</netty.version>
9090
<arrow.version>15.0.0</arrow.version>
9191
<paimon.version>1.2.0</paimon.version>
92-
<iceberg.version>1.9.1</iceberg.version>
92+
<iceberg.version>1.10.0</iceberg.version>
9393

9494
<fluss.hadoop.version>2.10.2</fluss.hadoop.version>
9595
<frocksdb.version>6.20.3-ververica-2.0</frocksdb.version>

‎website/docs/streaming-lakehouse/integrate-data-lakes/iceberg.md‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ datalake.iceberg.warehouse: /tmp/iceberg
3131
3232
Fluss processes Iceberg configurations by stripping the `datalake.iceberg.` prefix and uses the stripped configurations (without the prefix `datalake.iceberg.`) to initialize the Iceberg catalog.
3333

34-
This approach enables passing custom configurations for Iceberg catalog initialization. Check out the [Iceberg Catalog Properties](https://iceberg.apache.org/docs/1.9.1/configuration/#catalog-properties) for more details on available catalog configurations.
34+
This approach enables passing custom configurations for Iceberg catalog initialization. Check out the [Iceberg Catalog Properties](https://iceberg.apache.org/docs/1.10.0/configuration/#catalog-properties) for more details on available catalog configurations.
3535

3636
#### Supported Catalog Types
3737

@@ -93,11 +93,11 @@ Fluss only bundles catalog implementations included in the `iceberg-core` module
9393

9494
##### 3. Version Compatibility
9595

96-
The Iceberg version that Fluss bundles is based on `1.9.1`. Please ensure the JARs you add are compatible with `Iceberg-1.9.1`.
96+
The Iceberg version that Fluss bundles is based on `1.10.0`. Please ensure the JARs you add are compatible with `Iceberg-1.10.0`.
9797

9898
#### Important Notes
9999

100-
- Ensure all JAR files are compatible with Iceberg 1.9.1
100+
- Ensure all JAR files are compatible with Iceberg 1.10.0
101101
- If using an existing Hadoop environment, it's recommended to use the `HADOOP_CLASSPATH` environment variable
102102
- Configuration changes take effect after restarting the Fluss service
103103

@@ -171,8 +171,8 @@ Put the JARs required by your Iceberg FileIO into `${FLINK_HOME}/lib`:
171171
**S3 FileIO:**
172172
```bash
173173
# Required JARs for S3 FileIO
174-
iceberg-aws-1.9.1.jar
175-
iceberg-aws-bundle-1.9.1.jar
174+
iceberg-aws-1.10.0.jar
175+
iceberg-aws-bundle-1.10.0.jar
176176
failsafe-3.3.2.jar
177177
```
178178

@@ -190,7 +190,7 @@ When following the [Start Datalake Tiering Service](maintenance/tiered-storage/l
190190

191191
#### Important Notes
192192

193-
- Ensure all JAR files are compatible with Iceberg 1.9.1
193+
- Ensure all JAR files are compatible with Iceberg 1.10.0
194194
- Verify that all required dependencies are in the `${FLINK_HOME}/lib` directory
195195
- Check the Flink job logs for any missing dependency errors
196196
- Restart the Flink cluster after adding new JAR files

0 commit comments

Comments
 (0)