Skip to content

Commit fd9671b

Browse files
committed
[clone] Remove support for Hudi tables
1 parent c069fec commit fd9671b

File tree

9 files changed

+3
-732
lines changed

9 files changed

+3
-732
lines changed

docs/content/migration/clone-to-paimon.md

Lines changed: 2 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -32,14 +32,8 @@ Clone supports cloning tables to Paimon tables.
3232
2. Clone is reentrant, but it requires existing tables to contain all fields from the source table and have the
3333
same partition fields.
3434

35-
Currently, clone supports:
36-
1. Clone Hive tables in Hive Catalog to Paimon Catalog, supports Parquet, ORC, Avro formats, target table will
37-
be append table.
38-
2. Clone Hudi tables in Hive Catalog to Paimon Catalog, target table will be append table.
39-
40-
The source table below is currently under development:
41-
1. Clone Paimon tables to Paimon tables, target table can be primary table or append table.
42-
2. Clone Iceberg tables in Hive Catalog to Paimon Catalog, target table will be append table.
35+
Currently, clone supports clone Hive tables in Hive Catalog to Paimon Catalog, supports Parquet, ORC, Avro formats,
36+
target table will be append table.
4337

4438
## Clone Hive Table
4539

@@ -93,13 +87,6 @@ clone \
9387
The format is `<database1>.<table1>,<database2>.<table2>,<database3>.<table3>`.
9488
"--excluded_tables" has higher priority than "--included_tables" if you specified both.
9589

96-
97-
## Clone Hudi Tables
98-
99-
Clone Hudi needs dependency: [hudi-flink1.18-bundle-0.15.0.jar](https://repo1.maven.org/maven2/org/apache/hudi/hudi-flink1.18-bundle/0.15.0/hudi-flink1.18-bundle-0.15.0.jar)
100-
101-
The execution method is the same as the Hive table mentioned above.
102-
10390
## Clone Iceberg Tables
10491

10592
Clone Iceberg needs dependency: [iceberg-flink-runtime-1.20-1.8.1.jar](https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-flink-runtime-1.20/1.8.1/iceberg-flink-runtime-1.20-1.8.1.jar)

paimon-core/src/main/java/org/apache/paimon/migrate/Migrator.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@
1818

1919
package org.apache.paimon.migrate;
2020

21-
/** Migrator interface for migrating table from other data-lake like hive, iceberg, hudi and etc. */
21+
/** Migrator interface for migrating table from other data-lake like hive, iceberg and etc. */
2222
public interface Migrator {
2323

2424
void executeMigrate() throws Exception;

paimon-hive/paimon-hive-connector-common/pom.xml

Lines changed: 0 additions & 38 deletions
Original file line numberDiff line numberDiff line change
@@ -571,44 +571,6 @@ under the License.
571571
</exclusions>
572572
</dependency>
573573

574-
<!-- for huid clone test -->
575-
<dependency>
576-
<groupId>org.apache.paimon</groupId>
577-
<artifactId>paimon-hudi</artifactId>
578-
<version>${project.version}</version>
579-
<scope>test</scope>
580-
</dependency>
581-
582-
<dependency>
583-
<groupId>org.apache.hudi</groupId>
584-
<artifactId>hudi-flink1.18-bundle</artifactId>
585-
<version>${hudi.version}</version>
586-
<scope>test</scope>
587-
</dependency>
588-
589-
<!-- this is for huid clone test, and it should be put before hive-exec
590-
for the same reason as org.apache.avro:avro. -->
591-
<dependency>
592-
<groupId>org.apache.parquet</groupId>
593-
<artifactId>parquet-avro</artifactId>
594-
<version>${parquet.version}</version>
595-
<scope>test</scope>
596-
<exclusions>
597-
<exclusion>
598-
<groupId>org.apache.parquet</groupId>
599-
<artifactId>parquet-column</artifactId>
600-
</exclusion>
601-
<exclusion>
602-
<groupId>org.apache.parquet</groupId>
603-
<artifactId>parquet-common</artifactId>
604-
</exclusion>
605-
<exclusion>
606-
<groupId>org.apache.parquet</groupId>
607-
<artifactId>parquet-hadoop</artifactId>
608-
</exclusion>
609-
</exclusions>
610-
</dependency>
611-
612574
<!--
613575
Why we need this test dependency:
614576
IDEA reads classes from the same project from target/classes of that module,

paimon-hive/paimon-hive-connector-common/src/test/java/org/apache/paimon/hudi/CloneActionForHudiITCase.java

Lines changed: 0 additions & 207 deletions
This file was deleted.

paimon-hudi/pom.xml

Lines changed: 0 additions & 70 deletions
This file was deleted.

0 commit comments

Comments
 (0)