You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/content/docs/connectors/pipeline-connectors/iceberg.md
+15-15Lines changed: 15 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -26,15 +26,15 @@ under the License.
26
26
27
27
# Iceberg Pipeline Connector
28
28
29
-
The Iceberg Pipeline Connector functions as a *Data Sink* for data pipelines, enabling data writes to Apache Iceberg tables[Iceberg](https://iceberg.apache.org). This document explains how to configure the connector.
29
+
The Iceberg Pipeline Connector functions as a *Data Sink* for data pipelines, enabling data writes to [Apache Iceberg](https://iceberg.apache.org) tables. This document explains how to configure the connector.
30
30
31
31
## Key Capabilities
32
-
* Automatic Table Creation
33
-
Creates Iceberg tables dynamically when they do not exist
34
-
* Schema Synchronization
35
-
Propagates schema changes (e.g., column additions) from source systems to Iceberg
36
-
* Data Replication
37
-
Supports both batch and streaming data synchronization
32
+
***Automatic Table Creation:**
33
+
creates Iceberg tables dynamically when they do not exist
34
+
***Schema Synchronization:**
35
+
propagates schema changes (e.g., column additions) from source systems to Iceberg
36
+
***Data Replication:**
37
+
supports both batch and streaming data synchronization
38
38
39
39
How to create Pipeline
40
40
----------------
@@ -82,7 +82,7 @@ Pipeline Connector Options
82
82
<td>required</td>
83
83
<td style="word-wrap: break-word;">(none)</td>
84
84
<td>String</td>
85
-
<td>Specify what connector to use, here should be <code>'iceberg'</code>.</td>
85
+
<td>Specify what connector to use, here should be <code>iceberg</code>.</td>
86
86
</tr>
87
87
<tr>
88
88
<td>name</td>
@@ -96,7 +96,7 @@ Pipeline Connector Options
96
96
<td>required</td>
97
97
<td style="word-wrap: break-word;">(none)</td>
98
98
<td>String</td>
99
-
<td>Metastore of iceberg catalog, supports hadoop and hive.</td>
99
+
<td>Metastore of Iceberg catalog, supports <code>hadoop</code> and <code>hive</code>.</td>
100
100
</tr>
101
101
<tr>
102
102
<td>catalog.properties.warehouse</td>
@@ -117,21 +117,21 @@ Pipeline Connector Options
117
117
<td>optional</td>
118
118
<td style="word-wrap: break-word;">(none)</td>
119
119
<td>String</td>
120
-
<td>Partition keys for each partitioned table, allow setting multiple primary keys for multiTables. Each table are separated by ';', and each partition key are separated by ','. For example, we can set partition.key of two tables by 'testdb.table1:id1,id2;testdb.table2:name'.</td>
120
+
<td>Partition keys for each partitioned table. Allow setting multiple primary keys for multiTables. Tables are separated by ';', and partition keys are separated by ','. For example, we can set <code>partition.key</code> of two tables using 'testdb.table1:id1,id2;testdb.table2:name'.</td>
121
121
</tr>
122
122
<tr>
123
123
<td>catalog.properties.*</td>
124
124
<td>optional</td>
125
125
<td style="word-wrap: break-word;">(none)</td>
126
126
<td>String</td>
127
-
<td>Pass options of Iceberg catalog to pipeline,See <a href="https://iceberg.apache.org/docs/nightly/flink-configuration/#catalog-configuration">Iceberg catalog options</a>. </td>
127
+
<td>Pass Iceberg catalog options to the pipeline,See <a href="https://iceberg.apache.org/docs/nightly/flink-configuration/#catalog-configuration">Iceberg catalog options</a>. </td>
128
128
</tr>
129
129
<tr>
130
130
<td>table.properties.*</td>
131
131
<td>optional</td>
132
132
<td style="word-wrap: break-word;">(none)</td>
133
133
<td>String</td>
134
-
<td>Pass options of Iceberg table to pipeline,See <a href="https://iceberg.apache.org/docs/nightly/configuration/#write-properties">Iceberg table options</a>. </td>
134
+
<td>Pass Iceberg table options to the pipeline,See <a href="https://iceberg.apache.org/docs/nightly/configuration/#write-properties">Iceberg table options</a>. </td>
135
135
</tr>
136
136
</tbody>
137
137
</table>
@@ -140,9 +140,9 @@ Pipeline Connector Options
140
140
Usage Notes
141
141
--------
142
142
143
-
* Only support Iceberg primary key table, so the source table must have primary keys.
143
+
* The source table must have a primary key. Tables with no primary key are not supported.
144
144
145
-
* Not support exactly-once. The connector uses at-least-once + primary key table for idempotent writing.
145
+
* Exactly-once semantics are not supported. The connector uses at-least-once + the table's primary key for idempotent writing.
0 commit comments