Skip to content

Commit 92c62c5

Browse files
corgy-wcorgy-w
authored
[Improve][Connector-V2] Optimize dialect selection in jdbc (#8820)
1 parent c99dbf2 commit 92c62c5

40 files changed

+329
-111
lines changed

‎docs/en/connector-v2/sink/Jdbc.md

+21-1
Original file line numberDiff line numberDiff line change
@@ -31,14 +31,15 @@ support `Xa transactions`. You can set `is_exactly_once=true` to enable it.
3131

3232
## Options
3333

34-
| Name | Type | Required | Default |
34+
| Name | Type | Required | Default |
3535
|-------------------------------------------|---------|----------|------------------------------|
3636
| url | String | Yes | - |
3737
| driver | String | Yes | - |
3838
| user | String | No | - |
3939
| password | String | No | - |
4040
| query | String | No | - |
4141
| compatible_mode | String | No | - |
42+
| dialect | String | No | - |
4243
| database | String | No | - |
4344
| table | String | No | - |
4445
| primary_keys | Array | No | - |
@@ -90,6 +91,23 @@ For example, when using OceanBase database, you need to set it to 'mysql' or 'or
9091

9192
Postgres 9.5 version or below,please set it to `postgresLow` to support cdc
9293

94+
### dialect [string]
95+
96+
The appointed dialect, if it does not exist, is still obtained according to the url, and the priority is higher than the url. For example,when using starrocks, you need set it to `starrocks`. Similarly, when using mysql, you need to set its value to `mysql`.
97+
98+
#### dialect list
99+
100+
| | Dialect Name | |
101+
|-----------|--------------|----------|
102+
| Greenplum | DB2 | Dameng |
103+
| Gbase8a | HIVE | KingBase |
104+
| MySQL | StarRocks | Oracle |
105+
| Phoenix | Postgres | Redshift |
106+
| SapHana | Snowflake | Sqlite |
107+
| SqlServer | Tablestore | Teradata |
108+
| Vertica | OceanBase | XUGU |
109+
| IRIS | Inceptor | Highgo |
110+
93111
### database [string]
94112

95113
Use this `database` and `table-name` auto-generate sql and receive upstream input datas write to database.
@@ -105,11 +123,13 @@ This option is mutually exclusive with `query` and has a higher priority.
105123
The table parameter can fill in the name of an unwilling table, which will eventually be used as the table name of the creation table, and supports variables (`${table_name}`, `${schema_name}`). Replacement rules: `${schema_name}` will replace the SCHEMA name passed to the target side, and `${table_name}` will replace the name of the table passed to the table at the target side.
106124

107125
mysql sink for example:
126+
108127
1. test_${schema_name}_${table_name}_test
109128
2. sink_sinktable
110129
3. ss_${table_name}
111130

112131
pgsql (Oracle Sqlserver ...) Sink for example:
132+
113133
1. ${schema_name}.${table_name} _test
114134
2. dbo.tt_${table_name} _sink
115135
3. public.sink_table

‎docs/en/connector-v2/source/Jdbc.md

+19
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,7 @@ supports query SQL and can achieve projection effect.
4949
| password | String | No | - | password |
5050
| query | String | No | - | Query statement |
5151
| compatible_mode | String | No | - | The compatible mode of database, required when the database supports multiple compatible modes.<br/> For example, when using OceanBase database, you need to set it to 'mysql' or 'oracle'. <br/> when using starrocks, you need set it to `starrocks` |
52+
| dialect | String | No | - | The appointed dialect, if it does not exist, is still obtained according to the url, and the priority is higher than the url. <br/> For example,when using starrocks, you need set it to `starrocks` |
5253
| connection_check_timeout_sec | Int | No | 30 | The time in seconds to wait for the database operation used to validate the connection to complete. |
5354
| partition_column | String | No | - | The column name for split data. |
5455
| partition_upper_bound | Long | No | - | The partition_column max value for scan, if not set SeaTunnel will query database get max value. |
@@ -93,6 +94,24 @@ decimal_type_narrowing = false
9394
| NUMBER(6, 0) | Decimal(6, 0) |
9495
| NUMBER(10, 0) | Decimal(10, 0) |
9596

97+
### dialect [string]
98+
99+
The appointed dialect, if it does not exist, is still obtained according to the url, and the priority is higher than the url. For example,when using starrocks, you need set it to `starrocks`. Similarly, when using mysql, you need to set its value to `mysql`.
100+
101+
#### dialect list
102+
103+
| | Dialect Name | |
104+
|-----------|--------------|----------|
105+
| Greenplum | DB2 | Dameng |
106+
| Gbase8a | HIVE | KingBase |
107+
| MySQL | StarRocks | Oracle |
108+
| Phoenix | Postgres | Redshift |
109+
| SapHana | Snowflake | Sqlite |
110+
| SqlServer | Tablestore | Teradata |
111+
| Vertica | OceanBase | XUGU |
112+
| IRIS | Inceptor | Highgo |
113+
114+
96115
## Parallel Reader
97116

98117
The JDBC Source connector supports parallel reading of data from tables. SeaTunnel will use certain rules to split the data in the table, which will be handed over to readers for reading. The number of readers is determined by the `parallelism` option.

0 commit comments

Comments
 (0)