Skip to content

Commit 99e6c41

Browse files
committed
release-1.6.0
1 parent c92aaa1 commit 99e6c41

9 files changed

Lines changed: 23 additions & 29 deletions

File tree

README.md

Lines changed: 8 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -59,10 +59,13 @@ Connectors for Hologres
5959
* [hologres-connector-flink-1.14](https://github.com/aliyun/alibabacloud-hologres-connectors/tree/flink-1.13/1.14/hologres-connector-flink-1.14)<br/>
6060
依赖hologres-connector-flink-base,实现了Flink 1.14版本的Connector
6161

62-
* [hologres-connector-flink-1.15](./hologres-connector-flink-1.15)<br/>
62+
* [hologres-connector-flink-1.15](https://github.com/aliyun/alibabacloud-hologres-connectors/tree/flink-1.15/1.17/hologres-connector-flink-1.15)<br/>
6363
依赖hologres-connector-flink-base,实现了Flink 1.15版本的Connector
6464

65-
* [hologres-connector-flink-1.17](./hologres-connector-flink-1.17)<br/>
65+
* [hologres-connector-flink-1.17](https://github.com/aliyun/alibabacloud-hologres-connectors/tree/flink-1.15/1.17/hologres-connector-flink-1.17)<br/>
66+
依赖hologres-connector-flink-base,实现了Flink 1.17版本的Connector<br/><br/>
67+
68+
* [hologres-connector-flink-1.19](./hologres-connector-flink-1.19)<br/>
6669
依赖hologres-connector-flink-base,实现了Flink 1.17版本的Connector<br/><br/>
6770

6871
* [hologres-connector-hive-base](./hologres-connector-hive-base)
@@ -79,7 +82,7 @@ Connectors for Hologres
7982
* [hologres-connector-spark-base](./hologres-connector-spark-base)
8083

8184
该模块实现了Hologres Spark Connector的通用核心代码
82-
* [hologres-connector-spark-2.x](./hologres-connector-spark-2.x)
85+
* [hologres-connector-spark-2.x](https://github.com/aliyun/alibabacloud-hologres-connectors/tree/spark-2.x/hologres-connector-spark-2.x)
8386

8487
依赖hologres-connector-spark-base,实现了Spark2.x版本的Connector
8588
* [hologres-connector-spark-3.x](./hologres-connector-spark-3.x)
@@ -103,8 +106,8 @@ Connectors for Hologres
103106
```xml
104107
<dependency>
105108
<groupId>com.alibaba.hologres</groupId>
106-
<artifactId>hologres-connector-flink-1.17</artifactId>
107-
<version>1.4.2</version>
109+
<artifactId>hologres-connector-flink-1.19</artifactId>
110+
<version>1.6.0</version>
108111
<classifier>jar-with-dependencies</classifier>
109112
</dependency>
110113
```

hologres-connector-hive-2.x/README.md

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
<dependency>
1111
<groupId>com.alibaba.hologres</groupId>
1212
<artifactId>hologres-connector-hive-2.x</artifactId>
13-
<version>1.5.6</version>
13+
<version>1.6.0</version>
1414
<classifier>jar-with-dependencies</classifier>
1515
</dependency>
1616
```
@@ -41,9 +41,9 @@ mvn clean install -N
4141
#### 加载jar包
4242

4343
* 永久:
44-
* 将hologres-connector-hive-2.x-1.5.6-SNAPSHOT-jar-with-dependencies.jar放在HiveServer2所在节点的$HIVE_HOME/auxlib目录下(目录不存在就新建)
44+
* 将hologres-connector-hive-2.x-1.6.0-SNAPSHOT-jar-with-dependencies.jar放在HiveServer2所在节点的$HIVE_HOME/auxlib目录下(目录不存在就新建)
4545
* session级
46-
1. 将hologres-connector-hive-2.x-1.5.6-SNAPSHOT-jar-with-dependencies.jar上传至hdfs
46+
1. 将hologres-connector-hive-2.x-1.6.0-SNAPSHOT-jar-with-dependencies.jar上传至hdfs
4747
2. 在hive session中,使用add jar引入jar包。add jar hdfs:....
4848

4949
## 注意事项
@@ -261,9 +261,6 @@ insert into test_copy_to_holo select 1, 'aaaaabbbbb';
261261
| enable_serverless_computing| false || 是否使用serverless资源, 仅对读取和bulk_load写入有效,详见[serverless computing](https://help.aliyun.com/zh/hologres/user-guide/serverless-computing) |
262262
| serverless_computing_query_priority| 3 || serverless computing执行优先级 |
263263
| statement_timeout| 28800000 || query执行的超时时间 |
264-
| akv4_enabled| false || 默认值为false, 表示不启用akv4认证 |
265-
| akv4_region||| 无默认值, 在启用akv4认证时,需要根据实例所在的region设置,例如cn-beijing |
266-
267264
写参数
268265

269266
| 参数名 | 默认值 | 是否必填 | 说明 |

hologres-connector-hive-2.x/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
<parent>
99
<groupId>com.alibaba.hologres</groupId>
1010
<artifactId>hologres-connector-parent</artifactId>
11-
<version>1.5.6-SNAPSHOT</version>
11+
<version>1.6.0-SNAPSHOT</version>
1212
</parent>
1313

1414
<artifactId>hologres-connector-hive-2.x</artifactId>

hologres-connector-hive-3.x/README.md

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
<dependency>
1111
<groupId>com.alibaba.hologres</groupId>
1212
<artifactId>hologres-connector-hive-3.x</artifactId>
13-
<version>1.5.6</version>
13+
<version>1.6.0</version>
1414
<classifier>jar-with-dependencies</classifier>
1515
</dependency>
1616
```
@@ -40,9 +40,9 @@ mvn clean install -N
4040
#### 加载jar包
4141

4242
* 永久:
43-
* 将hologres-connector-hive-3.x-1.5.6-SNAPSHOT-jar-with-dependencies.jar放在HiveServer3所在节点的$HIVE_HOME/auxlib目录下(目录不存在就新建)
43+
* 将hologres-connector-hive-3.x-1.6.0-SNAPSHOT-jar-with-dependencies.jar放在HiveServer3所在节点的$HIVE_HOME/auxlib目录下(目录不存在就新建)
4444
* session级
45-
1. 将hologres-connector-hive-3.x-1.5.6-SNAPSHOT-jar-with-dependencies.jar上传至hdfs
45+
1. 将hologres-connector-hive-3.x-1.6.0-SNAPSHOT-jar-with-dependencies.jar上传至hdfs
4646
2. 在hive session中,使用add jar引入jar包。add jar hdfs:....
4747

4848
## 注意事项
@@ -260,9 +260,6 @@ insert into test_copy_to_holo select 1, 'aaaaabbbbb';
260260
| enable_serverless_computing| false || 是否使用serverless资源, 仅对读取和bulk_load写入有效,详见[serverless computing](https://help.aliyun.com/zh/hologres/user-guide/serverless-computing) |
261261
| serverless_computing_query_priority| 3 || serverless computing执行优先级 |
262262
| statement_timeout| 28800000 || query执行的超时时间 |
263-
| akv4_enabled| false || 默认值为false, 表示不启用akv4认证 |
264-
| akv4_region||| 无默认值, 在启用akv4认证时,需要根据实例所在的region设置,例如cn-beijing |
265-
266263
写参数
267264

268265
| 参数名 | 默认值 | 是否必填 | 说明 |

hologres-connector-hive-3.x/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
<parent>
99
<groupId>com.alibaba.hologres</groupId>
1010
<artifactId>hologres-connector-parent</artifactId>
11-
<version>1.5.6-SNAPSHOT</version>
11+
<version>1.6.0-SNAPSHOT</version>
1212
</parent>
1313

1414
<artifactId>hologres-connector-hive-3.x</artifactId>

hologres-connector-hive-base/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
<parent>
99
<groupId>com.alibaba.hologres</groupId>
1010
<artifactId>hologres-connector-parent</artifactId>
11-
<version>1.5.6-SNAPSHOT</version>
11+
<version>1.6.0-SNAPSHOT</version>
1212
</parent>
1313

1414
<artifactId>hologres-connector-hive-base</artifactId>

hologres-connector-kafka/README.md

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616
<dependency>
1717
<groupId>com.alibaba.hologres</groupId>
1818
<artifactId>hologres-connector-kafka</artifactId>
19-
<version>1.5.6</version>
19+
<version>1.6.0</version>
2020
<classifier>jar-with-dependencies</classifier>
2121
</dependency>
2222
```
@@ -589,8 +589,6 @@ curl -s -X POST -H 'Content-Type: application/json' --data @holo-sink.json http:
589589
| connection.retrySleepStepMs | 10000 || 每次重试的等待时间=retrySleepInitMs+retry*retrySleepStepMs |
590590
| connection.connectionMaxIdleMs | 60000 || 写入线程和点查线程数据库连接的最大Idle时间,超过连接将被释放 |
591591
| connection.fixedConnectionMode| false|| 写入和点查不占用连接数(beta功能,需要connector版本>=1.2.0,hologres引擎版本>=1.3)|
592-
| connection.enableAkv4| false|| 默认值为false, 表示不启用akv4认证|
593-
| connection.akv4Region| false|| 无默认值, 在启用akv4认证时,需要根据实例所在的region设置,例如cn-beijing |
594592
| initial_timestamp | -1 || 从某个时间点开始消费kafka数据写入hologres |
595593
| dirty_data_strategy | EXCEPTION || 脏数据处理策略,只对空数据或者schema错误的脏数据有效,不能处理格式错误的数据(input_format错误,乱码等)<br>EXCEPTION: 脏数据抛出异常 <br>SKIP: 跳过脏数据,打印warn日志<br>SKIP_ONCE: 跳过特定的一条脏数据,详见dirty_data_to_skip_once参数 |
596594
| dirty_data_to_skip_once | `null,-1,-1` || 在dirty_data_strategy=SKIP_ONCE 时生效,由三个部分组成,分别是需要跳过的脏数据对应的topic,partition,offset,通过`,`隔开 |

hologres-connector-kafka/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55
<parent>
66
<groupId>com.alibaba.hologres</groupId>
77
<artifactId>hologres-connector-parent</artifactId>
8-
<version>1.5.6-SNAPSHOT</version>
8+
<version>1.6.0-SNAPSHOT</version>
99
</parent>
1010
<modelVersion>4.0.0</modelVersion>
1111

pom.xml

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -6,12 +6,12 @@
66

77
<groupId>com.alibaba.hologres</groupId>
88
<artifactId>hologres-connector-parent</artifactId>
9-
<version>1.5.6-SNAPSHOT</version>
9+
<version>1.6.0-SNAPSHOT</version>
1010
<packaging>pom</packaging>
1111

1212
<properties>
13-
<hologres.client.version>2.6.7</hologres.client.version>
14-
<java.version>1.8</java.version>
13+
<hologres.client.version>2.6.10</hologres.client.version>
14+
<java.version>11</java.version>
1515
<maven.compiler.source>${java.version}</maven.compiler.source>
1616
<maven.compiler.target>${java.version}</maven.compiler.target>
1717
<spotless.version>2.27.1</spotless.version>
@@ -45,8 +45,7 @@
4545

4646
<modules>
4747
<module>hologres-connector-flink-base</module>
48-
<module>hologres-connector-flink-1.15</module>
49-
<module>hologres-connector-flink-1.17</module>
48+
<module>hologres-connector-flink-1.19</module>
5049
<module>hologres-connector-spark-base</module>
5150
<module>hologres-connector-spark-3.x</module>
5251
<module>hologres-connector-hive-base</module>

0 commit comments

Comments
 (0)