Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
2244688
[FLINK-32172][kafka] KafkaExampleUtils incorrect check of the minimum…
reswqa May 25, 2023
27e2bd3
[FLINK-32289][docs] Fix incorrect metadata column type in examples
yuxiqian Jun 13, 2023
910fc5a
[FLINK-31747] Remove Confluent Avro formats from externalized Kafka c…
tzulitai Jun 1, 2023
c1e3527
[FLINK-32462] Pin the used shaded version of Guava and Jackson in the…
MartijnVisser Jun 28, 2023
ad62c13
[FLINK-32019][Connector/Kafka] EARLIEST offset strategy for partition…
loserwang1024 May 6, 2023
14d8462
[FLINK-32021][kafka] Improve the java docs of SpecifiedOffsetsInitial…
loserwang1024 Jul 11, 2023
97dbfca
[FLINK-32455] Copy over TypeSerializerUpgradeTestBase due to breaking…
tzulitai Jul 4, 2023
21d3b10
[FLINK-32453] Ambiguous assertThat call after upgrade to Flink 1.18
tzulitai Jul 4, 2023
9109722
[FLINK-31408] Add support for EOS delivery-guarantee in upsert-kafka
Gerrrr Mar 12, 2023
811716c
[FLINK-32020] Enable Dynamic Partition Discovery by Default in Kafka …
loserwang1024 May 6, 2023
79ae2d7
[FLINK-32591][Connectors/Kafka] Update document of Kafka Source: Enab…
loserwang1024 Jul 17, 2023
d6525c1
[FLINK-31208][Connectors/Kafka] KafkaSourceReader overrides meaningle…
loserwang1024 May 4, 2023
818d1fd
[FLINK-33017] Remove dependency on shaded guava
Gerrrr Sep 5, 2023
27a5465
[FLINK-28758] Fix stop-with-savepoint for FlinkKafkaConsumer
pnowojski Sep 13, 2023
4c03d60
[hotfix][docs] Optimize the Security part in docs
ruanhang1993 Sep 11, 2023
d89a082
[FLINK-29398] Provide rack ID to KafkaSource to take advantage of Rac…
GoutyEthan Feb 8, 2023
b09928d
[FLINK-33219][connector/kafka] Add new archunit violation messages in…
PatrickRen Oct 9, 2023
73f761f
[FLINK-33149][Connector/Kafka] Bump snappy-java from 1.1.8.3 to 1.1.10.5
dependabot[bot] Jun 15, 2023
b0f15f2
[FLINK-33231] [source] Properly evict offsetsToCommit cache on checkp…
tzulitai Oct 10, 2023
89343bb
[FLINK-33234][Connector/Kafka] Bump Guava to 32.1.2-jre
dependabot[bot] Oct 10, 2023
26ab532
[FLINK-33234][Connector/Kafka] Exclude bundled Guava versions from Ka…
MartijnVisser Oct 11, 2023
e9d3089
[FLINK-33191][Connector/Kafka] Remove dependency on Flink Shaded
MartijnVisser Oct 9, 2023
bd260f1
[FLINK-33191][Connector/Kafka] Make the `testKafkaValueDeserializatio…
MartijnVisser Oct 10, 2023
c829d7a
[FLINK-33238][Formats/Avro] Upgrade used AVRO version to 1.11.3. This…
MartijnVisser Oct 11, 2023
398054a
[hotfix] Update CI strategy. This closes #61
MartijnVisser Oct 16, 2023
37cbb83
[FLINK-30400][build] Stop bundling flink-connector-base. This closes #50
ruanhang1993 Oct 16, 2023
946df1e
[FLINK-28303] Support LatestOffsetsInitializer to avoid latest-offset…
Sep 26, 2023
54e3b70
[FLINK-28303] Allow LATEST_OFFSET marker when restoring from old chec…
tzulitai Oct 23, 2023
40da49e
[hotfix] Test connector against Flink 1.18.0 and Flink 1.19-SNAPSHOT
MartijnVisser Oct 25, 2023
b732ce3
[hotfix] Partially revert 40da49e73b956b1a6fa0c1351b695b520c91919e an…
MartijnVisser Oct 25, 2023
d9628f5
Update pom versions
guruguhams Oct 30, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion .github/workflows/push_pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,9 @@ concurrency:
cancel-in-progress: true
jobs:
compile_and_test:
strategy:
matrix:
flink: [ 1.17.1, 1.18.0 ]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: 1.17.0
flink_version: ${{ matrix.flink }}
17 changes: 15 additions & 2 deletions .github/workflows/weekly.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,8 +26,21 @@ jobs:
if: github.repository_owner == 'apache'
strategy:
matrix:
flink: [1.17-SNAPSHOT, 1.18-SNAPSHOT]
flink_branches: [{
flink: 1.17.1,
branch: v3.0
}, {
flink: 1.18.0,
branch: v3.0
}, {
flink: 1.17.1,
branch: main
}, {
flink: 1.18.0,
branch: main
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
flink_version: ${{ matrix.flink_branches.flink }}
connector_branch: ${{ matrix.flink_branches.branch }}
run_dependency_convergence: false
1 change: 1 addition & 0 deletions .idea/vcs.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions docs/content.zh/docs/connectors/datastream/kafka.md
Original file line number Diff line number Diff line change
Expand Up @@ -229,7 +229,7 @@ Kafka consumer 的配置可以参考 [Apache Kafka 文档](http://kafka.apache.o

### 动态分区检查
为了在不重启 Flink 作业的情况下处理 Topic 扩容或新建 Topic 等场景,可以将 Kafka Source 配置为在提供的 Topic / Partition
订阅模式下定期检查新分区。要启用动态分区检查,请将 ```partition.discovery.interval.ms``` 设置为非负值
订阅模式下定期检查新分区。要启用动态分区检查,请将 ```partition.discovery.interval.ms``` 设置为正值


{{< tabs "KafkaSource#PartitionDiscovery" >}}
Expand All @@ -248,7 +248,7 @@ KafkaSource.builder() \
{{< /tabs >}}

{{< hint warning >}}
分区检查功能默认**不开启**。需要显式地设置分区检查间隔才能启用此功能
分区检查间隔默认为5分钟。需要显式地设置分区检查间隔为非正数才能关闭此功能
{{< /hint >}}

### 事件时间和水印
Expand Down
294 changes: 0 additions & 294 deletions docs/content.zh/docs/connectors/table/formats/avro-confluent.md

This file was deleted.

Loading