Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
322 commits
Select commit Hold shift + click to select a range
20223de
[FLINK-17925][fs-connector] Fix Filesystem options to default values …
JingsongLi May 27, 2020
b77f97c
[hotfix][tests] Move containsCause to FlinkMatchers
twalthr May 29, 2020
3a9bc13
[FLINK-17887][table][connector] Improve interface of ScanFormatFactor…
wuchong Jun 1, 2020
bd6467a
[FLINK-18299][json] Fix the non SQL standard timestamp format in JSON…
fsk119 Jun 17, 2020
bc8d5a7
[FLINK-17000][table] Ensure that every logical type can be represente…
twalthr Jun 23, 2020
1acd122
[FLINK-18002][json] Correct the behavior for ContainerNode as varchar…
libenchao Jun 1, 2020
fbc291f
[FLINK-18537][table] Replace RowDataTypeInfo with InternalTypeInfo
twalthr Jul 10, 2020
ed9f5af
[FLINK-18296][json] Add support for TIMESTAMP_WITH_LOCAL_ZONE type fo…
fsk119 Jun 23, 2020
7006696
[FLINK-18607][build] Give the maven module a human readable name
nielsbasjes Jul 22, 2020
1380f0e
[FLINK-16048][avro] Support read/write confluent schema registry avro…
danny0405 Jul 30, 2020
ae8ac94
[FLINK-18776][avro] Avoid hardcoded scala version
dianfu Jul 31, 2020
5561317
[FLINK-18700][debezium] Debezium-json format throws NPE when PG table…
wuchong Jul 29, 2020
b76981e
[FLINK-18705][debezium] Fix Debezium-JSON throws NPE when tombstone m…
wuchong Jul 29, 2020
5260033
[FLINK-18844][json][maxwell] Support maxwell-json format to read Maxw…
dijiekstra Aug 12, 2020
bad1aeb
[hoxfix] Fix various typos
brandonJY Aug 17, 2020
3776d1e
[FLINK-18824][json][table] Support serialization for canal-json format
caozhen1937 Sep 1, 2020
f30075d
[FLINK-18823][format] Support serialization for debezium-json format
SteNicholas Sep 10, 2020
55f493e
[FLINK-18192] Upgrade avro to 1.10
dawidwys Sep 10, 2020
7d74f65
[FLINK-19152] Remove Kafka 0.10.x and 0.11.x connectors
aljoscha Sep 7, 2020
fca2c3f
[FLINK-19002][canal][json] Support to only read changelogs of specifi…
wuchong Sep 18, 2020
1c7ecd9
[FLINK-19098][json][csv] Make RowData CSV and JSON converters public
crazyzhou Sep 25, 2020
edf51f6
[FLINK-19509][json] Support MULTISET type for JSON format
wangxlong Oct 10, 2020
839f96a
[FLINK-18999][table-common][table-planner-blink] Add isTemporary flag…
lirui-apache Aug 21, 2020
13d7fbb
[FLINK-17528][table] Remove RowData#get() API and use FieldGetter ins…
wuchong Oct 15, 2020
2e4a694
[FLINK-17528][table] Remove ArrayData#get() API and use ElementGetter…
wuchong Oct 15, 2020
c883034
[hotfix][table-common] Avoid unnecessary casting when creating type i…
twalthr Oct 19, 2020
ef72378
[hotfix][json] Add serialVersionUID to JsonInputFormat class
wangxlong Oct 29, 2020
b86a6e2
[FLINK-19779][avro] Remove the "record_" field name prefix for Avro f…
danny0405 Oct 27, 2020
11dcb83
[FLINK-19786][avro] Fix the nullability and precision for Avro format…
danny0405 Oct 27, 2020
7fbc65d
[FLINK-19873][canal-json] Skip DDL change events for Canal data
pyscala Nov 4, 2020
26e9b18
[FLINK-19790][json] Clear reused ObjectNode's content for map convert…
libenchao Oct 23, 2020
9b8b7b4
[FLINK-19849] Fix NOTICE files for 1.12 release
rmetzger Oct 30, 2020
719b390
[FLINK-18546] Upgrade to Kafka Schema Registry Client 5.5.2
dawidwys Nov 6, 2020
7bfb2b4
[FLINK-19276][json][connector-kafka] Support reading Debezium metadata
twalthr Nov 3, 2020
2f6933d
[FLINK-19823][table][fs-connector] Filesystem connector supports de/s…
JingsongLi Nov 7, 2020
1dd7a3a
[FLINK-18774][debezium-avro] Support debezium avro format
caozhen1937 Sep 1, 2020
a1c3e9d
[FLINK-18774][debezium-avro] Improve debezium-avro format implementation
wuchong Nov 7, 2020
aa4a291
[FLINK-19912][json] Fix JSON format fails to serialize map value with…
wangxlong Nov 11, 2020
48f6d29
[FLINK-20147][json] Replace lambdas with classes to prevent serializa…
twalthr Nov 16, 2020
ea1af30
[FLINK-20170][json] Fix JSON format loses precision when deserializin…
caozhen1937 Nov 20, 2020
7113361
[hotfix][json] Consider nullability for Debezium ingestion timestamp
twalthr Nov 20, 2020
fb84e62
[FLINK-20295][table][fs-connector] Table File Source lost data when r…
JingsongLi Nov 25, 2020
45fd0b4
[hotfix] Shade avro in sql-avro jars
dawidwys Nov 20, 2020
3b61f33
Update version to 1.13-SNAPSHOT
dianfu Nov 26, 2020
93ce729
[FLINK-20470][json] MissingNode can't be casted to ObjectNode when de…
zhuxiaoshang Dec 9, 2020
954ef1b
[FLINK-19880][json] Fix ignore-parse-errors option not work for the l…
cxiiiiiii Dec 18, 2020
fbf6bf1
[FLINK-20651] Format code with Spotless/google-java-format
Dec 28, 2020
e88df03
[FLINK-20790][build][avro] Move generated files to target/generated[-…
zentol Dec 29, 2020
6a81b61
[FLINK-20385][canal-json] Allow to read metadata for canal-json format
SteNicholas Dec 31, 2020
a3a9368
[FLINK-20841][git] Remove .gitignore entries for generated files
XComp Jan 4, 2021
1299112
[FLINK-18090] Update tests for new Row.toString
twalthr Dec 18, 2020
b53a936
[FLINK-20773][json] Support to parse unescaped control chars in strin…
V1ncentzzZ Jan 8, 2021
0b7fce0
[FLINK-20321][formats] Fix NPE when using Avro/Json/Csv formats to de…
xuewang Jan 8, 2021
42cd733
[FLINK-20906][legal] Update copyright year to 2021 for NOTICE files.
xintongsong Jan 9, 2021
6be35ca
[FLINK-20861][json] Introduce an option for serializing DECIMALs in J…
lmagic233 Jan 13, 2021
842359a
[FLINK-20885][canal-json] Fix deserialization exception when using 'c…
SteNicholas Jan 14, 2021
f4edddf
[FLINK-20953][canal-json] Support regular expression to filter databa…
SteNicholas Jan 15, 2021
f717f27
[FLINK-19446][canal-json] Fix canal-json format parse UPDATE record w…
SteNicholas Jan 22, 2021
17c5aaa
[FLINK-21020][build] Bump Jackson to 2.12.1
HuangXingBo Jan 21, 2021
9cd50f6
[FLINK-21172][canal][json] Support 'event-timestampcanal-json format …
SteNicholas Feb 2, 2021
9f8a7fd
[FLINK-21193][docs] Migrate Flink docs from Jekyll to Hugo
sjwiesman Feb 7, 2021
942784c
[FLINK-21176][docs-zh] Translate the updates of 'avro-confluent.md' t…
klook-tech-jayyang Feb 22, 2021
ed7b269
[FLINK-21620][table] Support abbreviation TIMESTAMP_LTZ for TIMESTAMP…
leonardBang Mar 9, 2021
5818335
[FLINK-21913][table][connectors] Update DynamicTableFactory.Context t…
twalthr Mar 18, 2021
9fef485
[FLINK-21947][csv] Support TIMESTAMP_LTZ type in CSV format
leonardBang Mar 24, 2021
0fbe0ca
[hotfix] Package format-common to flink-csv/flink-json (#15394)
leonardBang Mar 27, 2021
07ba2fa
Update version to 1.14-SNAPSHOT
guoweiM Apr 18, 2021
40d8e22
[FLINK-13538][formats] Figure out wrong field name when serializer/de…
luoyuxia Jun 3, 2021
1b4cc85
[FLINK-20926][maxwell][json] Allow to read metadata for maxwell-json …
SteNicholas Jun 1, 2021
329193f
[FLINK-21229][avro-confluent-registry] Shorten RegistryAvroOptions
twalthr Jun 22, 2021
0b915bf
[FLINK-21229][avro-confluent-registry] Add Confluent schema registry …
Apr 29, 2021
900a198
[FLINK-21229][docs] Update avro-confluent docs
twalthr Jun 23, 2021
58893ed
[FLINK-22880][table] Remove 'blink' term from code base
twalthr Jun 24, 2021
e3a499b
[FLINK-21448] Add dependency for ChangelogStateBackend ITTests
zhangyy91 Jun 24, 2021
c611980
[FLINK-22879][table] Rename flink-table-runtime-blink to flink-table-…
twalthr Jul 5, 2021
7f2ff96
[FLINK-22879][table] Rename flink-table-planner-blink to flink-table-…
twalthr Jul 6, 2021
6df5e27
[FLINK-23064][format-json] Make JsonOptions PublicEvolving
Airblader Jun 30, 2021
a9bca2b
[FLINK-23064][format-avro][format-avro-confluent-registry] Expose con…
Airblader Jun 30, 2021
47a10d6
[FLINK-18783] Load Akka with separate classloader
zentol Jun 29, 2021
e75bcdb
Revert "[FLINK-18783] Load Akka with separate classloader"
pnowojski Jul 14, 2021
1bce2e2
[FLINK-18783] Load Akka with separate classloader
zentol Jun 29, 2021
1649c9c
[FLINK-23450][avro-confluent-registry] Set properties map for Debeziu…
twalthr Jul 21, 2021
f08f6e7
[FLINK-23513] Remove format descriptors
Airblader Jul 30, 2021
54ab781
[FLINK-23192][table] Move connector & format options to consistent pa…
Airblader Aug 4, 2021
918235f
[FLINK-23044][docs] Fix typos
hapihu Aug 18, 2021
dcae1cc
Update version to 1.15-SNAPSHOT
xintongsong Aug 28, 2021
ec97614
[FLINK-24034] Upgrade apache commons dependencies
MartijnVisser Sep 8, 2021
bd82131
[FLINK-23607][state/changelog] Make Changelog Backend a transitive de…
rkhachatryan Aug 25, 2021
6561133
[FLINK-24281][connectors/kafka] Migrate all format tests from FlinkKa…
fapaul Sep 14, 2021
e6d1ef6
[FLINK-24018][build] Remove Scala dependencies from Java APIs
zentol Oct 25, 2021
b01a973
[FLINK-24599][table] Replace static methods with convenient methods i…
matriv Oct 22, 2021
20cc1d8
[FLINK-24673][formats] Deprecate old Row SerializationSchema/Deserial…
slinkydeveloper Oct 28, 2021
13a86e6
[FLINK-24715][connectors][filesystems][formats] Update multiple Jacks…
MartijnVisser Nov 3, 2021
9aa0925
[FLINK-24776][table] Clarify DecodingFormat and introduce Projectable…
slinkydeveloper Nov 11, 2021
868da97
[FLINK-25039][build] Disable shading of test jar by default
zentol Nov 25, 2021
d50867d
[FLINK-25060][table-common] Replace projection methods of FLINK-24399…
slinkydeveloper Nov 25, 2021
90ddb4f
[FLINK-24687][table][connectors] Move FileSystemTableSink, FileSystem…
slinkydeveloper Nov 24, 2021
d084a7c
[FLINK-25114][table-runtime] Remove flink-scala dependency and scala …
slinkydeveloper Dec 1, 2021
862df07
[FLINK-25229][table] Introduce flink-table-api-bridge-base
slinkydeveloper Dec 9, 2021
ede46ea
[FLINK-25362][docs] fix maven instructions for "Confluent Avro Format"
NicoK Dec 17, 2021
ebaa169
[FLINK-25390][connector-kafka][json] Show usage of helper to forward …
slinkydeveloper Jan 6, 2022
f5ca5ea
[FLINK-25504][Kafka] Upgrade Confluent to v6.2.2 and Kafka-Client to …
MartijnVisser Jan 13, 2022
ca7413a
[FLINK-25391][format-avro] Forward catalog table options
slinkydeveloper Jan 6, 2022
d8566a8
[FLINK-25391][format-json] Forward catalog table options
slinkydeveloper Jan 12, 2022
aa6e30c
[FLINK-24745][format][json] Support Oracle OGG json format
wgzhao Nov 3, 2021
d2b7bb3
[FLINK-24745][format][json] Improve the metadata tests and documentat…
luoyuxia Feb 12, 2022
4b1ca3e
Update version to 1.16-SNAPSHOT
gaoyunhaii Mar 14, 2022
9beeb21
[FLINK-26736][tests] Migrate flink-avro-confluent-registry to JUnit5
RyanSkraba Mar 25, 2022
239b361
[FLINK-26961][connectors][filesystems][formats] Update Jackson Databi…
snuyanzin Mar 31, 2022
1b0ab39
[FLINK-26011][avro-confluent-registry][test] add ArchUnit tests for t…
JingGe Apr 4, 2022
a56a132
[FLINK-26011][json][test] add ArchUnit tests for the test code
JingGe Apr 4, 2022
3507b28
[FLINK-24721][build] Remove unnecessary relativePath to parent
zentol Apr 20, 2022
2371b92
[FLINK-27352][json][tests] Migrate flink-json to JUnit5
BiGsuw May 3, 2022
0ff1cd0
[hotfix][json][tests] Fix location of services directory
zentol May 3, 2022
dd6c275
[FLINK-27442][Formats][Avro Confluent] Add Confluent repo to module f…
MartijnVisser May 4, 2022
43854ab
[FLINK-28060][Connector/Kafka] Updated Kafka Clients to 3.1.1 to reso…
MartijnVisser Jun 17, 2022
95f315e
[FLINK-28222][json] Add flink-sql-json module
zentol Jun 23, 2022
bbc81ba
[FLINK-28634][json] Add simple JsonSerDeSchema
zentol Jul 25, 2022
4a141f0
[FLINK-28634][json] Deprecate JsonNodeDeserializationSchema
zentol Jul 25, 2022
a31ac02
[FLINK-28807] Honor schema lifecycle
zentol Jul 26, 2022
a6b822a
[FLINK-28621][formats] Initialize mappers in open()
zentol Jul 28, 2022
f34906d
[FLINK-28621][core] Add central Jackson mapper factory methods
zentol Jul 28, 2022
077210b
[FLINK-28060][kafka] Bump Kafka to 3.2.1
zentol Aug 10, 2022
e71024c
[FLINK-28676] Update copyright year to 2014-2022 in NOTICE files
libenchao Jul 25, 2022
54d3c6c
[FLINK-24718] Update Avro dependency to 1.11.1
RyanSkraba Aug 31, 2022
4abce4b
Update version to 1.17-SNAPSHOT
HuangXingBo Sep 5, 2022
9975414
[FLINK-25868][build] Disable japicmp in packaging/e2e modules
zentol Feb 1, 2022
a81eba6
[FLINK-29513][Connector/Kafka] Update Kafka to version 3.2.3 which co…
MartijnVisser Oct 5, 2022
85e5ca6
[FLINK-29468][connectors][filesystems][formats] Update Jackson-BOM to…
snuyanzin Sep 29, 2022
d9a80bd
[FLINK-28405][Connector/Kafka] Update Confluent Platform images used …
MartijnVisser Oct 18, 2022
ad930a4
[FLINK-29638][connectors][filesystems][formats] Update Jackson-BOM to…
snuyanzin Oct 13, 2022
35ac273
Update version to 1.18-SNAPSHOT
leonardBang Feb 7, 2023
efad9b5
[FLINK-31348][Docs] Fix unclosed shortcodes (/tabs) in the docs, that…
dmvk Mar 7, 2023
6f905fb
[FLINK-31085][formats] Add schema option to confluent registry avro f…
fruska Mar 15, 2023
f1a078c
[FLINK-31485][Confluent Avro] Change packaging of Schema Registry so …
MartijnVisser Mar 16, 2023
453592b
[hotfix] Sort NOTICE dependencies in alphabetical order
MartijnVisser Mar 16, 2023
0d30880
[hotfix] Update copyright NOTICE year to 2023
rmetzger Mar 21, 2023
d762d01
[FLINK-30859] Externalize confluent avro related code
mas-chen Mar 24, 2023
96780b9
[FLINK-31747] remove debezium json for now
mas-chen Apr 6, 2023
a778563
[FLINK-31049] [flink-connector-kafka] Add support for Kafka record he…
AlexAxeman Mar 27, 2023
c9f8aa9
[hotfix] [flink-connector-kafka] Simplify ProducerRecord instantiatio…
tzulitai Apr 12, 2023
fc526a8
Update version to 3.1-SNAPSHOT
tzulitai Apr 12, 2023
2244688
[FLINK-32172][kafka] KafkaExampleUtils incorrect check of the minimum…
reswqa May 25, 2023
27e2bd3
[FLINK-32289][docs] Fix incorrect metadata column type in examples
yuxiqian Jun 13, 2023
910fc5a
[FLINK-31747] Remove Confluent Avro formats from externalized Kafka c…
tzulitai Jun 1, 2023
c1e3527
[FLINK-32462] Pin the used shaded version of Guava and Jackson in the…
MartijnVisser Jun 28, 2023
ad62c13
[FLINK-32019][Connector/Kafka] EARLIEST offset strategy for partition…
loserwang1024 May 6, 2023
14d8462
[FLINK-32021][kafka] Improve the java docs of SpecifiedOffsetsInitial…
loserwang1024 Jul 11, 2023
97dbfca
[FLINK-32455] Copy over TypeSerializerUpgradeTestBase due to breaking…
tzulitai Jul 4, 2023
21d3b10
[FLINK-32453] Ambiguous assertThat call after upgrade to Flink 1.18
tzulitai Jul 4, 2023
9109722
[FLINK-31408] Add support for EOS delivery-guarantee in upsert-kafka
Gerrrr Mar 12, 2023
811716c
[FLINK-32020] Enable Dynamic Partition Discovery by Default in Kafka …
loserwang1024 May 6, 2023
79ae2d7
[FLINK-32591][Connectors/Kafka] Update document of Kafka Source: Enab…
loserwang1024 Jul 17, 2023
d6525c1
[FLINK-31208][Connectors/Kafka] KafkaSourceReader overrides meaningle…
loserwang1024 May 4, 2023
818d1fd
[FLINK-33017] Remove dependency on shaded guava
Gerrrr Sep 5, 2023
27a5465
[FLINK-28758] Fix stop-with-savepoint for FlinkKafkaConsumer
pnowojski Sep 13, 2023
4c03d60
[hotfix][docs] Optimize the Security part in docs
ruanhang1993 Sep 11, 2023
d89a082
[FLINK-29398] Provide rack ID to KafkaSource to take advantage of Rac…
GoutyEthan Feb 8, 2023
b09928d
[FLINK-33219][connector/kafka] Add new archunit violation messages in…
PatrickRen Oct 9, 2023
73f761f
[FLINK-33149][Connector/Kafka] Bump snappy-java from 1.1.8.3 to 1.1.10.5
dependabot[bot] Jun 15, 2023
b0f15f2
[FLINK-33231] [source] Properly evict offsetsToCommit cache on checkp…
tzulitai Oct 10, 2023
89343bb
[FLINK-33234][Connector/Kafka] Bump Guava to 32.1.2-jre
dependabot[bot] Oct 10, 2023
26ab532
[FLINK-33234][Connector/Kafka] Exclude bundled Guava versions from Ka…
MartijnVisser Oct 11, 2023
e9d3089
[FLINK-33191][Connector/Kafka] Remove dependency on Flink Shaded
MartijnVisser Oct 9, 2023
bd260f1
[FLINK-33191][Connector/Kafka] Make the `testKafkaValueDeserializatio…
MartijnVisser Oct 10, 2023
c829d7a
[FLINK-33238][Formats/Avro] Upgrade used AVRO version to 1.11.3. This…
MartijnVisser Oct 11, 2023
398054a
[hotfix] Update CI strategy. This closes #61
MartijnVisser Oct 16, 2023
37cbb83
[FLINK-30400][build] Stop bundling flink-connector-base. This closes #50
ruanhang1993 Oct 16, 2023
946df1e
[FLINK-28303] Support LatestOffsetsInitializer to avoid latest-offset…
Sep 26, 2023
54e3b70
[FLINK-28303] Allow LATEST_OFFSET marker when restoring from old chec…
tzulitai Oct 23, 2023
40da49e
[hotfix] Test connector against Flink 1.18.0 and Flink 1.19-SNAPSHOT
MartijnVisser Oct 25, 2023
b732ce3
[hotfix] Partially revert 40da49e73b956b1a6fa0c1351b695b520c91919e an…
MartijnVisser Oct 25, 2023
979791c
[hotfix] refer to sql_connector_download_table shortcode in the docs …
mas-chen Oct 30, 2023
c38a040
[FLINK-33559] Externalize Kafka Python connector code
pvary Dec 11, 2023
825052f
[FLINK-33361][connectors/kafka] Add Java 17 compatibility to Flink Ka…
snuyanzin Dec 11, 2023
eaeb781
[FLINK-32416] initial implementation of DynamicKafkaSource with bound…
mas-chen Aug 9, 2023
cdfa328
[FLINK-32416] Fix flaky tests by ensuring test utilities produce reco…
mas-chen Jan 17, 2024
d3bda90
[hotfix] Synchronize CI pipeline setup. This closes #78
MartijnVisser Jan 18, 2024
8d53189
[FLINK-33329] Bump org.apache.commons:commons-compress from 1.22 to 1…
dependabot[bot] Jan 18, 2024
6f06f15
[FLINK-34154] Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2…
dependabot[bot] Jan 19, 2024
4f30099
[FLINK-32417] Add DynamicKafkaSource documentation for setter methods…
mas-chen Jan 25, 2024
fd7b46c
[release] Update weekly CI to check against new release branch `v3.1`
MartijnVisser Jan 26, 2024
68ac980
[hotfix] Remove weekly test against 1.19-SNAPSHOT since that's curren…
MartijnVisser Jan 26, 2024
a468c2b
[hotfix] Add missing JDK17 test for 1.18 against v3.1
MartijnVisser Jan 26, 2024
624f0a1
[hotfix] Update copyright year to 2024
MartijnVisser Jan 26, 2024
abf4563
[hotfix] Update copyright year to 2024 (#82)
ruanhang1993 Jan 30, 2024
ab356b4
[hotfix] Make the upsert-kafka artifacts point to the regular kafka a…
MartijnVisser Feb 7, 2024
6d0ffcd
[hotfix] Update shortcode in Kafka Datastream documentation so that t…
MartijnVisser Feb 7, 2024
cfb275b
[FLINK-34244] Update Confluent Platform to 7.4.4. This closes #81
MartijnVisser Feb 9, 2024
b8328ab
[FLINK-34192] Update to be compatible with updated SinkV2 interfaces
Jiabao-Sun Feb 8, 2024
2606a82
[FLINK-34193] Remove usage of Flink-Shaded Jackson and Snakeyaml in f…
Jiabao-Sun Feb 8, 2024
489dd7b
[hotfix] Test against Flink 1.19-SNAPSHOT for `main` and Weekly builds
MartijnVisser Feb 13, 2024
15f2662
[hotfix] Add JDK21 for 1.19-SNAPSHOT
MartijnVisser Feb 13, 2024
897001d
[FLINK-35007] Add support for Flink 1.19 (#90)
MartijnVisser Apr 11, 2024
2f5e3cf
[hotfix] Add Java 21 as JDK to test for Flink 1.19.0 weekly runs
MartijnVisser Apr 11, 2024
c47abb3
[FLINK-34961] Use dedicated CI name for Kafka connector to differenti…
snuyanzin Apr 11, 2024
1c39e3b
[FLINK-35008] Bump org.apache.commons:commons-compress from 1.25.0 to…
dependabot[bot] Apr 11, 2024
369e7be
[FLINK-35038] Bump `org.yaml:snakeyaml` to `2.2` (#93)
uce Apr 11, 2024
00c9c8c
[FLINK-35228][Connectors/Kafka] Fix: DynamicKafkaSource does not read…
IgnasD Apr 29, 2024
15d3fbd
[FLINK-35138][Connectors/Kafka] Bump development version to 3.3-SNAPSHOT
dannycranmer Jun 7, 2024
4429b78
[FLINK-35749] Kafka sink component will lose data when kafka cluster …
JimmyZZZ Jul 11, 2024
86f796a
[FLINK-35808] Let `ConsumerConfig.(KEY|VALUE)_DESERIALIZER_CLASS_CONF…
klam-shop Jul 18, 2024
b5b8076
[FLINK-36083][docs] Fix kafka table api doc's Connector Options table…
GOODBOY008 Aug 21, 2024
ea3a641
[FLINK-33201][Connectors/Kafka] Fix memory leak in CachingTopicSelector
qbx2 Sep 21, 2023
020bc33
[FLINK-35886] Leave a note for future Flink 2.0 upgrade
pnowojski Aug 29, 2024
268f6b5
[FLINK-36176] Remove support for Kafka 0.1 (#115)
AHeise Aug 30, 2024
3730005
[FLINK-22748] Allow dynamic target topic selection in SQL Kafka sinks…
klam-shop Sep 6, 2024
7929b16
[FLINK-36210] Optimize the logic for fetching topic metadata in the T…
xiaochen-zhou Sep 12, 2024
122a743
[FLINK-34470][Connectors/Kafka] Fix indefinite blocking by adjusting …
dongwoo6kim Sep 17, 2024
52e7e58
[FLINK-36209] Remove redundant operations in the initialization of Ka…
xiaochen-zhou Sep 19, 2024
c0be7d5
[FLINK-36278] Reduce log size by avoiding container logs by default
AHeise Sep 13, 2024
2f86484
[FLINK-36278] Decrease log levels for hotpath logs
AHeise Sep 17, 2024
ec8d7c2
[FLINK-36278] Reduce Kafka log level
AHeise Sep 17, 2024
1b02ce8
[FLINK-36278] Reduce Flink log levels
AHeise Sep 19, 2024
2ee9b9a
[hotfix] Remove unused test dependencies
AHeise Sep 19, 2024
9b97c51
[hotfix] Fix FlinkKafkaConsumerBaseTest.testClosePartitionDiscovererW…
AHeise Sep 19, 2024
21d07b7
[FLINK-36177] Deprecate KafkaShuffle and more
AHeise Sep 26, 2024
157813e
[FLINK-36177] Introduce KafkaPartitioner to replace FlinkKafkaPartiti…
AHeise Sep 27, 2024
a87bf72
[FLINK-35138][Connectors/Kafka] Drop support for Flink 1.17
dannycranmer Apr 22, 2024
ac8fa12
[FLINK-36422][docs] Fix PyFlink jar download link
z3d1k Oct 3, 2024
3fbb68d
[FLINK-36420][Connectors/Kafka] Bump avro from 1.11.3 to 1.11.4
dannycranmer Oct 3, 2024
264ce8c
[hotfix] Copy Flink .editorconfig
AHeise Oct 8, 2024
a738104
[FLINK-36441] Show full stacktraces in tests for failures
AHeise Oct 2, 2024
ab333a4
[FLINK-36441] Ignore exceptions during test cleanup
AHeise Oct 2, 2024
8472d03
[FLINK-36441] Fix leak for non-transactional FlinkKafkaProducer.
AHeise Oct 8, 2024
28836c6
[FLINK-36441] Ensure producers are not leaked in tests
AHeise Oct 1, 2024
5eeafd6
[FLINK-36441] Fix KafkaWriterITCase#testIncreasingRecordBasedCounters
AHeise Oct 4, 2024
429fe0c
[FLINK-35109] Fix SmokeKafkaITCase for later java versions
AHeise Oct 9, 2024
aedc790
[FLINK-35109] Bump to Flink 1.19 and support Flink 1.20
AHeise Sep 30, 2024
7f1ac6d
[hotfix] Add maven wrapper
AHeise Oct 10, 2024
6dc74db
Addressing Chesnay's feedback
AHeise Oct 10, 2024
c2e11a6
[FLINK-35109] Update version to 3.4-SNAPSHOT
AHeise Oct 10, 2024
2dfdae6
[FLINK-34467] bump flink version to 1.20.0 (#111)
HuangZhenQiu Oct 14, 2024
0fed445
[FLINK-35109] Updating build configurations for v3.3
AHeise Oct 14, 2024
727327d
[FLINK-34466] Lineage interfaces for kafka connector (#130)
pawel-big-lebowski Nov 14, 2024
59baacc
[FLINK-35109] Update weekly CI to verify 3.4 release branch
AHeise Nov 25, 2024
f6a077a
[FLINK-36780] Kafka source disable partition discovery unexpectedly (…
liuml07 Dec 3, 2024
20809da
[hotfix] Remote dead code
AHeise Feb 7, 2025
8bb953d
[FLINK-37281] Refactor KafkaSinkITCase
AHeise Feb 7, 2025
ee3d713
[FLINK-37281] Improve extensibility in KafkaWriterTestBase
AHeise Feb 7, 2025
707ec4c
[FLINK-37281] Fix KafkaUtil#checkProducerLeak
AHeise Feb 11, 2025
5947f3c
[FLINK-37282] Introduce internal package to sink
AHeise Feb 7, 2025
2e652a9
[hotfix] Fix leaks in FlinkKafkaProducerTest
AHeise Feb 16, 2025
df353e9
[FLINK-37282] Split KafkaWriter into EOS/non-EOS
AHeise Feb 10, 2025
db07aa6
[FLINK-37282] Add Backchannel
AHeise Feb 10, 2025
580d3ed
[FLINK-37282] Add ProducerPool
AHeise Feb 10, 2025
d3c3546
[FLINK-37282] Force colocation of kafka writer and kafka committer.
AHeise Feb 18, 2025
f4015d1
[FLINK-37282] Incorporate Backchannel and ProducerPool into EOSWriter
AHeise Feb 7, 2025
a52f15a
[FLINK-33265] Support source parallelism setting for Kafka connector
X-czh Nov 16, 2024
718621e
[FLINK-37380] Change TransactionalIdPrefix to a required option if Ex…
loserwang1024 Feb 27, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
275 changes: 275 additions & 0 deletions .editorconfig
Original file line number Diff line number Diff line change
@@ -0,0 +1,275 @@
root = true

[*]
charset = utf-8
end_of_line = lf
insert_final_newline = true
max_line_length = 100
# ij_formatter_off_tag = @formatter:off
# ij_formatter_on_tag = @formatter:on
# ij_formatter_tags_enabled = false
# ij_smart_tabs = false
# ij_wrap_on_typing = false

[*.java]
indent_size = 4
indent_style = space
tab_width = 4
ij_continuation_indent_size = 8
# ij_java_align_consecutive_assignments = false
# ij_java_align_consecutive_variable_declarations = false
# ij_java_align_group_field_declarations = false
# ij_java_align_multiline_annotation_parameters = false
# ij_java_align_multiline_array_initializer_expression = false
# ij_java_align_multiline_assignment = false
# ij_java_align_multiline_binary_operation = false
# ij_java_align_multiline_chained_methods = false
# ij_java_align_multiline_extends_list = false
# ij_java_align_multiline_for = true
# ij_java_align_multiline_method_parentheses = false
# ij_java_align_multiline_parameters = true
# ij_java_align_multiline_parameters_in_calls = false
# ij_java_align_multiline_parenthesized_expression = false
# ij_java_align_multiline_records = true
# ij_java_align_multiline_resources = true
# ij_java_align_multiline_ternary_operation = false
# ij_java_align_multiline_text_blocks = false
# ij_java_align_multiline_throws_list = false
# ij_java_align_subsequent_simple_methods = false
# ij_java_align_throws_keyword = false
# ij_java_annotation_parameter_wrap = off
# ij_java_array_initializer_new_line_after_left_brace = false
# ij_java_array_initializer_right_brace_on_new_line = false
# ij_java_array_initializer_wrap = off
# ij_java_assert_statement_colon_on_next_line = false
# ij_java_assert_statement_wrap = off
# ij_java_assignment_wrap = off
ij_java_binary_operation_sign_on_next_line = true
ij_java_binary_operation_wrap = normal
# ij_java_blank_lines_after_anonymous_class_header = 0
# ij_java_blank_lines_after_class_header = 0
# ij_java_blank_lines_after_imports = 1
# ij_java_blank_lines_after_package = 1
# ij_java_blank_lines_around_class = 1
# ij_java_blank_lines_around_field = 0
# ij_java_blank_lines_around_field_in_interface = 0
# ij_java_blank_lines_around_initializer = 1
# ij_java_blank_lines_around_method = 1
# ij_java_blank_lines_around_method_in_interface = 1
# ij_java_blank_lines_before_class_end = 0
# ij_java_blank_lines_before_imports = 1
# ij_java_blank_lines_before_method_body = 0
# ij_java_blank_lines_before_package = 0
# ij_java_block_brace_style = end_of_line
# ij_java_block_comment_at_first_column = true
ij_java_call_parameters_new_line_after_left_paren = true
# ij_java_call_parameters_right_paren_on_new_line = false
ij_java_call_parameters_wrap = on_every_item
# ij_java_case_statement_on_separate_line = true
# ij_java_catch_on_new_line = false
# ij_java_class_annotation_wrap = split_into_lines
# ij_java_class_brace_style = end_of_line
ij_java_class_count_to_use_import_on_demand = 9999
# ij_java_class_names_in_javadoc = 1
# ij_java_do_not_indent_top_level_class_members = false
# ij_java_do_not_wrap_after_single_annotation = false
# ij_java_do_while_brace_force = never
# ij_java_doc_add_blank_line_after_description = true
ij_java_doc_add_blank_line_after_param_comments = true
ij_java_doc_add_blank_line_after_return = true
# ij_java_doc_add_p_tag_on_empty_lines = true
ij_java_doc_align_exception_comments = false
ij_java_doc_align_param_comments = false
ij_java_doc_do_not_wrap_if_one_line = true
ij_java_doc_enable_formatting = true
# ij_java_doc_enable_leading_asterisks = true
ij_java_doc_indent_on_continuation = true
ij_java_doc_keep_empty_lines = true
# ij_java_doc_keep_empty_parameter_tag = true
# ij_java_doc_keep_empty_return_tag = true
# ij_java_doc_keep_empty_throws_tag = true
# ij_java_doc_keep_invalid_tags = true
# ij_java_doc_param_description_on_new_line = false
ij_java_doc_preserve_line_breaks = false
# ij_java_doc_use_throws_not_exception_tag = true
# ij_java_else_on_new_line = false
# ij_java_entity_dd_suffix = EJB
# ij_java_entity_eb_suffix = Bean
# ij_java_entity_hi_suffix = Home
# ij_java_entity_lhi_prefix = Local
# ij_java_entity_lhi_suffix = Home
# ij_java_entity_li_prefix = Local
# ij_java_entity_pk_class = java.lang.String
# ij_java_entity_vo_suffix = VO
# ij_java_enum_constants_wrap = off
# ij_java_extends_keyword_wrap = off
# ij_java_extends_list_wrap = off
# ij_java_field_annotation_wrap = split_into_lines
# ij_java_finally_on_new_line = false
# ij_java_for_brace_force = never
# ij_java_for_statement_new_line_after_left_paren = false
# ij_java_for_statement_right_paren_on_new_line = false
# ij_java_for_statement_wrap = off
# ij_java_generate_final_locals = false
# ij_java_generate_final_parameters = false
# ij_java_if_brace_force = never
ij_java_imports_layout = org.apache.flink.**,|,org.apache.flink.shaded.**,|,*,|,javax.**,|,java.**,|,scala.**,|,$*
# ij_java_indent_case_from_switch = true
# ij_java_insert_inner_class_imports = false
# ij_java_insert_override_annotation = true
# ij_java_keep_blank_lines_before_right_brace = 2
# ij_java_keep_blank_lines_between_package_declaration_and_header = 2
# ij_java_keep_blank_lines_in_code = 2
# ij_java_keep_blank_lines_in_declarations = 2
# ij_java_keep_control_statement_in_one_line = true
# ij_java_keep_first_column_comment = true
# ij_java_keep_indents_on_empty_lines = false
# ij_java_keep_line_breaks = true
# ij_java_keep_multiple_expressions_in_one_line = false
# ij_java_keep_simple_blocks_in_one_line = false
# ij_java_keep_simple_classes_in_one_line = false
# ij_java_keep_simple_lambdas_in_one_line = false
# ij_java_keep_simple_methods_in_one_line = false
# ij_java_label_indent_absolute = false
# ij_java_label_indent_size = 0
# ij_java_lambda_brace_style = end_of_line
ij_java_layout_static_imports_separately = true
# ij_java_line_comment_add_space = false
# ij_java_line_comment_at_first_column = true
# ij_java_message_dd_suffix = EJB
# ij_java_message_eb_suffix = Bean
# ij_java_method_annotation_wrap = split_into_lines
# ij_java_method_brace_style = end_of_line
ij_java_method_call_chain_wrap = on_every_item
ij_java_method_parameters_new_line_after_left_paren = true
# ij_java_method_parameters_right_paren_on_new_line = false
ij_java_method_parameters_wrap = on_every_item
# ij_java_modifier_list_wrap = false
ij_java_names_count_to_use_import_on_demand = 9999
# ij_java_new_line_after_lparen_in_record_header = false
# ij_java_packages_to_use_import_on_demand = java.awt.*,javax.swing.*
# ij_java_parameter_annotation_wrap = off
# ij_java_parentheses_expression_new_line_after_left_paren = false
# ij_java_parentheses_expression_right_paren_on_new_line = false
# ij_java_place_assignment_sign_on_next_line = false
# ij_java_prefer_longer_names = true
# ij_java_prefer_parameters_wrap = false
# ij_java_record_components_wrap = normal
# ij_java_repeat_synchronized = true
# ij_java_replace_instanceof_and_cast = false
# ij_java_replace_null_check = true
# ij_java_replace_sum_lambda_with_method_ref = true
# ij_java_resource_list_new_line_after_left_paren = false
# ij_java_resource_list_right_paren_on_new_line = false
# ij_java_resource_list_wrap = off
# ij_java_rparen_on_new_line_in_record_header = false
# ij_java_session_dd_suffix = EJB
# ij_java_session_eb_suffix = Bean
# ij_java_session_hi_suffix = Home
# ij_java_session_lhi_prefix = Local
# ij_java_session_lhi_suffix = Home
# ij_java_session_li_prefix = Local
# ij_java_session_si_suffix = Service
# ij_java_space_after_closing_angle_bracket_in_type_argument = false
# ij_java_space_after_colon = true
# ij_java_space_after_comma = true
# ij_java_space_after_comma_in_type_arguments = true
# ij_java_space_after_for_semicolon = true
# ij_java_space_after_quest = true
# ij_java_space_after_type_cast = true
# ij_java_space_before_annotation_array_initializer_left_brace = false
# ij_java_space_before_annotation_parameter_list = false
# ij_java_space_before_array_initializer_left_brace = false
# ij_java_space_before_catch_keyword = true
# ij_java_space_before_catch_left_brace = true
# ij_java_space_before_catch_parentheses = true
# ij_java_space_before_class_left_brace = true
# ij_java_space_before_colon = true
# ij_java_space_before_colon_in_foreach = true
# ij_java_space_before_comma = false
# ij_java_space_before_do_left_brace = true
# ij_java_space_before_else_keyword = true
# ij_java_space_before_else_left_brace = true
# ij_java_space_before_finally_keyword = true
# ij_java_space_before_finally_left_brace = true
# ij_java_space_before_for_left_brace = true
# ij_java_space_before_for_parentheses = true
# ij_java_space_before_for_semicolon = false
# ij_java_space_before_if_left_brace = true
# ij_java_space_before_if_parentheses = true
# ij_java_space_before_method_call_parentheses = false
# ij_java_space_before_method_left_brace = true
# ij_java_space_before_method_parentheses = false
# ij_java_space_before_opening_angle_bracket_in_type_parameter = false
# ij_java_space_before_quest = true
# ij_java_space_before_switch_left_brace = true
# ij_java_space_before_switch_parentheses = true
# ij_java_space_before_synchronized_left_brace = true
# ij_java_space_before_synchronized_parentheses = true
# ij_java_space_before_try_left_brace = true
# ij_java_space_before_try_parentheses = true
# ij_java_space_before_type_parameter_list = false
# ij_java_space_before_while_keyword = true
# ij_java_space_before_while_left_brace = true
# ij_java_space_before_while_parentheses = true
# ij_java_space_inside_one_line_enum_braces = false
# ij_java_space_within_empty_array_initializer_braces = false
# ij_java_space_within_empty_method_call_parentheses = false
# ij_java_space_within_empty_method_parentheses = false
# ij_java_spaces_around_additive_operators = true
# ij_java_spaces_around_assignment_operators = true
# ij_java_spaces_around_bitwise_operators = true
# ij_java_spaces_around_equality_operators = true
# ij_java_spaces_around_lambda_arrow = true
# ij_java_spaces_around_logical_operators = true
# ij_java_spaces_around_method_ref_dbl_colon = false
# ij_java_spaces_around_multiplicative_operators = true
# ij_java_spaces_around_relational_operators = true
# ij_java_spaces_around_shift_operators = true
# ij_java_spaces_around_type_bounds_in_type_parameters = true
# ij_java_spaces_around_unary_operator = false
# ij_java_spaces_within_angle_brackets = false
# ij_java_spaces_within_annotation_parentheses = false
# ij_java_spaces_within_array_initializer_braces = false
# ij_java_spaces_within_braces = false
# ij_java_spaces_within_brackets = false
# ij_java_spaces_within_cast_parentheses = false
# ij_java_spaces_within_catch_parentheses = false
# ij_java_spaces_within_for_parentheses = false
# ij_java_spaces_within_if_parentheses = false
# ij_java_spaces_within_method_call_parentheses = false
# ij_java_spaces_within_method_parentheses = false
# ij_java_spaces_within_parentheses = false
# ij_java_spaces_within_switch_parentheses = false
# ij_java_spaces_within_synchronized_parentheses = false
# ij_java_spaces_within_try_parentheses = false
# ij_java_spaces_within_while_parentheses = false
# ij_java_special_else_if_treatment = true
# ij_java_subclass_name_suffix = Impl
# ij_java_ternary_operation_signs_on_next_line = false
# ij_java_ternary_operation_wrap = off
# ij_java_test_name_suffix = Test
# ij_java_throws_keyword_wrap = off
# ij_java_throws_list_wrap = off
# ij_java_use_external_annotations = false
# ij_java_use_fq_class_names = false
# ij_java_use_relative_indents = false
# ij_java_use_single_class_imports = true
ij_java_variable_annotation_wrap = normal
# ij_java_visibility = public
# ij_java_while_brace_force = never
# ij_java_while_on_new_line = false
# ij_java_wrap_comments = false
ij_java_wrap_first_method_in_call_chain = true
# ij_java_wrap_long_lines = false

[*.out]
insert_final_newline = false

[*.xml]
indent_style = tab
indent_size = 4

[*.py]
indent_style = space
indent_size = 4
19 changes: 17 additions & 2 deletions .github/workflows/push_pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,13 +16,28 @@
# limitations under the License.
################################################################################

name: CI
# We need to specify repo related information here since Apache INFRA doesn't differentiate
# between several workflows with the same names while preparing a report for GHA usage
# https://infra-reports.apache.org/#ghactions
name: Flink Connector Kafka CI
on: [push, pull_request]
concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true
jobs:
compile_and_test:
strategy:
matrix:
flink: [ 1.20.0 ]
jdk: [ '8, 11, 17, 21' ]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: 1.17-SNAPSHOT
flink_version: ${{ matrix.flink }}
jdk_version: ${{ matrix.jdk }}
python_test:
strategy:
matrix:
flink: [ 1.20.0 ]
uses: apache/flink-connector-shared-utils/.github/workflows/python_ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
23 changes: 20 additions & 3 deletions .github/workflows/weekly.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,10 @@
# limitations under the License.
################################################################################

name: Nightly
# We need to specify repo related information here since Apache INFRA doesn't differentiate
# between several workflows with the same names while preparing a report for GHA usage
# https://infra-reports.apache.org/#ghactions
name: Weekly Flink Connector Kafka CI
on:
schedule:
- cron: "0 0 * * 0"
Expand All @@ -26,8 +29,22 @@ jobs:
if: github.repository_owner == 'apache'
strategy:
matrix:
flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
flink_branches: [{
flink: 1.20-SNAPSHOT,
branch: main
}, {
flink: 1.19.1,
branch: v3.3
}, {
flink: 1.20.0,
branch: v3.3
}, {
flink: 1.20.0,
branch: v3.4
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
flink_version: ${{ matrix.flink_branches.flink }}
connector_branch: ${{ matrix.flink_branches.branch }}
jdk_version: ${{ matrix.flink_branches.jdk || '8, 11, 17, 21' }}
run_dependency_convergence: false
19 changes: 18 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -35,4 +35,21 @@ out/
tools/flink
tools/flink-*
tools/releasing/release
tools/japicmp-output
tools/japicmp-output

# Generated file, do not store in git
flink-connector-kafka/.idea
flink-python/pyflink/datastream/connectors/kafka_connector_version.py
flink-python/apache_flink_connectors_kafka.egg-info/
flink-python/.tox/
flink-python/build
flink-python/dist
flink-python/dev/download
flink-python/dev/.conda/
flink-python/dev/log/
flink-python/dev/.stage.txt
flink-python/dev/install_command.sh
flink-python/dev/lint-python.sh
flink-python/dev/build-wheels.sh
flink-python/dev/glibc_version_fix.h
flink-python/dev/dev-requirements.txt
1 change: 1 addition & 0 deletions .idea/vcs.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading