·
17 commits
to master
since this release
Release 1.0.0.Beta1
Based on the provided changelog for Release 1.0.0.Beta1, here are the notable changes:
Notable Changes
- Variant Support:
icebergconsumer got a configuration option to store nested data to avariantfield. - Default Behavior Changes: The default consuming mode has been changed from
upserttoappend, and the default event format has been changed fromjsontoconnect. - Parallel Processing: Concurrent parallel processing of the tables is now enabled, which should improve performance.
- Iceberg and Debezium Upgrades: The project has been upgraded to Iceberg 1.10.0 and Debezium 3.3.0.Beta1
- Documentation: Added migration guides for incompatible type changes.
- Build Environment: The release target has been set to Java 21.
NOTE:
- Please be aware that these modifications may affect backward compatibility. Thorough testing is strongly recommended before deployment.
- Switching from the
jsonformat to theconnectformat may introduce differences in how data types are handled. This could potentially lead to processing failures or unexpected data representations. We strongly recommend thoroughly testing your pipelines after making this change. Also please see migration guideline - For new applications, we recommend starting with the
connectformat. It should be more performant and provide better data type support.
What's Changed
- Preserve required/optional field property when converting from source schema to Iceberg by @zilder in #575
- Fix IcebergSchemaHistory, dont delete history records by @ismailsimsek in #581
- Bump org.apache.iceberg:iceberg-bom from 1.8.1 to 1.9.1 by @dependabot[bot] in #579
- Bump io.debezium:debezium-build-parent from 3.1.1.Final to 3.1.2.Final by @dependabot[bot] in #578
- Bump version.debezium from 3.1.1.Final to 3.1.2.Final by @dependabot[bot] in #577
- Set release target to java 21 by @ismailsimsek in #582
- Bump org.testcontainers:testcontainers-bom from 1.21.0 to 1.21.1 by @dependabot[bot] in #576
- Connect, Use logicalTypeName to do precise value conversion by @ismailsimsek in #570
- Enforce non temporal(dynamic) precision mode by @ismailsimsek in #583
- Improve testing temporal type handling by @ismailsimsek in #585
- Fix JsonSchemaConverter dont increment filed ids for map key val by @ismailsimsek in #584
- Deprecate
icebergeventsconsumer now with Variant supporticebergconsumer is recommended instead by @ismailsimsek in #589 - Improvements documentation by @ismailsimsek in #590
- Add config to store nested data to variant field by @ismailsimsek in #587
- Fix deployment maven artifacts to github by @ismailsimsek in #588
- Change default consuming mode from
upserttoappendby @ismailsimsek in #591 - Change default event format from
jsontoconnectby @ismailsimsek in #592 - Add nessie catalog test as an example by @ismailsimsek in #593
- Improve namespace handling, don't fail if exists by @ismailsimsek in #595
- Testing, Replace jdbc catalog with nessie for better performance with testing by @ismailsimsek in #594
- Table destination mapper by @zilder in #599
- Fix class (org.apache.hadoop.mapreduce.lib.input.FileInputFormat) not found error with restart by @ismailsimsek in #606
- Enable concurent parallel processing by @ismailsimsek in #607
- docs: Add migration guide for incompatible type changes by @ismailsimsek in #612
- docs: Update migration guide for incompatible type changes by @ismailsimsek in #613
- Timestamp column in postgres is causing the debezium server to crash by @adasari in #621
- Consume nested fields to variant, And upgrade Iceberg to 1.10.0 by @ismailsimsek in #596
- Skip consuming heartbeat events by @ismailsimsek in #623
- Upgrade debezium to 3.3.x by @ismailsimsek in #622
- Bump org.codehaus.mojo:flatten-maven-plugin from 1.7.0 to 1.7.2 by @dependabot[bot] in #617
- Bump org.apache.iceberg:iceberg-nessie from 1.9.1 to 1.10.0 by @dependabot[bot] in #627
New Contributors
Full Changelog: 1.0.0.Alpha1...1.0.0.Beta1