Skip to content

Dataflow Templates 2022-12-13-00_RC01

Compare
Choose a tag to compare
@bvolpato bvolpato released this 14 Dec 00:45
· 3457 commits to main since this release

Release Week of 2022-12-13

Note: This release is in the process of rolling out. It may not be in your region yet.

Improvements

  • [BigQuery] Add support to Storage Write API to several templates interacting with BigQuery.
  • [DatastreamToSpanner] Support Postgres as a source
  • [Integration Tests] Added several integration / end-to-end tests and resource managers
  • [PubsubAvroToBigQuery] Upgrade PubsubAvroToBigQuery template to support Storage Write API.
  • [Security] Bump dependencies as a response to CVEs
  • [Templates Plugin] Several improvements to metadata annotations and templates plugin

Bug Fixes

  • [All Templates] Add imperative version for Jackson/FasterXML to match Beam 2.43.0
  • [Changestreams] Fix WriteDataChangeRecordsToAvroTest serialization issue
  • [Flex Templates] Make classpath deterministic for Flex Template executions, by always making sure that Conscrypt is loaded first.

Contributors

@Harwayne
@bvolpato
@oleg-semenov
@pranavbhandari24