v1.47.1

1.47.1 (2025-04-16)

Bug Fixes

• jobsdb payload limit used compressed column sizes instead of actual payload length (#5723) (966b8dd)
• version downgrade for databricks-sql-go to 1.6.1 (#5741) (09f2615)

Miscellaneous

• granular configuration for adaptive rate limiting (#5739) (5e6eb81)

v1.47.0

1.47.0 (2025-04-14)

Features

• add a common package for validation (#5579) (f2cee9d)
• add support for table size metadata in warehouse /v1/process API (#5705) (cbebd23)
• add tracer support to partition and pipeline workers (#5668) (a38b4f5)
• add upload_id column in wh_load_files table (#5682) (9def123)
• embedded google pubsub transformer (#5525) (dcdb681)
• embedded kafka transformer (#5575) (224228b)
• jobsdb: introduce jobMinRowsLeftMigrateThres (#5704) (b1f4ce0)
• processor: concurrent store steps (#5687) (2435cba)
• support compacted destination transformation payloads (#5667) (15ccaac)

Bug Fixes

• handle consent management filtering per connection (#5718) (69f1baf)
• handling isBlank for nested and empty arrays (#5714) (69f1baf)
• kafka message batching applies to Confluent Cloud and Azure Event Hub (#5699) (7d8cdb9)
• router: applying excessive read pressure to the database when jobs are being throttled (#5685) (f0e8b75)
• snowflake fetch schema privileges (#5692) (0b83028)
• unmarshalling error for staging files without bytes per table (#5725) (8c35d0a)
• warehouse transformations comparisions (#5694) (0b83028)
• warehouse transformations concurrent writes (#5724) (68e6309)
• warehouse transformations ordering for comparison (#5670) (28ba26e)
• warehouse transformations ordering while processing properties (#5713) (69f1baf)
• warehouse transformations valid timestamp formats and log file path (#5707) (69f1baf)

Miscellaneous

• add sourceDef field to stats and related structures for enhanced observability (#5660) (632bfca)
• avoid using reflections for warehouse transformations (#5673) (3290794)
• clean up tests because transformer defaults to v2 (#5712) (e9b96cf)
• datetime detection (#5675) (1c53807)
• default webhook contract version to v2 (#5659) (7dbf5d8)
• deps: bump beatlabs/delete-old-branches-action from 0.0.10 to 0.0.11 (#5620) (451c593)
• deps: bump google.golang.org/api from 0.227.0 to 0.228.0 in the frequent group (#5708) (cbce33a)
• deps: bump the frequent group across 1 directory with 3 updates (#5702) (00a1bc5)
• deps: bump the go-deps group across 1 directory with 12 updates (#5698) (4c3e4ff)
• deps: bump the go-deps group with 2 updates (#5701) (27c71e6)
• deps: bump the go-deps group with 2 updates (#5709) (1335fa6)
• deps: bump the go-deps group with 2 updates (#5719) (d3ab3e6)
• remove explicit schema synchronization in upload job (#5672) (462db8a)
• remove unused schema v1 code (#5661) (3290794)
• snowflake integrations tests to use keypair instead of password (#5684) (3ed7a11)

v1.47.0-rc.3

1.47.0-rc.3 (2025-04-15)

Features

• add a common package for validation (#5579) (f2cee9d)
• add support for table size metadata in warehouse /v1/process API (#5705) (cbebd23)
• add tracer support to partition and pipeline workers (#5668) (a38b4f5)
• add upload_id column in wh_load_files table (#5682) (9def123)
• embedded google pubsub transformer (#5525) (dcdb681)
• embedded kafka transformer (#5575) (224228b)
• jobsdb: introduce jobMinRowsLeftMigrateThres (#5704) (b1f4ce0)
• processor: concurrent store steps (#5687) (2435cba)
• support compacted destination transformation payloads (#5667) (15ccaac)

Bug Fixes

• handle consent management filtering per connection (#5718) (69f1baf)
• handling isBlank for nested and empty arrays (#5714) (69f1baf)
• kafka message batching applies to Confluent Cloud and Azure Event Hub (#5699) (7d8cdb9)
• router: applying excessive read pressure to the database when jobs are being throttled (#5685) (f0e8b75)
• snowflake fetch schema privileges (#5692) (0b83028)
• unmarshalling error for staging files without bytes per table (#5725) (8c35d0a)
• warehouse transformations comparisions (#5694) (0b83028)
• warehouse transformations concurrent writes (#5724) (68e6309)
• warehouse transformations ordering for comparison (#5670) (28ba26e)
• warehouse transformations ordering while processing properties (#5713) (69f1baf)
• warehouse transformations valid timestamp formats and log file path (#5707) (69f1baf)

Miscellaneous

• add sourceDef field to stats and related structures for enhanced observability (#5660) (632bfca)
• avoid using reflections for warehouse transformations (#5673) (3290794)
• clean up tests because transformer defaults to v2 (#5712) (e9b96cf)
• datetime detection (#5675) (1c53807)
• default webhook contract version to v2 (#5659) (7dbf5d8)
• deps: bump beatlabs/delete-old-branches-action from 0.0.10 to 0.0.11 (#5620) (451c593)
• deps: bump google.golang.org/api from 0.227.0 to 0.228.0 in the frequent group (#5708) (cbce33a)
• deps: bump the frequent group across 1 directory with 3 updates (#5702) (00a1bc5)
• deps: bump the go-deps group across 1 directory with 12 updates (#5698) (4c3e4ff)
• deps: bump the go-deps group with 2 updates (#5701) (27c71e6)
• deps: bump the go-deps group with 2 updates (#5709) (1335fa6)
• deps: bump the go-deps group with 2 updates (#5719) (d3ab3e6)
• remove explicit schema synchronization in upload job (#5672) (462db8a)
• remove unused schema v1 code (#5661) (3290794)
• snowflake integrations tests to use keypair instead of password (#5684) (3ed7a11)

v1.47.0-rc.2

1.47.0-rc.2 (2025-04-14)

Features

• add a common package for validation (#5579) (f2cee9d)
• add support for table size metadata in warehouse /v1/process API (#5705) (cbebd23)
• add tracer support to partition and pipeline workers (#5668) (a38b4f5)
• add upload_id column in wh_load_files table (#5682) (9def123)
• embedded google pubsub transformer (#5525) (dcdb681)
• embedded kafka transformer (#5575) (224228b)
• jobsdb: introduce jobMinRowsLeftMigrateThres (#5704) (b1f4ce0)
• processor: concurrent store steps (#5687) (2435cba)
• support compacted destination transformation payloads (#5667) (15ccaac)

Bug Fixes

• handle consent management filtering per connection (#5718) (69f1baf)
• handling isBlank for nested and empty arrays (#5714) (69f1baf)
• kafka message batching applies to Confluent Cloud and Azure Event Hub (#5699) (7d8cdb9)
• router: applying excessive read pressure to the database when jobs are being throttled (#5685) (f0e8b75)
• snowflake fetch schema privileges (#5692) (0b83028)
• unmarshalling error for staging files without bytes per table (#5725) (8c35d0a)
• warehouse transformations comparisions (#5694) (0b83028)
• warehouse transformations ordering for comparison (#5670) (28ba26e)
• warehouse transformations ordering while processing properties (#5713) (69f1baf)
• warehouse transformations valid timestamp formats and log file path (#5707) (69f1baf)

Miscellaneous

• add sourceDef field to stats and related structures for enhanced observability (#5660) (632bfca)
• avoid using reflections for warehouse transformations (#5673) (3290794)
• clean up tests because transformer defaults to v2 (#5712) (e9b96cf)
• datetime detection (#5675) (1c53807)
• default webhook contract version to v2 (#5659) (7dbf5d8)
• deps: bump beatlabs/delete-old-branches-action from 0.0.10 to 0.0.11 (#5620) (451c593)
• deps: bump google.golang.org/api from 0.227.0 to 0.228.0 in the frequent group (#5708) (cbce33a)
• deps: bump the frequent group across 1 directory with 3 updates (#5702) (00a1bc5)
• deps: bump the go-deps group across 1 directory with 12 updates (#5698) (4c3e4ff)
• deps: bump the go-deps group with 2 updates (#5701) (27c71e6)
• deps: bump the go-deps group with 2 updates (#5709) (1335fa6)
• deps: bump the go-deps group with 2 updates (#5719) (d3ab3e6)
• remove explicit schema synchronization in upload job (#5672) (462db8a)
• remove unused schema v1 code (#5661) (3290794)
• snowflake integrations tests to use keypair instead of password (#5684) (3ed7a11)

v1.47.0-rc.1

1.47.0-rc.1 (2025-04-14)

Features

• add a common package for validation (#5579) (f2cee9d)
• add support for table size metadata in warehouse /v1/process API (#5705) (cbebd23)
• add tracer support to partition and pipeline workers (#5668) (a38b4f5)
• add upload_id column in wh_load_files table (#5682) (9def123)
• embedded google pubsub transformer (#5525) (dcdb681)
• embedded kafka transformer (#5575) (224228b)
• jobsdb: introduce jobMinRowsLeftMigrateThres (#5704) (b1f4ce0)
• processor: concurrent store steps (#5687) (2435cba)
• support compacted destination transformation payloads (#5667) (15ccaac)

Bug Fixes

• handle consent management filtering per connection (#5718) (69f1baf)
• handling isBlank for nested and empty arrays (#5714) (69f1baf)
• kafka message batching applies to Confluent Cloud and Azure Event Hub (#5699) (7d8cdb9)
• router: applying excessive read pressure to the database when jobs are being throttled (#5685) (69f1baf)
• router: applying excessive read pressure to the database when jobs are being throttled (#5685) (0b83028)
• router: applying excessive read pressure to the database when jobs are being throttled (#5685) (f0e8b75)
• snowflake fetch schema privileges (#5692) (69f1baf)
• snowflake fetch schema privileges (#5692) (0b83028)
• warehouse transformations comparisions (#5694) (69f1baf)
• warehouse transformations comparisions (#5694) (0b83028)
• warehouse transformations ordering for comparison (#5670) (28ba26e)
• warehouse transformations ordering while processing properties (#5713) (69f1baf)
• warehouse transformations valid timestamp formats and log file path (#5707) (69f1baf)

Miscellaneous

• add sourceDef field to stats and related structures for enhanced observability (#5660) (632bfca)
• avoid using reflections for warehouse transformations (#5673) (3290794)
• clean up tests because transformer defaults to v2 (#5712) (e9b96cf)
• datetime detection (#5675) (1c53807)
• default webhook contract version to v2 (#5659) (7dbf5d8)
• deps: bump beatlabs/delete-old-branches-action from 0.0.10 to 0.0.11 (#5620) (451c593)
• deps: bump google.golang.org/api from 0.227.0 to 0.228.0 in the frequent group (#5708) (cbce33a)
• deps: bump the frequent group across 1 directory with 3 updates (#5702) (00a1bc5)
• deps: bump the go-deps group across 1 directory with 12 updates (#5698) (4c3e4ff)
• deps: bump the go-deps group with 2 updates (#5701) (27c71e6)
• deps: bump the go-deps group with 2 updates (#5709) (1335fa6)
• deps: bump the go-deps group with 2 updates (#5719) (d3ab3e6)
• remove explicit schema synchronization in upload job (#5672) (462db8a)
• remove unused schema v1 code (#5661) (3290794)
• snowflake integrations tests to use keypair instead of password (#5684) (3ed7a11)

v1.46.3

1.46.3 (2025-04-11)

Bug Fixes

• handle consent management filtering per connection (#5718) (ef57ce6)
• handling isBlank for nested and empty arrays (#5714) (670bee0)
• warehouse transformations ordering while processing properties (#5713) (3298855)
• warehouse transformations valid timestamp formats and log file path (#5707) (8675302)

Miscellaneous

• fix webhook tests in release branch (#5715) (090942d)

v1.46.2

1.46.2 (2025-04-07)

Bug Fixes

• snowflake fetch schema privileges (#5692) (2ef6133)
• warehouse transformations comparisions (#5694) (0539987)

v1.46.1

1.46.1 (2025-04-03)

Bug Fixes

• router: applying excessive read pressure to the database when jobs are being throttled (#5685) (58246cf)

v1.46.0

1.46.0 (2025-04-01)

Features

• introduce workers per partition in processor (#5607) (46d61b0)
• move async batch router destinations to use OAuth v2 flow (#5574) (3e35b23)
• option for disabling view creation for bigquery (#5630) (c804547)
• processor: break down transformations step (#5639) (379fcbd)
• processor: count pending events without blocking (#5605) (a41c63d)

Bug Fixes

• compilation error in events_test.go (#5671) (e3ead37)
• increased archival table count alert firing after starting using dslimit (#5649) (ff799d4)
• remove the noisy combination for version deprecation detection (#5629) (4516a40)
• sonnet panic while unmarshalling float64 types (#5616) (c1236e4)
• warehouse transformations for data_warehouse json paths (#5653) (2bbe140)
• warehouse transformations for mandatory fields (#5658) (5019422)
• warehouse transformations for tracking plans (#5662) (3692063)

Miscellaneous

• add limiter to pretransform (#5622) (57ba242)
• badger configuration tuning (#5634) (1936b98)
• bump sqlconnect-go to 1.18.1 (#5635) (f4d78bf)
• dedup service improvements (#5602) (2e7497e)
• deps: bump docker/login-action from 3.3.0 to 3.4.0 (#5604) (7e5cea3)
• deps: bump github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 in the go_modules group (#5643) (4510413)
• deps: bump golangci/golangci-lint-action from 6 to 7 (#5641) (1110b6a)
• deps: bump the go-deps group across 1 directory with 5 updates (#5633) (a5a8978)
• deps: bump the go-deps group across 1 directory with 5 updates (#5642) (89070bd)
• increase max idle connections per host for kinesis (#5652) (6fd8e7c)
• migrate sample event column to text for reporting (#5503) (7d6cbf9)
• optimise schema generation function (#5597) (f1818d0)
• recover from badgerdb panic (#5678) (9a47bbd)
• remove transformations v2 flag (#5650) (3182f9a)
• sync release v1.45.0 to main branch (#5617) (3669407)
• use rss for calculating used memory in adaptive payload limiter (#5656) (63ff163)
• use sonnet as the default json library (#5657) (4c6e5e0)
• version deprecation detection avoid regex (#5625) (0d0e7dd)
• version deprecation detection logic (#5644) (345162a)

v1.46.0-rc.2

1.46.0-rc.2 (2025-04-01)

Features

• introduce workers per partition in processor (#5607) (46d61b0)
• move async batch router destinations to use OAuth v2 flow (#5574) (3e35b23)
• option for disabling view creation for bigquery (#5630) (c804547)
• processor: break down transformations step (#5639) (379fcbd)
• processor: count pending events without blocking (#5605) (a41c63d)

Bug Fixes

• compilation error in events_test.go (#5671) (e3ead37)
• increased archival table count alert firing after starting using dslimit (#5649) (ff799d4)
• remove the noisy combination for version deprecation detection (#5629) (4516a40)
• sonnet panic while unmarshalling float64 types (#5616) (c1236e4)
• warehouse transformations for data_warehouse json paths (#5653) (2bbe140)
• warehouse transformations for mandatory fields (#5658) (5019422)
• warehouse transformations for tracking plans (#5662) (3692063)

Miscellaneous

• add limiter to pretransform (#5622) (57ba242)
• badger configuration tuning (#5634) (1936b98)
• bump sqlconnect-go to 1.18.1 (#5635) (f4d78bf)
• dedup service improvements (#5602) (2e7497e)
• deps: bump docker/login-action from 3.3.0 to 3.4.0 (#5604) (7e5cea3)
• deps: bump github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 in the go_modules group (#5643) (4510413)
• deps: bump golangci/golangci-lint-action from 6 to 7 (#5641) (1110b6a)
• deps: bump the go-deps group across 1 directory with 5 updates (#5633) (a5a8978)
• deps: bump the go-deps group across 1 directory with 5 updates (#5642) (89070bd)
• increase max idle connections per host for kinesis (#5652) (6fd8e7c)
• migrate sample event column to text for reporting (#5503) (7d6cbf9)
• optimise schema generation function (#5597) (f1818d0)
• recover from badgerdb panic (#5678) (9a47bbd)
• remove transformations v2 flag (#5650) (3182f9a)
• sync release v1.45.0 to main branch (#5617) (3669407)
• use rss for calculating used memory in adaptive payload limiter (#5656) (63ff163)
• use sonnet as the default json library (#5657) (4c6e5e0)
• version deprecation detection avoid regex (#5625) (0d0e7dd)
• version deprecation detection logic (#5644) (345162a)