Releases: datazip-inc/olake
Releases · datazip-inc/olake
v0.1.9
What's Changed
- fix: oracle incremental fallback cursor deletion handled correctly by @vaibhav-datazip in #418
- feat: mongo filter and multi cursor by @tanishaAtDatazip in #416
- chore: default normalization for relational db's by @tanishaAtDatazip in #333
- feat: incremental mysql by @tanishaAtDatazip in #399
- chore: update readme and remove unnecessary ports from docker-compose by @schitizsharma in #440
- feat: consistent batch size across all drivers by @vaibhav-datazip in #423
- chore: slack url change by @shubham19may in #445
- fix: olake generated timestamps spark version compatibility by @ImDoubD-datazip in #451
- feat: add incremental sync support for Postgres driver by @vaibhav-datazip in #430
- fix: readme changes by @ImDoubD-datazip in #432
- chore: staging -> master v0.1.9 by @hash-data in #433
Full Changelog: v0.1.8...v0.1.9
v0.1.8
What's Changed
- fix: MongoDB _id type string by @ImDoubD-datazip in #419
- fix: gcp using hive added by @ImDoubD-datazip in #420
- chore: readme update by @rkhameshra in #417
- chore: Staging -> Master v0.1.8 by @hash-data in #424
Full Changelog: v0.1.7...v0.1.8
v0.1.7
What's Changed
- feat: add MySQL binlog permissions check for CDC support by @hardikkum444 in #223
- feat: testcontainers integration by @ImDoubD-datazip in #356
- fix: multiple data types and writer panic by @hash-data in #411
- feat(parquet): add support for custom s3_endpoint in parquet writer config by @vikash390 in #412
- feat: add multi-cursor support for oracle incremental sync by @vaibhav-datazip in #403
- chore: staging -> master v0.1.7 by @hash-data in #407
New Contributors
- @hardikkum444 made their first contribution in #223
Full Changelog: v0.1.6...v0.1.7
v0.1.6
What's Changed
- chore: improve postgres cdc by @hash-data in #367
- feat: Filter Option introduced for all the drivers. by @ImDoubD-datazip in #340
- fix: credential parsing for postgres and mongodb by @vaibhav-datazip in #303
- feat: clear destination flag by @tanishaAtDatazip in #362
- feat: mongo Incremental by @tanishaAtDatazip in #385
- feat: disable telemetry events by @vikash390 in #390
- fix: merge cursor field in new discover by @hash-data in #398
- feat: add filter support and optimize chunking strategy for oracle connector by @vaibhav-datazip in #388
- feat: incremental for oracle connector by @vaibhav-datazip in #395
- chore: staging -> master v0.1.6 by @hash-data in #383
Full Changelog: v0.1.5...v0.1.6
v0.1.5
What's Changed
- fix: correctly handle case-sensitive Oracle table names by @vaibhav-datazip in #377
- fix: correctly handle case-sensitive Oracle table names (#377) by @shubham19may in #380
- chore: staging to master v0.1.5 by @hash-data in #381
Full Changelog: v0.1.4...v0.1.5
v0.1.4
What's Changed
- feat: unity catalog support by @shubham19may in #375
- chore: staging to master v0.1.4 by @hash-data in #376
Full Changelog: v0.1.3...v0.1.4
v0.1.3
What's Changed
- chore(ci): optimize trivy scan by @tanishaAtDatazip in #353
- feat: Oracle Database as a Source Connector by @vaibhav-datazip in #355
- feat: config decryption for source and destination by @vikash390 in #364
- fix: iceberg deduplication fix by @shubham19may in #349
- chore: staging to master v0.1.3 by @hash-data in #374
Full Changelog: v0.1.2...v0.1.3
v0.1.2
What's Changed
- chore: some fixes on olake by @hash-data in #357
- feat: Telemetry Setup Using Segment IO and Mixpanel by @ImDoubD-datazip in #290
- chore: Staging to Master v0.1.2 by @hash-data in #365
Full Changelog: v0.1.1...v0.1.2
v0.1.1
What's Changed
- feat: strict_cdc sync mode for all drivers by @vishalm0509 in #344
- feat: discover with merge of old streams.json by @vikash390 in #347
- chore: run integration ci on relevant files by @tanishaAtDatazip in #338
- chore: Staging to Master v0.1.1 by @hash-data in #346
New Contributors
- @tanishaAtDatazip made their first contribution in #338
Full Changelog: v0.1.0...v0.1.1
v0.1.0
What's Changed
- Update LICENCE to add year and company name by @zriyanshdz in #8
- Update README.md to add benchmarking data by @zriyanshdz in #13
- feat: MongoDB Driver by @piyushdatazip in #4
- Mongodb by @piyushdatazip in #31
- Revert "Mongodb" by @piyushdatazip in #32
- WIP: MongoDB Discover and CDC Sync by @hash-data in #9
- fix: Working on Writer by @piyushdatazip in #14
- chore: Adding CONTRIBUTING.md file by @hash-data in #38
- Update README.md to remove pricing from github by @zriyanshdz in #44
- feat: MongoDB state Management by @hash-data in #37
- Update README.md to add better user experience navigating olake by @zriyanshdz in #48
- cleanup: Project cleanup and Lints by @hash-data in #52
- feat: Olake Driver Releaser by @hash-data in #56
- feat: Implement Parquet writer to write to both local storage and S3 … by @vikash390 in #62
- chore: Change Docker Repo Name by @hash-data in #65
- feat(writer): Add option to choose normalization or denormalization by @hash-data in #69
- chore: Catalog Restructure and Autosave Catalog and State Files (#66) by @vikash390 in #72
- chore: Readme Update with Getting Started (#73) by @vikash390 in #75
- Update README.md with updated links by @zriyanshdz in #84
- fix: log formatting (initial state) by @mrmagicpotato007 in #59
- chore : Replace custom loggers with Zerolog and Lumberjack by @vikash390 in #76
- feat: Folder Partition in Parquet Writer by @hash-data in #85
- Stable: Development -> Master by @hash-data in #93
- feat: Resumable Full Load In Mongodb (#61) by @vikash390 in #99
- Update README.md by @rkhameshra in #100
- chore: Exponential Backoff For Backfill In Mongodb by @hash-data in #74
- Update README.md with footer links by @zriyanshdz in #104
- Chore: Adding Stats and Speed Fix by @hash-data in #108
- Feat: Adding Split Vector Strategy In Mongodb (#97) by @vikash390 in #116
- chore: Migrating Fraugster to Parquet-Go by @hash-data in #111
- [Chore] Added a test releaser by @shubham19may in #117
- Chore: Merge Staging -> Master by @hash-data in #119
- Fix: remove error rewrite by @hash-data in #129
- Fix: Broken Link in CONTRIBUTING.md by @Yanendrajha in #134
- Feat: Source Postgres by @hash-data in #79
- Update README.md to add whitespace for consistency by @zriyanshdz in #105
- fix: Standardize folder name format in logs by @k0msenapati in #131
- Chore: Update master readme, mongo and postgres readme by @zriyanshdz in #162
- feat : Fallback to bucketAuto Strategy In Monngodb by @vikash390 in #158
- chore: Merge Master to staging by @hash-data in #167
- added padding for HH,WW,MM,DD by @mrmagicpotato007 in #168
- Feat : Source mysql (#118) by @vikash390 in #175
- Update README.md by @zriyanshdz in #182
- Feat: Iceberg writer (#113) by @shubham19may in #183
- Fix: Fixed the issue of upserts and postgres timestamp by @shubham19may in #188
- chore: Staging -> Master by @hash-data in #166
- Hotfix: parquet writer by @hash-data in #195
- [Chore] Staging Rebase with Master by @shubham19may in #199
- Fix: Backoff in mongo chunk splitting by @debarshee2004 in #135
- Fix: Fixed avro-parquet version with vulnerability by @shubham19may in #207
- fix: mongocdc panic on delete records by @hash-data in #205
- feat: GolangCI on commit by @TheCoderAdi in #178
- fix: fixed pre-commit permission issue by @shubham19may in #210
- chore: Disable PR's on master branch by @shubham19may in #137
- chore: rest catalog example by @shubham19may in #208
- fix: Trivy ignore parquet-avro vulnerability by @shubham19may in #211
- chore: Update benchmarks in main readme by @zriyanshdz in #164
- fix: mongo delete records by @hash-data in #212
- fix: Mongodb username requirement by @TheCoderAdi in #176
- chore: update main readme for catalog support by @zriyanshdz in #215
- fix: Added CMD_NOT_ALLOWED as splitVector fallback in Mongodb by @vaibhav-datazip in #222
- chore: Biweekly Staging -> Master by @hash-data in #203
- fix: Fixing the logging color format for Iceberg sync failures by @shubham19may in #239
- chore: Hive catalog support fix & example by @shubham19may in #226
- chore: readme update for hive catalog by @zriyanshdz in #233
- chore: type convertor for postgres by @hash-data in #241
- chore: staging to master release by @shubham19may in #245
- fix: primitive type conversions for mongodb by @hash-data in #247
- feat: Added partitioning logic for iceberg writer by @shubham19may in #227
- chore: Staging merge to master by @shubham19may in #250
- fix: trivy vulnerability fix by @shubham19may in #252
- fix: handle double datatype (NaN, Infinity, -Infinity) by @vikash390 in #251
- chore: renamed catalog.json file to streams.json by @vaibhav-datazip in #246
- chore: staging to master by @hash-data in #255
- fix: refactored GetKeysHash to generate olakeID when primary key is absent by @vaibhav-datazip in #225
- feat: Moved normalization to a stream-level property instead of writer-level by @vaibhav-datazip in #237
- fix: iceberg schema fix by @shubham19may in #259
- feat: Append Only Mode Added by @ImDoubD-datazip in #256
- fix: Async file close and S3 upload by @mrmagicpotato007 in #173
- fix: solves the chunk intersection issue by @vaibhav-datazip in #261
- fix: support MySQL RDS v8.4 for CDC by @vishalm0509 in #280
- chore: fixed broken links in readme by @shiv4289 in #274
- chore: update readme with new writer supported features by @zriyanshdz in #272
- feat: add integration testing framework by @vikash390 in #209
- fix(source): check MongoDB connection by @vikash390 in #297
- feat: add check-destination cli command to check destination connection by @vishalm0509 in #285
- fix(source): full refresh by @vikash390 in #298
- chore: staging to master by @hash-data in #260
- fix: fixing destination check by @hash-data in #299
- chore: staging merge by @shubham19may in #300
- fix: fixed trivy vulnerability version for hadoop transitive dependency by @shubham19may in #301
- fix(mysql): correct datatype handling by @ImDoubD-datazip in #248
- chore: renamed partition_strategy to chunking_strategy in mongodb by @Saquib1973 in #281
- chore: add e...