- Bump urllib3 to 2.7.0 for security updates #89
- Bumps singer-econdings to remove pyarrow vulnerability #88
- Write bookmarks for streams that sync no records #87
- Bumps urllib3 dependency for twistlock compliance #86
- Bumps urllib3 dependency for dependabot compliance #84
- Fixes schema for _sdc_extra column #83
- Refactors JSONL support to use singer-encodings library #82
- Adds support for avro files #81
- Adds support for parquet files
- Updates schema generation to allow for more robust (i.e. nested) data structures
- #80
- Remove leading
/fromsearch_prefix - Connect using proxy account directly, if supplied in config
- #78
- Bump
voluptuousversion for python compatibility #76
- Bump dependency versions for twistlock compliance #72
- Changes JSONFileCache location #70
- Adds proxy AWS Account support
- #69
- Handle S3 files race condition
- #67
- Add Missing Type Information in JSON Schema
- #62
- Remove Backoff for Access Denied errors
- Add unitttest for access denied giveup
- #55
- Increase the limit on the width of a field in the CSV files read by the tap #47
- Bump singer-encodings to 0.1.2 #45
- Bump singer-encodings to 0.1.1 #41
- Skip files without a name #37
- Fix an issue to allow the tap to run with a catalog without schemas #38
- Fixed bug that caused
integers to be discovered asnumberdifferently in different versions of python #35
- Adds support for Compressed files #32
- Adds support for JSONL files #31
- Adds support for duplicated headers in CSV files #30
- Adds testing #29
- Updates
backoff,singer-encodings, andsinger-pythondependencies - Updates logging messages
- Fix issue relating to search_prefix config values
- Accepts the table key_properties as both a list and a csv string
- Skip files when they are empty #17
- Attempt to setup a AWS session that can refresh itself #16
- Strips hyphens from incoming account_ids.
- Adds retry logic and exponential backoff for AWS requests that fail #10
- Updates how the tap authenticates with AWS - it will now assume a role given via the config #9
- Adds support for different types of CSV delimiters via singer-encodings #7
- Add JSON Schema type string to all fields as a final fallback in case we miss a crucial sample #5
- Add error handling to fail quickly when no streams are found
- Fixes a bug where we could sample the reskey field for a non-rectangular csv #4
- Use the singer-encodings library to share more code
- Renames columns like "_s3_source_bucket" to "_sdc_source_bucket" to better align with standards
- Lowers the sample rate to improve speed for larger files
- Fixes a logging bug with a cached value
- Header keys are no longed scrubbed for non-word characters
- Raise an error when a date_override is set but does not exist in the header