v1.8.0

Upgrade to delta-rs 0.29.2 and pull CommitProperties through for writers

Closes #39

Signed-off-by: R. Tyler Croy <[email protected]>

v1.7.2

Missed a write on the README for parquet-concat

v1.7.1

bump to 1.7.1 for a release of more performance improvements

Signed-off-by: R. Tyler Croy <[email protected]>

v1.7.0

Prepare the parquet-concat lambda for release with 1.7.0

The minor changes are imply removing the collect on some Vec<T> to keep
memory consumption down

Signed-off-by: R. Tyler Croy <[email protected]>

v1.6.3

Revert "Upgrade oxbow to deltalake 0.28"

This reverts commit d8f7b683d7ff1498d1c2eea96a2642d8f5b490c4.

The 0.27 and 0.28 versions of delta-rs incorporate kernel-based log
reply and we're seeing pretty dramatic performance degredation

v1.6.2

Properly iterate through record batches on deserialization

Testing this in an automated fashion proved to be majority of the
challenge since the aws-sdk-s3 crate can produce an AsyncBufRead
implementation for asynchronously reading through the S3 input file, but
chaining that together within an abstracted function for execution.

This change also includes the introduction of stats_alloc to try to do a
better job tracking memory as files are loaded.

v1.6.1

This is a minor release with a big notable upgrade of delta-rs to 0.28

No functionality changes are expected however

v1.6.0

Wrap unit test calls to set_var in unsafe {}

Newer rustc's complain about it, previous ones didn't :shrug:

v1.5.2

Ensure that file-loader batches are augmented when appropriate

This was a mistake in the previous release

v1.5.1

Datafusion is unfortunately still required for tables with invariants