Skip to content

CHANGELOG-old.md

Latest commit

 

History

History
1177 lines (902 loc) · 141 KB

CHANGELOG-old.md

File metadata and controls

1177 lines (902 loc) · 141 KB

Historical Changelog

v0.13.0 (2025-12-19)

Full Changelog

Breaking changes:

  • fix: Add fields to Error::NotImplemented with more details on what isn't implemented #575 (carols10cents)
  • refactor!: copy & copy_if_not_exists => copy_opts #548 (crepererum)
  • refactor!: move head to ObjectStoreExt #543 (crepererum)
  • fix: wrappers and default trait methods #537 (crepererum)
  • refactor!: move get_range to ObjectStoreExt #536 (crepererum)
  • refactor!: move get to ObjectStoreExt #532 (crepererum)
  • refactor: move put_multipart to ObjectStoreExt #530 (crepererum)
  • feat!: use 'static lifetime for delete_stream #524 (linhr)
  • Bump rust edition to 2024, rust version to 1.85 #515 (AdamGS)
  • reapply: remove AWS dynamo integration (#407), try 2 #494 (alamb)
  • refactor: introduce ObjectStoreExt trait #405 (crepererum)

Implemented enhancements:

  • NotImplemented error should say what method wasn't implemented by what implementation #572
  • Allow explicitly specifying the GCS base URL #566
  • Detailed error messages for Generic #560
  • Include reqwest/hyper error sources in error messages #554
  • Improve Path ergonomics #545
  • [Suggestion] Move ObjectStore API to use arrow-rs' Buffer #544
  • Implement ObjectStore for Arc<T> and Box<T> #525
  • Refactor GetOptions with a builder pattern #516
  • Better support for Tags #508
  • Error 411 (Length Required) when using Multipart PUT on GCP with S3Store #495
  • Deprecate and Remove DynamoCommit #373
  • Add CopyOptions #116

Fixed bugs:

  • RequestError exposes underlying reqwest::Error rather than the nicer HttpError #579
  • SpawnService panics tokio-runtime-worker threads #578
  • local path filtering has different semantics #573
  • AWS: using Checksum::SHA256 causes copy_if_not_exists with S3CopyIfNotExists::Multipart to fail #568
  • Cargo Audit Produces a Warning for rustls-pemfile being unmaintained #564
  • AmazonS3ConfigKey::WebIdentityTokenFile is ignored #538
  • Cannot parse AWS S3 HTTP URLs without region #522
  • Signature mismatch (sigv4) when using attribute values with double whitespace #510
  • Generic S3 error: Metadata value for ""x-amz-meta-.."" contained non UTF-8 characters #509
  • Inconsistent documentation of "Supported Keys" #497

Documentation updates:

  • Update release date for version 0.13.0 in README #521 (alamb)
  • feat: refactor GetOptions with builder, add binary examples #517 (peasee)
  • docs: document missing config keys #498 (CommanderStorm)

Closed issues:

  • Add documentation for what backends support bulk delete (ObjectStore::delete_stream) #527
  • Use 'static lifetime for delete_stream #518
  • Release object store 0.12.4 (non breaking API) Release September 2025 #489
  • Cleanup ObjectStore trait: Split out convenience methods #385

Merged pull requests:

v0.12.4 (2025-09-19)

Full Changelog

Implemented enhancements:

  • Allow flagging PUT operations as idempotent. #464
  • Release object store 0.12.3 (non breaking API) Release July 2025 #428
  • LocalFileSystem: offset for list_with_offset can't be identified / List results *must* be sorted #388
  • Support setting storage class when objects are written #330
  • Support auth using AssumeRoleWithWebIdentity for non-AWS S3-compatible implementations #283
  • Types from http through request leak into object_store public interfaces but aren't re-exported #263

Fixed bugs:

  • Retry does not cover connection errors #368

Documentation updates:

  • Improve documentation for http client timeout #390 (alamb)

Closed issues:

  • When a client http request is retried, I would like more information in the info! about the retry #486
  • Range header causing AWS Signature issues #471
  • Impossible to downcast an Error::Generic into a RetryError #469
  • JWT session tokens cause SignatureDoesNotMatch with Supabase S3 #466
  • Double url-encoding of special characters in key names #457
  • Make MultipartUpload Sync #439
  • Integrate HDFS object store #424
  • Error performing POST when trying to write to S3 with a custom endpoint URL #408

Merged pull requests:

v0.12.3 (2025-07-11)

Full Changelog

Implemented enhancements:

  • S3 store fails without retrying #425
  • Deprecate and Remove DynamoCommit #373
  • Move payload helpers from GetResult to GetResultPayload #352
  • Retry on 429s and equivalents #309
  • object_store: Support container@account.dfs.core.windows.net/path URL style for az protocol #285
  • Rename PutMultiPartOpts to PutMultiPartOptions, the old name is deprecated and will be removed in the next major release #406

Fixed bugs:

  • Builder panics on malformed GCS private key instead of returning error #419
  • cargo check --no-default-features --features=aws,azure,gcp,http fails #411
  • Incorrect prefix in ObjectStoreScheme::parse for Azure HTTP urls #398

Closed issues:

  • PutMode::Update support for LocalFileSystem? #423

Merged pull requests:

v0.12.2 (2025-06-06)

Full Changelog

Implemented enhancements:

  • Add ObjectStoreUrl to resolve URLs to ObjectStore instances #356
  • Retry / recover after partially reading a streaming response ( fix timeout errors / error decoding response body ) #15
  • Expose list_paginated in object_store #291

Fixed bugs:

  • Emulator tests are broken on main #395
  • Retry does not cover connection errors #368
  • Error handling of HTTP storage backend not utilizing retry::RetryError::error when possible #365
  • Error running cargo publish: wildcard (*) dependency constraints are not allowed on crates.io. #357
  • No retries when connection closes abruptly (i.e TCP-RST) #350
  • Compilation error in tests with Rust 1.87: integer out of range for u16 in format string #343

Documentation updates:

  • Improve parse_url_opts documentation #377 (alamb)

Closed issues:

  • object_store pulls default reqwest features which always active native-tls #400
  • Introduce retry to other methods than get after #383 #387
  • Security: AwsCredential prints plaintext may cause security issue. #363
  • Docs build fails for object_store 0.12.1 #360
  • Is there a way to go from ObjectStore to (URL, opts)? #347

Merged pull requests:

v0.12.1 (2025-05-08)

Full Changelog

Implemented enhancements:

  • Support Alibaba OSS Object Storage #323
  • Enable anonymous access to GCS buckets #302
  • [object_store] Run requests on a different tokio runtime #13
  • [object_store] consider migrating humantime to jiff #292
  • Support EKS Pod Identity (alternative to IRSA) #282
  • Object_store: Create an upload method that handles concurrency #279
  • object_store: Retry on connection duration timeouts (retry / recover after partially reading a streaming response) #53
  • [object-store] re-export hyper #293
  • object_store: abort_multipart() should return NotFound error if not found #146
  • Make GetOptionsExt publicly usable #261

Fixed bugs:

  • Incorrect token sent as part of url signing function. #337
  • Azure Gen2 broken on latest #320
  • object_store: Azure brokenness on 0.12.0 #326
  • Generic S3 error: Client error with status 411 Length Required #278

Closed issues:

  • CI doesn't run on PRs #335
  • Some Inconsistencies in the Path and List #327
  • Add allow-list to restrict access to local files with LocalFileSystem #312
  • Query on usage of experimental package ring #310
  • [Object Store] Make the service account used when interacting with the metadata url more flexible #265

Merged pull requests:

object_store_0.12.0 (2025-03-05)

Full Changelog

Breaking changes:

Implemented enhancements:

Fixed bugs:

Merged pull requests:

object_store_0.11.2 (2024-12-20)

Full Changelog

Implemented enhancements:

Fixed bugs:

Merged pull requests:

object_store_0.11.1 (2024-10-15)

Full Changelog

Implemented enhancements:

Fixed bugs:

  • [object-store] Requested tokio version is too old - does not compile #6458 [object-store]
  • Azure SAS tokens are visible when retry errors are logged via object_store #6322 [object-store]

Merged pull requests:

object_store_0.11.0 (2024-08-12)

Full Changelog

Breaking changes:

Merged pull requests:

object_store_0.10.2 (2024-07-17)

Full Changelog

Implemented enhancements:

  • Relax WriteMultipart API to support aborting after completion #5977 [object-store]
  • Make ObjectStoreScheme in the object_store crate public #5911 [object-store]
  • Add BufUploader to implement same feature upon WriteMultipart like BufWriter #5834 [object-store]

Fixed bugs:

  • Investigate why InstanceCredentialProvider::cache is flagged as dead code #5884 [object-store]
  • [object_store] Potential race condition in list_with_delimiter on Local #5800 [object-store]

Documentation updates:

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator

object_store_0.10.1 (2024-05-10)

Full Changelog

Implemented enhancements:

  • Allow specifying PUT options when using BufWriter #5692 [object-store]
  • Add more attributes to object_store::Attribute #5689 [object-store]
  • feat object_store: moving tests from src/ to a tests/ folder and enabling access to test functions for enabling a shared integration test suite #5685 [object-store]
  • Release Object Store 0.10.0 #5647 [object-store]

Fixed bugs:

Merged pull requests:

object_store_0.10.0 (2024-04-17)

Full Changelog

Breaking changes:

Implemented enhancements:

Fixed bugs:

  • [object_store] minor bug: typos present in local variable #5628 [object-store]
  • [arrow-csv] Schema inference requires csv on disk #5551
  • Local object store copy/rename with nonexistent from file loops forever instead of erroring #5503 [object-store]
  • object store ApplicationDefaultCredentials auth is not working on windows #5466 [object-store]
  • MicrosoftAzure store list result omits empty objects #5451 [object-store]

Documentation updates:

Merged pull requests:

object_store_0.9.1 (2024-03-01)

Full Changelog

Implemented enhancements:

Fixed bugs:

Merged pull requests:

object_store_0.9.0 (2024-01-05)

Full Changelog

Breaking changes:

Implemented enhancements:

Fixed bugs:

Documentation updates:

Merged pull requests:

object_store_0.8.0 (2023-11-02)

Full Changelog

Breaking changes:

Implemented enhancements:

Fixed bugs:

Closed issues:

Merged pull requests:

object_store_0.7.1 (2023-09-26)

Full Changelog

Implemented enhancements:

  • Automatically Cleanup LocalFileSystem Temporary Files #4778 [object-store]
  • object-store: Expose an async reader API for object store #4762
  • Improve proxy support by using reqwest::Proxy as configuration #4713 [object-store]

Fixed bugs:

  • object-store: http shouldn't perform range requests unless accept-ranges: bytes header is present #4839
  • object-store: http-store fails when url doesn't have last-modified header on 0.7.0 #4831
  • object-store fails to compile for wasm32-unknown-unknown with http feature #4776 [object-store]
  • object-store: could not find header in client for http feature #4775 [object-store]
  • LocalFileSystem Copy and Rename Don't Create Intermediate Directories #4760 [object-store]
  • LocalFileSystem Copy is not Atomic #4758 [object-store]

Closed issues:

  • object_store Azure Government Cloud functionality? #4853

Merged pull requests:

object_store_0.7.0 (2023-08-15)

Full Changelog

Breaking changes:

Implemented enhancements:

Fixed bugs:

Closed issues:

  • [object_store] when Create a AmazonS3 instance work with MinIO without set endpoint got error MissingRegion #4617
  • AWS Profile credentials no longer working in object_store 0.6.1 #4556 [object-store]

Merged pull requests:

object_store_0.6.0 (2023-05-18)

Full Changelog

Breaking changes:

Implemented enhancements:

Fixed bugs:

  • ObjectStore::head Returns Directory for LocalFileSystem and Hierarchical Azure #4230 [object-store]
  • object_store: different behavior from aws cli for default profile #4137 [object-store]
  • ImdsManagedIdentityOAuthProvider should send resource ID instead of OIDC scope #4096 [object-store]
  • Update readme to remove reference to Jira #4091
  • object_store: Incorrect parsing of https Path Style S3 url #4078 [object-store]
  • [object_store] local::tests::test_list_root test fails during release verification #3772 [object-store]

Merged pull requests:

object_store_0.5.6 (2023-03-30)

Full Changelog

Implemented enhancements:

Fixed bugs:

Merged pull requests:

object_store_0.5.5 (2023-02-27)

Full Changelog

Implemented enhancements:

Fixed bugs:

Merged pull requests:

object_store_0.5.4 (2023-01-30)

Full Changelog

Implemented enhancements:

  • [object_store] support more identity based auth flows for azure #3580 [object-store]
  • Implement workload identity and application default credentials for GCP object store. #3533 [object-store]
  • Support GCP Workload Identity #3490 [object-store]
  • Allow providing service account key directly when building GCP object store client #3488 [object-store]

Closed issues:

Merged pull requests:

object_store_0.5.3 (2023-01-04)

Full Changelog

Implemented enhancements:

  • Derive Clone for the builders in object-store. #3419
  • Add a constant prefix object store wrapper #3328 [object-store]
  • Add support for content-type while uploading files through ObjectStore API #3300 [object-store]
  • Add HttpStore #3294 [object-store]
  • Add support for Azure Data Lake Storage Gen2 (aka: ADLS Gen2) in Object Store library #3283
  • object_store: Add Put and Multipart Upload Doc Examples #2863 [object-store]

Closed issues:

  • Only flush buffered multi-part data on poll_shutdown not on poll_flush #3390 [object-store]

Merged pull requests:

object_store_0.5.2 (2022-12-02)

Full Changelog

Implemented enhancements:

Fixed bugs:

  • object_store(gcp): GCP complains about content-length for copy #3235
  • object_store(aws): EntityTooSmall error on multi-part upload #3233 [object-store]

Merged pull requests:

object_store_0.5.1 (2022-10-04)

Full Changelog

Implemented enhancements:

  • Allow HTTP S3 URLs #2806
  • object_store: support AWS ECS instance credentials #2802
  • Object Store S3 Alibaba Cloud OSS support #2777 [object-store]
  • Expose option to use GCS object store in integration tests #2627 [object-store]

Fixed bugs:

Merged pull requests:

object_store_0.5.0 (2022-09-08)

Full Changelog

Breaking changes:

Implemented enhancements:

Fixed bugs:

Merged pull requests:

object_store_0.4.0 (2022-08-10)

Full Changelog

Implemented enhancements:

Fixed bugs:

  • Azure/S3 Storage Fails to Copy Blob with URL-encoded Path #2353 [object-store]
  • Accessing a file with a percent-encoded name on the filesystem with ObjectStore LocalFileSystem #2349 [object-store]

Documentation updates:

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator