Releases: steveloughran/cloudstore
release-2026-02-20-18.21: put command
There's a new command "put" to upload/copy a single file, with the ability to set createFile() options for the target file.
Note that there's an avro cve related to untrusted schemas. moving to avro 1.12 just broke the build, and it will inevitably be incompatible with runtimes too, so it's downgraded to 1.11.5 for the avro generated classes (the ones which examine the logs)
release-2026-01-15-19.10: auditlogs command
Pulled in the uncommitted work of HADOOP-18257 to add a "hadoop s3guard auditlogs" command, and added here instead.
This will take a directory full of aws S3 server logs and convert to a single avro file, which can then be loaded in spark .
The date of the request (granularity is only 1 second) is extracted and converted to an epoch time in microseconds.
release-2025-12-09-14.55
Update for GCS 3.x, including gs.auth.type option
release-2025-12-02-18.20
- Update for GCS 3, including gs.auth.type option
- log some more aws system properties
The GCS change is the big one as google completely removed hadoop config auth
release-2025-10-21-14.18: cloudstore-1.1
- Now versioning releases even though it complicates build and release,
- new etag command
- listobjects working again (what comes with no tests)
- bandwidth will only set read policy if explicitly declared on CLI -otherwise you get the FS default. Helps benchmark that default value
release-2025-09-25-10.21
s3a:
- more detail on read policies
abfs:
- OAuth diagnostics improved
release-2025-08-27-15.36
abfs oauth2 diagnostics improvements
release-2025-08-27-14.09
Storediag: harden abfs authentication checks during preflight checks
release-2025-08-26-22.25
improved abfs and gcs store diagnostics
release-2025-07-15-13.56
Print JVM security properties in storediag and sysinfo