Issues proxying GCS and Azure

[tamalsaha]

Thanks for this very handy project. We are trying it to take backup from Solr (aws java sdk) into GCS or Azure. We are seeing the following errors when we try to do this:

For gcs: "Invalid base 16 character: 'O'"
For azure: "Input is expected to be encoded in multiple of 2 bytes but found: 17"

Looks like both issues are related to ETAG.

For GCS, I see similar reports here:

• https://stackoverflow.com/questions/56116120/etag-decoding-error-when-using-awssdk-s3-v2-with-gcs-and-minio-gateway
• S3 PutObject ETag using GCS gateway incompatible with aws-sdk-java minio/minio#7642

For Azure, I see similar reports here:

• S3: Input is expected to be encoded in multiple of 2 bytes but found: 31 localstack/localstack#2015
• Fix regex for replacement of S3 ETag hashes localstack/localstack#2021

How can we further debug these issues and fix them? Any help is much appreciated.

[aravinds502]

following

[dopan]

+1

[tamalsaha]

Seems related to

• S3 PutObject ETag using GCS gateway incompatible with aws-sdk-java minio/minio#7642
• gcs: use MD5Sum as ETag if present in object attrs minio/minio#7643