Skip to content

When trying to put a block into a custom bucket, considers the block to be the name of the bucket #100

Open
@TheRegent

Description

When soft try to put objects in a bucket it want to upload it in bucket named like block. I tested it with minio and localstack.

./near-lake --home /data run --endpoint http://localhost:9000 --region eu-central-1 --bucket near sync-from-latest

2024-07-15T10:06:02.038377Z WARN near_lake: Failed to put 000123442742/block.json to S3, retrying. Error: ServiceError(ServiceError { source: Unhandled(Unhandled { source: ErrorMetadata { code: Some("NoSuchBucket"), message: Some("The specified bucket does not exist"), extras: Some({"aws_request_id": "17E25AE8743CDB90", "s3_extended_request_id": "dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8"}) }, meta: ErrorMetadata { code: Some("NoSuchBucket"), message: Some("The specified bucket does not exist"), extras: Some({"aws_request_id": "17E25AE8743CDB90", "s3_extended_request_id": "dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8"}) } }), raw: Response { status: StatusCode(404), headers: Headers { headers: {"accept-ranges": HeaderValue { _private: H0("bytes") }, "content-length": HeaderValue { _private: H0("356") }, "content-type": HeaderValue { _private: H0("application/xml") }, "server": HeaderValue { _private: H0("MinIO") }, "strict-transport-security": HeaderValue { _private: H0("max-age=31536000; includeSubDomains") }, "vary": HeaderValue { _private: H0("Origin") }, "vary": HeaderValue { _private: H0("Accept-Encoding") }, "x-amz-id-2": HeaderValue { _private: H0("dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8") }, "x-amz-request-id": HeaderValue { _private: H0("17E25AE8743CDB90") }, "x-content-type-options": HeaderValue { _private: H0("nosniff") }, "x-xss-protection": HeaderValue { _private: H0("1; mode=block") }, "date": HeaderValue { _private: H0("Mon, 15 Jul 2024 10:06:02 GMT") }} }, body: SdkBody { inner: Once(Some(b"\nNoSuchBucketThe specified bucket does not existblock.json000123442742/000123442742/block.json17E25AE8743CDB90dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8")), retryable: true }, extensions: Extensions { extensions_02x: Extensions, extensions_1x: Extensions } } })

Localstack logs:
image

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions