Skip to content

InfluxDB 3.0 Core: Temporary AWS credentials with a short validity #26195

Open
@rajeiyer

Description

@rajeiyer

I provided a 15 minute valid credentials during influx startup. After 15 minutes, inserts started failing with the following error

2025-03-27T17:57:31.280241Z ERROR influxdb3_wal::object_store: error writing wal file to object store e=Generic S3 error: Client error with status 400 Bad Request: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>ExpiredToken</Code><Message>The provided token has expired.</Message><Token-0>FwoGZXIvYXdzEPP//////////w...=</Token-0><RequestId>T5F3MP16TV91YM97</RequestId><HostId>uMF3MnG/Og0v3aU2NVKJCTiav3YNT...=</HostId></Error>

This seems to imply that the S3 client is created during InfluxDB startup with the temporary credentials and the credentials are never refreshed. Thus, for temporary credentials, InfluxDB engine will need a restart every time the credentials are refreshed. Ideally, the writer should catch this exception and update the S3 client with fresh credentials

Sample InfluxDB 3.0 Core startup command

influxdb3 serve --node-id cwv86irbp2 --object-store s3 --bucket influxdb30 --aws-access-key-id ... --aws-secret-access-key ... --aws-session-token FwoGZ...= --aws-default-region ... 

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions