Skip to content

docker: pre-install the duckdb aws extension#111

Merged
jghoman merged 1 commit into
mainfrom
jakob/preinstall-aws-extension
Jul 24, 2026
Merged

docker: pre-install the duckdb aws extension#111
jghoman merged 1 commit into
mainfrom
jakob/preinstall-aws-extension

Conversation

@jghoman

@jghoman jghoman commented Jul 24, 2026

Copy link
Copy Markdown
Collaborator

CREATE SECRET (TYPE s3, PROVIDER credential_chain) — the Pod-Identity path the composition-stamped tenant maintenance crons use — requires DuckDB's aws extension. It was never in the build-time pre-install set (httpfs/ducklake/postgres), so DuckDB attempts a runtime auto-install, which dies on the crons' read-only root filesystem:

Cannot open file ".../.duckdb/extensions/v1.5.2/linux_arm64/aws...": Read-only file system

The central viaduck crons never exercised this path — they authenticate with static env credentials, which need no aws extension. Same first-time-exercised class as the psql gap (#110): observed live on the first tenant cron run to get past bootstrap-indexes (psql now works fleet-wide, so #110 is confirmed in prod).

With the image now floating on :prod (charts #13475), a release after merge reaches every tenant cron on its next tick — no chart change.

CREATE SECRET (TYPE s3, PROVIDER credential_chain) — the Pod-Identity
path the composition-stamped tenant maintenance crons use — requires
the aws extension. It was never pre-installed, so DuckDB attempted a
runtime auto-install, which dies on the crons' read-only root
filesystem:

  Cannot open file ".../.duckdb/extensions/v1.5.2/linux_arm64/
  aws.duckdb_extension.tmp-...": Read-only file system

The central viaduck crons never hit this: they authenticate with
static env credentials, which need no aws extension. Same
first-time-exercised class as the psql gap (#110): observed live on
the first tenant cron run that got past bootstrap-indexes.
@jghoman
jghoman force-pushed the jakob/preinstall-aws-extension branch from 0091f08 to 65ce417 Compare July 24, 2026 17:33
@jghoman
jghoman merged commit c4681fd into main Jul 24, 2026
17 checks passed
@jghoman
jghoman deleted the jakob/preinstall-aws-extension branch July 24, 2026 17:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant