Skip to content

Bump spiceai duckdb-rs fork to 7648ff8c (vendored vss; fix Windows build)#660

Merged
phillipleblanc merged 1 commit into
spiceai-52from
phillip/vss-vendored-1.5.3
Jun 3, 2026
Merged

Bump spiceai duckdb-rs fork to 7648ff8c (vendored vss; fix Windows build)#660
phillipleblanc merged 1 commit into
spiceai-52from
phillip/vss-vendored-1.5.3

Conversation

@phillipleblanc

Copy link
Copy Markdown
Collaborator

Summary

Bumps the duckdb (spiceai duckdb-rs fork) pin from b1cf1723 to 7648ff8c — the head of spiceai/duckdb-rs spiceai-1.5.3 after spiceai/duckdb-rs#39, which vendors the VSS extension as committed files instead of a git submodule.

Why

Cargo recursively checks out all submodules of this git dependency. The previous vss submodule dragged in duckdb-vss's own nested duckdb submodule, whose deeply-nested Swift example path exceeds Windows' MAX_PATH — breaking the Windows build. Vendoring the vss source as files removes all submodules from the dependency.

Change

  • Cargo.toml: duckdb rev b1cf1723 -> 7648ff8c.
  • Cargo.lock: the two duckdb / libduckdb-sys git source entries updated to the new rev (source-string only; no DuckDB Rust API change between the revs).

Validation

cargo metadata --locked resolves cleanly. Keeps table-providers' duckdb in sync with consumers that pin the same rev (avoids duplicate libduckdb-sys / links = "duckdb").

…ild)

Updates the duckdb-rs pin from b1cf1723 to 7648ff8c — spiceai/duckdb-rs#39, which vendors the
vss extension as committed files instead of a git submodule. Cargo recursively checks out
submodules of this git dependency, and the previous vss submodule pulled in duckdb-vss's nested
duckdb checkout, whose deep path exceeded Windows' MAX_PATH and broke the Windows build.
No DuckDB Rust API change; lock updated for the new rev only.
@phillipleblanc phillipleblanc self-assigned this Jun 3, 2026
@phillipleblanc phillipleblanc merged commit 4af8542 into spiceai-52 Jun 3, 2026
11 of 12 checks passed
@phillipleblanc phillipleblanc deleted the phillip/vss-vendored-1.5.3 branch June 3, 2026 09:58
phillipleblanc added a commit to spiceai/spiceai that referenced this pull request Jun 3, 2026
Bump duckdb-rs b1cf1723 -> 7648ff8c (spiceai/duckdb-rs#39) and datafusion-table-providers
be0837e3 -> 4af85422 (datafusion-contrib/datafusion-table-providers#660). Those vendor the vss
extension as committed files instead of a git submodule.

The vss submodule dragged in duckdb-vss's own nested `duckdb` submodule via Cargo's recursive
submodule checkout of the duckdb-rs git dependency, and that nested checkout's deep Swift example
path exceeded Windows' MAX_PATH, breaking the Windows build. Vendored sources have no submodules
to recurse into. No functional change to the bundled DuckDB (same v1.5.3 + statically-linked vss).
phillipleblanc added a commit to spiceai/spiceai that referenced this pull request Jun 3, 2026
…mongodb API

Bump duckdb-rs b1cf1723 -> 7648ff8c (spiceai/duckdb-rs#39) and datafusion-table-providers
be0837e3 -> 4af85422 (datafusion-contrib/datafusion-table-providers#660). Those vendor the vss
extension as committed files instead of a git submodule, fixing the Windows MAX_PATH break
(Cargo recursively checked out the vss submodule's nested duckdb, whose deep Swift path exceeded
Windows' MAX_PATH).

The table-providers bump to the current spiceai-52 head also brings in #657 (mongodb schema
merging), which added an optional declared-schema arg to MongoDBTableFactory::table_provider.
Adapt crates/data_components/src/mongodb.rs to pass None (no declared schema at that layer).

No functional change to the bundled DuckDB (same v1.5.3 + statically-linked vss).
phillipleblanc added a commit to spiceai/spiceai that referenced this pull request Jun 3, 2026
…mongodb API (#11140)

Bump duckdb-rs b1cf1723 -> 7648ff8c (spiceai/duckdb-rs#39) and datafusion-table-providers
be0837e3 -> 4af85422 (datafusion-contrib/datafusion-table-providers#660). Those vendor the vss
extension as committed files instead of a git submodule, fixing the Windows MAX_PATH break
(Cargo recursively checked out the vss submodule's nested duckdb, whose deep Swift path exceeded
Windows' MAX_PATH).

The table-providers bump to the current spiceai-52 head also brings in #657 (mongodb schema
merging), which added an optional declared-schema arg to MongoDBTableFactory::table_provider.
Adapt crates/data_components/src/mongodb.rs to pass None (no declared schema at that layer).

No functional change to the bundled DuckDB (same v1.5.3 + statically-linked vss).
phillipleblanc added a commit to spiceai/spiceai that referenced this pull request Jun 3, 2026
…mongodb API (#11140)

Bump duckdb-rs b1cf1723 -> 7648ff8c (spiceai/duckdb-rs#39) and datafusion-table-providers
be0837e3 -> 4af85422 (datafusion-contrib/datafusion-table-providers#660). Those vendor the vss
extension as committed files instead of a git submodule, fixing the Windows MAX_PATH break
(Cargo recursively checked out the vss submodule's nested duckdb, whose deep Swift path exceeded
Windows' MAX_PATH).

The table-providers bump to the current spiceai-52 head also brings in #657 (mongodb schema
merging), which added an optional declared-schema arg to MongoDBTableFactory::table_provider.
Adapt crates/data_components/src/mongodb.rs to pass None (no declared schema at that layer).

No functional change to the bundled DuckDB (same v1.5.3 + statically-linked vss).
github-actions Bot pushed a commit to spiceai/spiceai that referenced this pull request Jun 6, 2026
…mongodb API (#11140)

Bump duckdb-rs b1cf1723 -> 7648ff8c (spiceai/duckdb-rs#39) and datafusion-table-providers
be0837e3 -> 4af85422 (datafusion-contrib/datafusion-table-providers#660). Those vendor the vss
extension as committed files instead of a git submodule, fixing the Windows MAX_PATH break
(Cargo recursively checked out the vss submodule's nested duckdb, whose deep Swift path exceeded
Windows' MAX_PATH).

The table-providers bump to the current spiceai-52 head also brings in #657 (mongodb schema
merging), which added an optional declared-schema arg to MongoDBTableFactory::table_provider.
Adapt crates/data_components/src/mongodb.rs to pass None (no declared schema at that layer).

No functional change to the bundled DuckDB (same v1.5.3 + statically-linked vss).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant