chore(deps): bump iceberg-rust to parallel file scanning fork (release/2.0) - #11330
Closed
phillipleblanc wants to merge 1031 commits into
Closed
chore(deps): bump iceberg-rust to parallel file scanning fork (release/2.0)#11330phillipleblanc wants to merge 1031 commits into
phillipleblanc wants to merge 1031 commits into
Conversation
Merge OSS upstream 'trunk' Mar 3, 2026
* fix: update Dockerfile to conditionally install NFS support * fix: add libclang-dev to Dockerfile dependencies * fix: derive NFS install from CARGO_FEATURES instead of separate INSTALL_NFS arg Address review feedback: Remove the INSTALL_NFS build arg that could drift out of sync with CARGO_FEATURES. Instead, derive the libnfs-dev install from CARGO_FEATURES using the same grep pattern as ODBC. Also note: NFS and SMB features are intentionally removed from default, data, and allocator variants and moved to a dedicated 'nas' variant. This is a deliberate change to reduce image size for variants that don't need NAS support.
Jeadie/26 03 04/update
* Fix Saffron benchmarks dispatch * Trigger CI * Trigger CI
…03-04 # Conflicts: # tools/testoperator/dispatch/tpch/sf1/federated/iceberg[catalog].yaml
Install odbc in `install-spice` action
Upstream merge 2026-03-04
Properly install postgres (#9629)
add query_overrides: saffron-views
fix: Align CUDA asset names in Dockerfile and install tests with build output
Merges spiceai/spiceai trunk as of 2026-03-09 into spicehq/spiceai trunk. Includes runner name replacements and enterprise version preservation.
Merge OSS trunk (facec39) — 2026-03-09
* Enterprise release endgame: update list of test app * Update end_game_enterprise.md
…-oss-release Prepare v2.0.0-rc.5-enterprise
Include region in `spice dataset configure` for spice.ai command
* Refactor Clickhouse installation in CI workflow Updated Clickhouse installation steps for Linux and macOS with specific versioning and repository setup. * update cargo aes --------- Co-authored-by: Jeadie <jeadie@users.noreply.github.com>
requires `-helm` suffix.
Update version format in Chart.yaml
Co-authored-by: Spice Schema Bot <schema-bot@spice.ai>
…e/2.0) Re-pins iceberg-rust to spiceai-0.9.1-df-52 (rev 65463fe6), picking up the eager task-bucketing parallel-scan change (fork PR spiceai/iceberg-rust#44, port of apache/iceberg-rust#2298). release/2.0 counterpart of the trunk change in #11328. The DF52 fork line spiceai-52 is renamed spiceai-0.9.1-df-52 per the spiceai-<iceberg>-df-<df> convention (alias retained; version req stays caret 0.9.0, satisfied by 0.9.1). No Spice code changes — only IcebergTableProvider::try_new is used.
github-actions
Bot
added
area/ci
area/config
area/docs
area/tests
kind/chore
kind/dependencies
Contributor
🔍 Pull with Spice Failed🏷️ Auto-applied labels:
Passing checks:
Failed checks:
Please address these issues and update your pull request. |
Contributor
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
release/2.0 backport of #11328. Re-pins
spiceai/iceberg-rustto the eager task-bucketing parallel-scan change on the DF52 line.spiceai-0.9.1-df-52@65463fe6(wasspiceai-52@a24ad5d4)Not a literal cherry-pick of #11328 — that pins the DF53 line (
spiceai-0.9.1-df-53); this pins the DF52 linerelease/2.0builds against. Thespiceai-52branch is renamedspiceai-0.9.1-df-52per thespiceai-<iceberg>-df-<datafusion>convention (alias retained); the version requirement stays caret"0.9.0"(satisfied by the fork's 0.9.1).Effect on Spice
IcebergTableProvider::scan()now plans files eagerly and distributes file scan tasks acrossmin(target_partitions, n_files)DataFusion partitions, so Iceberg file reads are scheduled concurrently. No Spice code changes — Spice consumes the provider only viaIcebergTableProvider::try_new; the fork preserves Spice's Iceberg limit-pushdown.Validation
cargo check -p data_componentsclean against the bumped rev (Spice DataFusion 52 fork).df_*sqllogictest schedules + integration test; clippy/fmt clean (DataFusion 52.2).Note
Draft pending merge of spiceai/iceberg-rust#44. Pins the fork branch head; re-pin to the merge commit once #44 merges into
spiceai-0.9.1-df-52, then mark ready.