Prototype prepared indexing execution for codec consumers - #323
Draft
d-v-b wants to merge 2 commits into
Draft
Conversation
Use data-extent completeness, drop orthogonal scalar axes at the execution boundary, and run codec tests in the package CI suite. Keep ownership and write policies in this separate experimental review. Assisted-by: Codex:GPT-6
The planner now rejects diagonals with ValueError and has no shared projection walk, so execute_transform factors the plan up front and lets that rejection surface at construction instead of on first iteration. _axis_plan reuses chunk_resolution's data-extent helper rather than carrying a copy. Assisted-by: ClaudeCode:claude-fable-5-1 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
d-v-b
force-pushed
the
codex/indexing-execution
branch
from
September 6, 2026 10:07
1f2b4bc to
dc2e279
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🤖 AI text below 🤖
This draft adds an opt-in prepared execution layer on top of
zarr-indexing/grid-partition. It lets codec consumers obtain chunk-local and result selectors directly from affine runs or connected-component tables, while retaining declarative projection lowering for other transforms. It does not replace Zarr's default indexers.Preparation makes snapshot/borrow ownership and read/write conflict policies explicit. NumPy and shard consumers lower the same work to their respective selector layouts. The selection-flow guide remains on the base branch; this draft separately documents the experimental execution contracts and current sharding materialization boundary.
Review corrections included here:
Validation: 1,550 package tests passed, including 40 real codec integration cases; Ruff and commit hooks passed;
_execution.pypassed mypy; Pyright reported zero errors (95 warnings); strict MkDocs build passed. No end-to-end storage speedup is claimed. Compact sharding consumption and broader dispatch remain future work.