Skip to content

Commit fc13445

Browse files
committed
docs: Document Delta Lake column mapping support
Adds a Column Mapping section to the Delta Lake data connector page covering `columnMapping.mode = name` and `id`. The connector resolves logical-to-physical names at read time, including nested Struct, List, and Map field renames, and partition and predicate-pushdown paths. Source: spiceai/spiceai#10134
1 parent e6ac7b6 commit fc13445

1 file changed

Lines changed: 4 additions & 0 deletions

File tree

  • website/docs/components/data-connectors/delta-lake

website/docs/components/data-connectors/delta-lake/index.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -184,6 +184,10 @@ The table below shows the Delta Lake data types supported, along with the type m
184184
| `Variant` | `Struct` |
185185
| `Map` | `Map` |
186186

187+
## Column Mapping
188+
189+
Delta Lake tables that use [column mapping](https://github.com/delta-io/delta/blob/master/PROTOCOL.md#column-mapping) with `columnMapping.mode = name` or `columnMapping.mode = id` are supported. Tables in either mode store data in Parquet files under opaque physical column names (e.g., `col-b70f7585-…`) that differ from the logical names exposed by the table schema. Spice resolves logical-to-physical names at read time, including for partitions, predicate pushdown, and nested `Struct`, `List`, and `Map` field renames.
190+
187191
## Limitations
188192

189193
- Delta Lake connector does not support reading Delta tables with the `V2Checkpoint` feature enabled. To use the Delta Lake connector with such tables, drop the `V2Checkpoint` feature by executing the following command:

0 commit comments

Comments
 (0)