Skip to content

Support Variant arrays through DuckDB#8064

Draft
AdamGS wants to merge 1 commit into
developfrom
adamg/duckdb-variant-feature
Draft

Support Variant arrays through DuckDB#8064
AdamGS wants to merge 1 commit into
developfrom
adamg/duckdb-variant-feature

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 22, 2026

Summary

This PR adds support for reading and writing ParquetVariant arrays in DuckDB. It surfaced some issues around session/write options wiring for non-default encodings, I'll take it out of this PR into a dedicated one as it seems like a general oversight?

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration labels May 22, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 22, 2026

Merging this PR will improve performance by 19.8%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 1250 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 225.2 µs 188 µs +19.8%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing adamg/duckdb-variant-feature (75f7824) with develop (1a5079b)

Open in CodSpeed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant