array tree layouts

[onursatici]

Summary

Adds two new layouts, array tree layout and array tree flat layout. Latter writes the array node into a vortex array instead of serialising it into a flatbuffer, and the former collects all these columnar array nodes and creates one segment from them and writes at the end of the file, before the zone maps.

This replaces inlining the array nodes as flatbuffers to the footer

[codspeed-hq]

Merging this PR will improve performance by 18.03%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 4 improved benchmarks
✅ 1233 untouched benchmarks

Performance Changes

	Mode	Benchmark	BASE	HEAD	Efficiency
⚡	Simulation	chunked_varbinview_into_canonical[(100, 100)]	358.4 µs	323.4 µs	+10.83%
⚡	Simulation	chunked_varbinview_into_canonical[(1000, 10)]	211.2 µs	175.7 µs	+20.24%
⚡	Simulation	chunked_varbinview_opt_canonical_into[(1000, 10)]	224.7 µs	188.5 µs	+19.21%
⚡	Simulation	chunked_varbinview_canonical_into[(1000, 10)]	197.9 µs	162 µs	+22.17%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

---

_{Comparing os/array-tree-layout-stacked (39bfedf) with os/array-serialise-columnar (93e517d)}