🌪 0.45.0

Changes

✨ Features

• feat[spark]: write support in VortexDataSourceV2 (#4246) @lwwmanning
• feat: implement Display for StructFields (#4255) @blaginin
• feat: Support more datafusion features (#4180) @AdamGS
• Support converting TimestampTZ to and from duckdb (#4226) @robert3005
• Use perfetto tracing (#4250) @gatesn
• feat: Remove 'parquet' feature and some other dependency bloat (#4251) @AdamGS
• feat: Make FieldNames comparison more ergonomic (#4239) @AdamGS
• feat(c++): support passing filter and projection expression in scan (#4224) @XinyuZeng
• feat[expr]: add back the expression folder, implemented over Node (#4230) @joseph-isaacs
• feature: Add TryFrom impls for owned scalars to values (#4234) @AdamGS
• docs: add javadoc to docs.vortex.dev (#4229) @a10y
• feat: Expose various expr transformations directly instead of through module (#4212) @AdamGS
• feat[duckdb]: support more operators (#4170) @joseph-isaacs
• feat: teach Vortex how to export list arrays to duckdb (#4169) @danking
• feat(python): Write PyArrow types directly to Vortex (#4161) @a10y
• Inline the logic of the filter layout reader (#4089) @gatesn
• Support exporting Arrow RunArray to Vortex (#4162) @robert3005
• feature: Support converting Arrow DictArray into vortex (#4157) @robert3005
• refactor the LayoutStrategy (#4149) @a10y

🚀 Performance

• perf: Use sum compute function (#4207) @viirya

🐛 Bug Fixes

20 changes

• fix: Validity export using shifted u64 copy (#4244) @robert3005
• fix[bench]: better bench input size (#4243) @joseph-isaacs
• fix[bench-site]: Compression Size group missing charts (#4236) @lwwmanning
• Fix: Return currect field names in SelectExpr::as_include (#4232) @AdamGS
• fix: javadoc workflow (#4231) @a10y
• fix: Correctly convert arrow temporal arrays with timezone (#4227) @robert3005
• fix: runend decompress benchmarks (#4225) @0ax1
• fix: Avoid running projection evaluation for all false masks (#4209) @robert3005
• fix: small resource leak in vortex-io, plus test improvements (#4201) @lwwmanning
• fix: race condition in vortex-layout, plus test improvements (#4198) @lwwmanning
• fix[bench-website]: add tpc-ds to bench website (#4199) @joseph-isaacs
• shared waker in struct writer (#4193) @onursatici
• fix: duckdb dyn expr race on filter constant (#4168) @0ax1
• fix[scan]: don't convert filter to cnf just extract conjunct list (#4174) @joseph-isaacs
• fix: Fix some minor typos and remove the "single-file" feature from clickbench (#4182) @AdamGS
• fix: incorrect decimal scalar nbytes (#4176) @lwwmanning
• fix(pyvortex): encoding-specific dispatch (#4171) @a10y
• fix[duckdb]: validity ref u64 not u8 (#4172) @joseph-isaacs
• ScalarValue operations must go via Scalar (#4152) @robert3005
• Only coerce scalar values when necessary (#4135) @robert3005

🧰 Maintenance

55 changes

• chore: Fix all rustdoc warnings and enforce no warning in CI (#4261) @AdamGS
• fix(deps): update dependency org.junit.jupiter:junit-jupiter to v5.13.4 (#4260) @renovate[bot]
• chore[vortex-expr]: folder docs (#4238) @joseph-isaacs
• fix(deps): update dependency ch.qos.logback:logback-classic to v1.5.18 (#4259) @renovate[bot]
• fix(deps): update slf4j monorepo to v2.0.17 (patch) (#4258) @renovate[bot]
• fix(deps): update dependency org.junit.jupiter:junit-jupiter to v5.10.5 (#4257) @renovate[bot]
• chore: Add docs to vortex-expr (#4253) @AdamGS
• chore(deps): update rust crate cc to v1.2.33 (#4256) @renovate[bot]
• chore[fastlanes]: remove FoR unsigned transmute (#4252) @joseph-isaacs
• chore(deps): update plugin com.gradleup.shadow to v9.0.2 (#4249) @renovate[bot]
• fix(deps): update protobuf monorepo to v4.32.0 (minor) (#4248) @renovate[bot]
• chore(deps): update rust crate arbitrary to v1.4.2 (#4247) @renovate[bot]
• chore(deps): update rust crate async-trait to v0.1.89 (#4245) @renovate[bot]
• chore[vortex-array]: facilitate third-party ToArrowKernel implementations (#4237) @asubiotto
• chore: Allow coveralls step to fail in CI without failing the job (#4240) @AdamGS
• chore: speed up the benchmark page loading (#4235) @a10y
• docs: fill in missing javadoc (#4233) @a10y
• chore: expand runend decompress benchmarks (#4228) @0ax1
• fix(deps): update dependency org.immutables:value to v2.11.3 (#4222) @renovate[bot]
• chore(deps): update rust crate rayon to v1.11.0 (#4223) @renovate[bot]
• chore(deps): update all patch updates (patch) (#4211) @renovate[bot]
• chore: sequential consistency in vortex-scan (#4217) @lwwmanning
• chore: add vortex-ffi example to coverage (#4210) @lwwmanning
• chore: improve test coverage in vortex-scan (#4206) @lwwmanning
• chore: Fix random-access series colours and delete dead code from benchmarking website (#4213) @robert3005
• chore: improve vortex-dtype test coverage (#4204) @lwwmanning
• chore(deps): update all patch updates (patch) (#4205) @renovate[bot]
• chore(deps): update rust crate clap to v4.5.44 (#4202) @renovate[bot]
• Improve BoolArray::from_indices (#4200) @viirya
• chore[bench]: enable tpcds on label and merge (#4196) @joseph-isaacs
• chore(deps): update actions/checkout action to v5 (#4195) @renovate[bot]
• chore[bench]: enable tpcds on label and merge (#4187) @joseph-isaacs
• Remove for whom argument from SegmentSource (#4190) @gatesn
• chore(deps): update rust crate uuid to v1.18.0 (#4192) @renovate[bot]
• chore(deps): update rust crate glob to v0.3.3 (#4189) @renovate[bot]
• chore(deps): lock file maintenance (#4186) @renovate[bot]
• chore(deps): update rust crate sysinfo to 0.37.0 (#4185) @renovate[bot]
• fix(deps): update all patch updates to v1.0.168 (patch) (#4184) @renovate[bot]
• fix(deps): update all patch updates to v1.0.166 (patch) (#4183) @renovate[bot]
• chore(deps): update plugin com.gradleup.shadow to v9.0.1 (#4181) @renovate[bot]
• chore: improve vortex-mask testing (#4178) @lwwmanning
• chore(deps): update rust crate rustversion to v1.0.22 (#4179) @renovate[bot]
• build: Use Create cc to link to libc++ (#4173) @ssmccoy
• chore[bench-website]: add back tpc-ds to query_bench (#4155) @joseph-isaacs
• chore: clippy allow unreachable function (#4167) @0ax1
• chore(deps): update rust crate cc to v1.2.32 (#4166) @renovate[bot]
• fix(deps): update rust crate cxx to v1.0.165 (#4164) @renovate[bot]
• chore(deps): update all patch updates (patch) (#4163) @renovate[bot]
• chore: Bump msrv to 1.89 (#4159) @AdamGS
• chore: add CastKernel implementations for remaining array encodings (#4131) @lwwmanning
• chore: improve vortex-scalar tests, reorganize module structure (#4145) @lwwmanning
• chore: check out ddb version in ext build based on env var (#4153) @0ax1
• chore(deps): update rust crate taffy to 0.9.0 (#4154) @renovate[bot]
• chore(deps): update plugin com.gradleup.shadow to v9 (#4150) @renovate[bot]
• fix(deps): update all patch updates to v1.0.164 (patch) (#4151) @renovate[bot]