v0.2.30

[samster25]

Changes

✨ New Features

• [FEAT] Decouple pipeline building and running from new executor @colin-ho ([FEAT] Decouple pipeline building and running from new executor #2522)
• [FEAT] Add concat to new execution model + buffered intermediate ops @colin-ho ([FEAT] Add concat to new execution model + buffered intermediate ops #2519)
• [FEAT] Math Ops for FixedSizeList / FixedShapeTensor / Embedding Type @samster25 ([FEAT] Math Ops for FixedSizeList / FixedShapeTensor / Embedding Type #2507)
• [FEAT] adding transform functionality @otacilio-psf ([FEAT] adding transform functionality #2498)
• [FEAT] List chunk expression @desmondcheongzx ([FEAT] List chunk expression #2491)
• [FEAT] Refactors and agg improvements for new local execution model @colin-ho ([FEAT] Refactors and agg improvements for new local execution model #2497)
• [FEAT]: dyn function registry @universalmind303 ([FEAT]: dyn function registry #2466)
• [FEAT] New Local Execution Model @colin-ho ([FEAT] New Local Execution Model #2437)
• [FEAT] Implement hashing and groupby on lists @vince7778 ([FEAT] Implement hashing and groupby on lists #2464)
• [FEAT] Add upload functionality to binary columns @jaychia ([FEAT] Add upload functionality to binary columns #2461)
• [FEAT] List slice expression @desmondcheongzx ([FEAT] List slice expression #2479)
• [FEAT] add bit shift functions @murex971 ([FEAT] add bit shift functions #2453)
• [FEAT] Implements trigonometry expressions: arctanh arccosh arcsinh @fedemagnani ([FEAT] Implements trigonometry expressions: arctanh arccosh arcsinh #2476)
• [FEAT] Microsoft Fabric support in AzureConfig @kevinzwang ([FEAT] Microsoft Fabric support in AzureConfig #2465)

🚀 Performance Improvements

• [PERF]: dont read parquet metadata multiple times @universalmind303 ([PERF]: dont read parquet metadata multiple times #2358)
• [PERF] Local Execution Plan @samster25 ([PERF] Local Execution Plan #2489)
• [PERF] Optimize string normalization @vince7778 ([PERF] Optimize string normalization #2474)

👾 Bug Fixes

• [BUG] merge conflict for python catalog scan task @samster25 ([BUG] merge conflict for python catalog scan task #2517)
• [BUG] Add retries for write timeout errors @mauriceweber ([BUG] Add retries for write timeout errors #2508)
• [BUG] Use Daft s3 credentials chain for deltalake reads @jaychia ([BUG] Use Daft s3 credentials chain for deltalake reads #2486)
• [BUG] Support delta-rs version >0.17.4 in deltalake writes @jaychia ([BUG] Support delta-rs version >0.17.4 in deltalake writes #2488)
• [BUG] Fix anti-join on different column names @vince7778 ([BUG] Fix anti-join on different column names #2477)

📖 Documentation

• [FEAT] adding transform functionality @otacilio-psf ([FEAT] adding transform functionality #2498)
• [DOCS] Tutorial: FOTW data access @avriiil ([DOCS] Tutorial: FOTW data access #2384)
• [FEAT] List chunk expression @desmondcheongzx ([FEAT] List chunk expression #2491)
• [DOCS] Enhance Dataframe / Expressions examples @sunaysanghani ([DOCS] Enhance Dataframe / Expressions examples #2360)
• [FEAT] add bit shift functions @murex971 ([FEAT] add bit shift functions #2453)
• [FEAT] Implements trigonometry expressions: arctanh arccosh arcsinh @fedemagnani ([FEAT] Implements trigonometry expressions: arctanh arccosh arcsinh #2476)
• [DOCS] Adds RunLLM widget @vsreekanti ([DOCS] Adds RunLLM widget #2462)
• [DOCS] Fix broken example URL @kevinzwang ([DOCS] Fix broken example URL #2467)
• [FEAT] Microsoft Fabric support in AzureConfig @kevinzwang ([FEAT] Microsoft Fabric support in AzureConfig #2465)
• [DOCS] Remove unsupported map get doc example @kevinzwang ([DOCS] Remove unsupported map get doc example #2452)

🧰 Maintenance

• [CHORE] remove tokio-stream as dep @samster25 ([CHORE] remove tokio-stream as dep #2521)
• [CHORE] drop unused deps and add machete CI check @samster25 ([CHORE] drop unused deps and add machete CI check #2520)
• [CHORE] fix incremental builds with vscode rust analyzer @samster25 ([CHORE] fix incremental builds with vscode rust analyzer #2515)
• [CHORE] Disable Python as default feature and have maturin enable it by default @samster25 ([CHORE] Disable Python as default feature and have maturin enable it by default #2516)
• [CHORE]: remove daft-core from daft-io @universalmind303 ([CHORE]: remove daft-core from daft-io #2513)
• [CHORE]: move uri functions to new "daft-functions" crate @universalmind303 ([CHORE]: move uri functions to new "daft-functions" crate #2501)
• [CHORE] Add better typing for class UDFs @jaychia ([CHORE] Add better typing for class UDFs #2388)
• [CHORE] Add a helpful message in build-artifact-s3 workflow @jaychia ([CHORE] Add a helpful message in build-artifact-s3 workflow #2480)

---

This discussion was created from the release v0.2.30.