v0.1.11

[jaychia]

Changes

✨ New Features

• [FEAT] [New Query Plan] Add support for Projection and Coalesce, enable many tests @clarkzinzow ([FEAT] [New Query Plan] Add support for Projection and Coalesce, enable many tests #1256)
• [FEAT] [New Query Planner] Add support for Concat. @clarkzinzow ([FEAT] [New Query Planner] Add support for Concat. #1254)
• [FEAT] [New Query Planner] Add support for tabular writes. @clarkzinzow ([FEAT] [New Query Planner] Add support for tabular writes. #1252)
• [FEAT] Multi-partition aggregate; Coalesce @xcharleslin ([FEAT] Multi-partition aggregate; Coalesce #1249)
• [FEAT] [New Query Planner] Add support for Sort, Repartition, and Distinct in new query planner. @clarkzinzow ([FEAT] [New Query Planner] Add support for Sort, Repartition, and Distinct in new query planner. #1248)
• [FEAT] Add Azure Support for Native Downloader @samster25 ([FEAT] Add Azure Support for Native Downloader #1250)
• [FEAT] Locally unique semantic IDs for Expressions @xcharleslin ([FEAT] Locally unique semantic IDs for Expressions #1243)
• [FEAT] Read parquet tables with int96 coercion option @jaychia ([FEAT] Read parquet tables with int96 coercion option #1231)
• [FEAT] [New Query Plan] Add support for CSV scans, JSON scans, in-memory scans and caching materialized results. @clarkzinzow ([FEAT] [New Query Plan] Add support for CSV scans, JSON scans, in-memory scans and caching materialized results. #1246)
• [FEAT] Native Downloader add Retry Config parameters @samster25 ([FEAT] Native Downloader add Retry Config parameters #1244)
• [FEAT] (Single partition only) DataFrame.sum() via Rust planner @xcharleslin ([FEAT] (Single partition only) DataFrame.sum() via Rust planner #1230)
• [FEAT] [New Query Planner] Logical --> physical translation, physical plan execution. @clarkzinzow ([FEAT] [New Query Planner] Logical --> physical translation, physical plan execution. #1232)
• [FEAT] native parquet correctness checks @samster25 ([FEAT] native parquet correctness checks #1225)
• [FEAT] add session token as input to io config @samster25 ([FEAT] add session token as input to io config #1224)

🚀 Performance Improvements

• [PERF] Native Parquet Bulk Reader @samster25 ([PERF] Native Parquet Bulk Reader #1233)

👾 Bug Fixes

• [BUG] drop native-tls (openssl) for azure which was a default feature @samster25 ([BUG] drop native-tls (openssl) for azure which was a default feature #1251)
• [BUG] Fix decimal byte arrays @jaychia ([BUG] Fix decimal byte arrays #1247)
• [BUG] correct type when printing incorrect row count @samster25 ([BUG] correct type when printing incorrect row count #1226)
• [BUG] try manylinux 2 28 @samster25 ([BUG] try manylinux 2 28 #1214)
• [BUG] downgrade ray to 2.6 @samster25 ([BUG] downgrade ray to 2.6 #1212)
• [BUG] add explict target for aarch64 linux @samster25 ([BUG] add explict target for aarch64 linux #1209)
• [BUG] Fix incorrect sign bug for small decimals @xcharleslin ([BUG] Fix incorrect sign bug for small decimals #1204)
• [BUG] Set SSL paths on linux @samster25 ([BUG] Set SSL paths on linux #1203)

📖 Documentation

• [DOCS] Fix daft.read_parquet link @jaychia ([DOCS] Fix daft.read_parquet link #1228)
• [DOCS][CHORE] Add docs for IOConfig and S3Config @jaychia ([DOCS][CHORE] Add docs for IOConfig and S3Config #1227)

🧰 Maintenance

• [CHORE] Update test to only use store_schema kwarg for pa>=11 @jaychia ([CHORE] Update test to only use store_schema kwarg for pa>=11 #1253)
• [FEAT] (Single partition only) DataFrame.sum() via Rust planner @xcharleslin ([FEAT] (Single partition only) DataFrame.sum() via Rust planner #1230)
• [CHORE] [New Query Planner] Introduce LogicalPlanBuilder and QueryPlanner interfaces to hide query planner implementations. @clarkzinzow ([CHORE] [New Query Planner] Introduce LogicalPlanBuilder and QueryPlanner interfaces to hide query planner implementations. #1245)
• [CHORE] LogicalPlan: Add display improvements, and Filter @xcharleslin ([CHORE] LogicalPlan: Add display improvements, and Filter #1221)
• [CHORE] Add unit tests for int96 timestamps @jaychia ([CHORE] Add unit tests for int96 timestamps #1229)
• [DOCS][CHORE] Add docs for IOConfig and S3Config @jaychia ([DOCS][CHORE] Add docs for IOConfig and S3Config #1227)
• [CHORE] disable mac test for lack of docker @samster25 ([CHORE] disable mac test for lack of docker #1223)
• [CHORE] Begin integrating Rust Logical Plan with Dataframe API @xcharleslin ([CHORE] Begin integrating Rust Logical Plan with Dataframe API #1207)
• [CHORE] integration tests for nightly platform wheels @samster25 ([CHORE] integration tests for nightly platform wheels #1219)
• [CHORE] Remove existing LogicalPlan from all execution concepts @xcharleslin ([CHORE] Remove existing LogicalPlan from all execution concepts #1208)
• [CHORE] Add endpoints to simulate rate-limiting on AWS S3 buckets @jaychia ([CHORE] Add endpoints to simulate rate-limiting on AWS S3 buckets #1220)
• [CHORE] Add pytest marker for integration @jaychia ([CHORE] Add pytest marker for integration #1211)
• [CHORE] Add s3 fixtures for retrying logic @jaychia ([CHORE] Add s3 fixtures for retrying logic #1206)
• [CHORE] Add developer flag to use Rust query planner @xcharleslin ([CHORE] Add developer flag to use Rust query planner #1205)
• [CHORE] Rust Logical plan skeleton @xcharleslin ([CHORE] Rust Logical plan skeleton #1192)

⬆️ Dependencies

7 changes

• Bump tempfile from 3.7.0 to 3.7.1 @dependabot (Bump tempfile from 3.7.0 to 3.7.1 #1238)
• Bump ray[data,default] from 2.5.1 to 2.6.1 @dependabot (Bump ray[data,default] from 2.5.1 to 2.6.1 #1200)
• Bump numpy from 1.25.1 to 1.25.2 @dependabot (Bump numpy from 1.25.1 to 1.25.2 #1199)
• Bump tempfile from 3.6.0 to 3.7.0 @dependabot (Bump tempfile from 3.6.0 to 3.7.0 #1198)
• Bump serde_json from 1.0.103 to 1.0.104 @dependabot (Bump serde_json from 1.0.103 to 1.0.104 #1197)
• Bump num-traits from 0.2.15 to 0.2.16 @dependabot (Bump num-traits from 0.2.15 to 0.2.16 #1196)
• Bump serde from 1.0.171 to 1.0.179 @dependabot (Bump serde from 1.0.171 to 1.0.179 #1195)

---

This discussion was created from the release v0.1.11.