v0.5.6

[colin-ho]

What's Changed 🚀

✨ Features

• feat: support daft schema to arrow schema with metadata @Jay-ju (feat: support daft schema to arrow schema with metadata #4578)
• feat(flotilla): Flotilla progress bar @colin-ho (feat(flotilla): Flotilla progress bar #4584)
• feat: Commit write sink @colin-ho (feat: Commit write sink #4569)
• feat: resolve some unused warning @Jay-ju (feat: resolve some unused warning #4583)
• feat: Support file-based sharding @desmondcheongzx (feat: Support file-based sharding #4483)
• feat: support reading from AWS Athena @ptdtan (feat: support reading from AWS Athena #4573)
• feat: add some throttling error for tos @Jay-ju (feat: add some throttling error for tos #4563)
• feat: creates daft-ir and daft-proto @rchowell (feat: creates daft-ir and daft-proto #4539)
• feat: Add DISTINCT ON / drop_duplicates on a subset of columns @srilman (feat: Add DISTINCT ON / drop_duplicates on a subset of columns #4513)
• feat(flotilla): Make one node per physical operator @colin-ho (feat(flotilla): Make one node per physical operator #4555)

🐛 Bug Fixes

• fix: Pin optional pyspark dependency to 3.5.5 @desmondcheongzx (fix: Pin optional pyspark dependency to 3.5.5 #4596)
• fix: daft spark-connect server on windows hangs @SparkApplicationMaster (fix: daft spark-connect server on windows hangs #4581)
• fix: correct the throttle_time to fix flakey test @rchowell (fix: correct the throttle_time to fix flakey test #4579)
• fix: Fix daft.range partitioning logic @colin-ho (fix: Fix daft.range partitioning logic #4570)
• fix: Fix get_or_create_runner deadlock @colin-ho (fix: Fix get_or_create_runner deadlock #4561)
• fix: fix pypi image url @colin-ho (fix: fix pypi image url #4562)
• fix: Increase runtime stats subscriber test intervals @colin-ho (fix: Increase runtime stats subscriber test intervals #4571)
• fix: fix ray connection issues with ray:// protocol @jaychia (fix: fix ray connection issues with ray:// protocol #4567)
• fix: add missing distinct field @rchowell (fix: add missing distinct field #4558)
• fix: url download retry test io config @kevinzwang (fix: url download retry test io config #4548)

🚀 Performance

• perf: Improve efficiency of to_arrow for struct / fixed size lists @colin-ho (perf: Improve efficiency of to_arrow for struct / fixed size lists #4560)

🔧 Maintenance

• chore: Use scarf only for analytics @colin-ho (chore: Use scarf only for analytics #4595)
• chore: Update various Rust dependencies @srilman (chore: Update various Rust dependencies #4574)
• chore: improve the stability of unit test @stayrascal (chore: improve the stability of unit test #4565)

Full Changelog: v0.5.5...v0.5.6

---

This discussion was created from the release v0.5.6.