Releases: danielgafni/dagster-polars
Release v0.1.2
What's Changed
The lowest supported Dagster version is now 1.4.0.
- 🐛 fix loading multiple MultiPartitions, 📖 fix typo in Readme, ✔️ add tests for multiple Dagster versions by @danielgafni in #33
Full Changelog: v0.1.1...v0.1.2
Release v0.1.2a0
Full Changelog: v0.1.1...v0.1.2a0
Release v0.1.1
What's Changed
PolarsParquetIOManager is always using pyarrow for writes (for now).
- 🐛 fix overwriting Parquet file with empty data when saving storage metadata by @danielgafni in #30
Full Changelog: v0.1.0...v0.1.1
Release v0.1.0
What's Changed
A pretty useful feature added - writing/reading custom metadata into storage. This is different from Dagster metadata because it can be loaded outside of Dagster environment (as it's saved in the filesystem and not in Dagster's database).
PolarsParquetIOManager supports this new feature.
Also added more usage examples in docs/examples.md.
- ⭐ save/load custom metadata along the DataFrame, 📖 improve docs by @danielgafni in #27
- 📖 align docs types with actual types by @danielgafni in #28
- 📖 refactor write/read parquet metadata by @danielgafni in #29
Full Changelog: v0.0.10...v0.1.0
Release v0.0.10
What's Changed
- 🐛 make dependencies in extras optional by @danielgafni in #25
- 🐛 fix low dagster-gcp version upper bound by @danielgafni in #26
Full Changelog: v0.0.9...v0.0.10
Release v0.0.9
What's Changed
- ⚡ table sample metadata peformance improvement for wide DataFrames by @danielgafni in #24
Full Changelog: v0.0.8...v0.0.9
Release v0.0.8
What's Changed
- ⭐ add support for Optional ❓ output annotation by @danielgafni in #21
Full Changelog: v0.0.7...v0.0.8
Release v0.0.7
What's Changed
- ⭐ add support for Optional ❓ input annotation by @danielgafni in #19
- ⭐ skip loading non-existing Optional inputs by @danielgafni in #20
Full Changelog: v0.0.6...v0.0.7
Release v0.0.6
What's Changed
- ⭐ add some delta parameters to IOManager config by @danielgafni in #18
Full Changelog: v0.0.5...v0.0.6
Release v0.0.5
What's Changed
- 🗑️ remove old duplicated code by @danielgafni in #12
- 🐛 📖 fix metadata logged by
PolarsDeltaIOManagerin append mode & add docs by @danielgafni in #14 - ⭐ add
"append_row_count"metadata value logged byPolarsDeltaIOManagerin append mode by @danielgafni in #14
Full Changelog: v0.0.4...v0.0.5