0.7.4
New
- It is now possible to use Postgres to back schedule storage by configuring
dagster_postgres.PostgresScheduleStorageon the instance. - Added the
execute_pipeline_with_modeAPI to allow executing a pipeline in test with a specific
mode without having to specifyRunConfig. - Experimental support for retries in the Celery executor.
- It is now possible to set run-level priorities for backfills run using the Celery executor by
passing--celery-base-prioritytodagster pipeline backfill. - Added the
@weeklyschedule decorator.
Deprecations
- The
dagster-gelibrary has been removed from this release due to drift from the underlying
Great Expectations implementation.
dagster-pandas
PandasColumnnow includes anis_optionalflag, replacing the previous
ColumnExistsConstraint.- You can now pass the
ignore_missing_values flagtoPandasColumnin order to apply column
constraints only to the non-missing rows in a column.
dagster-k8s
- The Helm chart now includes provision for an Ingress and for multiple Celery queues.
Documentation
- Improvements and fixes.