Skip to content

Release v0.4.0

Latest
Latest

Choose a tag to compare

View all tags
@danielgafni danielgafni released this 10 Oct 15:26
· 5 commits to master since this release
v0.4.0
f2fe537
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

This release introduces a new feature that is very useful in dev environments: Cluster Sharing. Cluster sharing allows reusing existing RayCluster resources created by previous Dagster steps. It's implemented for KubeRayCluster Dagster resource. This feature enables faster iteration speed and reduced infrastructure costs (at the expense of job isolation). Therefore KubeRayCluster is now recommended over KubeRayInteractiveJob for use in dev environments.

Learn more in Cluster Sharing docs.

Added

  • KubeRayCluster.cluster_sharing parameter that controls cluster sharing behavior.
  • dagster_ray.kuberay.sensors.cleanup_expired_kuberay_clusters sensor that cleans up expired clusters (both shared and non-shared). Learn more in docs.
  • dagster-ray entry now appears in the Dagster libraries list in the web UI.

Changed

  • [:bomb: breaking] - removed cleanup_kuberay_clusters_op and other associated definitions in favor of dagster_ray.kuberay.sensors.cleanup_expired_kuberay_clusters sensor that is more flexible.

Full Changelog: v0.3.1...v0.4.0

Assets 2
Loading