Release v0.4.1

This release includes a few quality of life fixes. It's also tested against the latest versions of the code dependencies: Dagster 1.12, Ray 2.53, and KubeRay 1.5.

Added

• RayCluster's head pod logs are now displayed on startup timeout or failure

Fixes

• the RayCluster cleanup sensor no longer attempts to cleanup clusters with .metadata.ownerReferences field set.

• Fixed race condition with cluster sharing: previously multiple steps running in parallel could create different RayCluster instances at the same time (that were supposed to be shared). dagster-ray now uses Kubernetes Lease-based leader election to coordinate shared cluster creation, which guarantees that only one of the running steps creates the shared RayCluster.

• runtimeEnvYAML now has all strings fully quoted which fixes passing values such as 1e-5 as runtime_env values. Thanks @JosefNagelschmidt!

• ray_address is now optional for RunLauncherConfig. Thanks @cornettew!

• Prevent the RayCluster cleanup sensor from targeting clusters with .metadata.ownerReferences set.

• address config value can now be omitted for ray_executor, making it use Ray's default cluster address resolution. Thanks @cornettew!

New Contributors

• @cornettew made their first contribution in #292
• @JosefNagelschmidt made their first contribution in #297

Full Changelog: v0.4.0...v0.4.1