Skip to content

2.18.3

Choose a tag to compare

@saikonen saikonen released this 08 Sep 22:33
· 151 commits to master since this release
8dd5ed1

Features

Argo Events sensor namespace configuration

This release enables deploying the Argo sensor in its own namespace. The sensors are required when using Metaflow triggers when deploying to Argo Workflows.

The sensor namespace can be configured by either by the Metaflow config, or through an environment variable

export METAFLOW_ARGO_EVENTS_SENSOR_NAMESPACE=example

Compressing of large commands on AWS Step Functions

AWS Step Functions has a maximum size for the step command that can become a problem with complex flows. To get around this limitation, this release introduces a way to compress the command being executed by offloading it to S3 instead.

Setting the following environment variable or Metaflow config value to true will enable the feature.

export METAFLOW_SFN_COMPRESS_STATE_MACHINE=True

Improvements

Improve support for conditional steps with Argo Workflows

This release fixes an issue with conditional steps on Argo Workflows, where deployment would fail with a flow that had a conditional step where a case would not introduce its own steps, but instead skip ahead in the graph.

What's Changed

  • Make argo events sensor namespace configurable by @dhpollack in #1463
  • feat: add S3 command upload support for AWS Step Functions to handle large commands by @nlwstein in #2534
  • Patch 2025-09-08-01 fix minor typos by @myatt83 in #2591
  • Update metaflow client to accept both pathspec and _object together by @talsperre in #2590
  • fix: argo conditional skip step parsing by @saikonen in #2587
  • release: 2.18.3 by @saikonen in #2592

New Contributors

Full Changelog: 2.18.2...2.18.3