Skip to content

The xcom sidecar container to be in the running state before we exec against it. #45772

Open
@Lechufane

Description

Apache Airflow version

main (development)

If "Other Airflow 2 version" selected, which one?

No response

What happened?

There is no guarantee that the xcom sidecar container will have been running by the time the extract_xcom is used by KPO's execute even if we wait for pod to be a "Running" state - this further means if the base container has completed before the xcom sidecar container is running, the entire operator fails because you cannot exec against a non-running container.

What you think should happen instead?

Before we exec against it, it needs to wait for the Xcom sidecar container to be in "running" state.

How to reproduce

Have a k8s cluster that can reproduce the behavior of the Xcom container not starting when the base container has been completed, and check that Xcom extraction was successful.

Operating System

Windows

Versions of Apache Airflow Providers

No response

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions