Skip to content

DAG Run triggered ignoring one missing dataset event #56541

@GiorgosPn

Description

@GiorgosPn

Apache Airflow version

Other Airflow 2/3 version (please specify below)

If "Other Airflow 2/3 version" selected, which one?

2.10.4

What happened?

We created a DAG, scheduled with 16 different datasets. It ran properly for a couple of days, waiting for all 16 datasets to be produced. But suddenly, it was triggerred ignoring one dataset (triggered taking into account 15/16 datasets).

Image Image Image

What you think should happen instead?

The DAG should not be triggered, since only 15 out of 16 datasets were produced at that time.

How to reproduce

We cannot reproduce it, it did not happen earlier and we haven't faced it again some days later.

Operating System

Debian 12

Versions of Apache Airflow Providers

No relevant providers used

Deployment

Other Docker-based deployment

Deployment details

We use an AKS cluster in combination with customized docker image, built from the official docker image.

Anything else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:corekind:bugThis is a clearly a bugneeds-triagelabel for new issues that we didn't triage yet

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions