-
Notifications
You must be signed in to change notification settings - Fork 221
Open
Description
Fail to Load DAGs When a Multi-DAG YAML Contains an Import Error.
Example YAML to reproduce
default:
default_args:
start_date: 2024-11-11
basic_example_dag:
default_args:
owner: "custom_owner"
description: "this is an example dag"
schedule: "0 3 * * *"
render_template_as_native_obj: True
catchup: false
task_groups:
- group_name: "example_task_group"
tooltip: "this is an example task group"
dependencies: [task_1]
tasks:
- task_id: "task_1"
operator: airflow.providers.standard.operators.bash.BashOperator
bash_command: "echo 1"
- task_id: "task_2"
operator: airflow.providers.standard.operators.bash.BashOperator
bash_command: "echo 2"
dependencies: [task_1]
- task_id: "task_3"
operator: airflow.providers.standard.operators.bash.BashOperator
bash_command: "echo 3"
dependencies: [task_1]
task_group_name: "example_task_group"
basic_example_dag2:
default_args:
owner: "custom_owner"
description: "this is an example dag"
schedule: "0 3 * * *"
render_template_as_native_obj: True
catchup: false
task_groups:
- group_name: "example_task_group"
tooltip: "this is an example task group"
dependencies: [task_1]
tasks:
- task_id: "task_1"
operator: airflow.operators.bash.BashOperator
bash_command1: "echo 1"
- task_id: "task_2"
operator: airflow.providers.standard.operators.bash.BashOperator
bash_command: "echo 2"
dependencies: [task_1]
- task_id: "task_3"
operator: airflow.providers.standard.operators.bash.BashOperator
bash_command: "echo 3"
dependencies: [task_1]
task_group_name: "example_task_group"I suspect maybe handling exception here https://github.com/astronomer/dag-factory/blob/main/dagfactory/dagfactory.py#L235 may fix it
Metadata
Metadata
Assignees
Labels
No labels