Skip to content

DatabricksWorkflowOperator do not update ACL on workflow reset #45738

Open
@adamgorkaextbi

Description

Apache Airflow Provider(s)

databricks

Versions of Apache Airflow Providers

apache-airflow-providers-databricks==7.0.0

Apache Airflow version

2.10.4

Operating System

Linux

Deployment

Official Apache Airflow Helm Chart

Deployment details

official Helm Chart

What happened

DatabricksWorkflowOperator do not update ACL on workflow reset, this is done only during creation of workflow (Databricks API 2.0 implementation)
one more call is needed to Databricks API 2.0

What you think should happen instead

DatabricksWorkflowOperator on workflow reset should also update ACL in next api call

How to reproduce

try to modify ACL after creation of workflow

Anything else

Proposed solution:
after this line:


add this code:

            if "access_control_list" in job_spec.keys():
                access_control_list = {"access_control_list": job_spec["access_control_list"]}
                self.log.info(
                    "Updating ACL of Databricks workflow job %s with spec %s",
                    self.job_name,
                    json.dumps(access_control_list, indent=2),
                )
                self._hook.update_job_permission(job_id, access_control_list)

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions