DatabricksWorkflowOperator do not update ACL on workflow reset #45738
Open
Description
Apache Airflow Provider(s)
databricks
Versions of Apache Airflow Providers
apache-airflow-providers-databricks==7.0.0
Apache Airflow version
2.10.4
Operating System
Linux
Deployment
Official Apache Airflow Helm Chart
Deployment details
official Helm Chart
What happened
DatabricksWorkflowOperator do not update ACL on workflow reset, this is done only during creation of workflow (Databricks API 2.0 implementation)
one more call is needed to Databricks API 2.0
What you think should happen instead
DatabricksWorkflowOperator on workflow reset should also update ACL in next api call
How to reproduce
try to modify ACL after creation of workflow
Anything else
Proposed solution:
after this line:
add this code:
if "access_control_list" in job_spec.keys():
access_control_list = {"access_control_list": job_spec["access_control_list"]}
self.log.info(
"Updating ACL of Databricks workflow job %s with spec %s",
self.job_name,
json.dumps(access_control_list, indent=2),
)
self._hook.update_job_permission(job_id, access_control_list)
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct