Skip to content

WIP feat: add support for package management#190

Open
fhussonnois wants to merge 1 commit intomainfrom
feat/deps
Open

WIP feat: add support for package management#190
fhussonnois wants to merge 1 commit intomainfrom
feat/deps

Conversation

@fhussonnois
Copy link
Member

Add support for installing and managing declared Python packages on all Dbt tasks and DbtCLI

Add new task properties dependencies, pythonVersion and dependencyCacheEnabled.

Related-to: kestra-io/kestra-ee#3530

To work this PR needs to add the following to the beforeCommand:

# 1 ) Replace all shebang to use container python interpreter
for i in {{workingDir}}/.kestra_additional_python_lib/bin/*; do [ -f "$i" ] && sed -i '1s|^#!.*|#!/usr/bin/env python|' "$i"; done

# 2 ) Make all scripts executable
for i in {{workingDir}}/.kestra_additional_python_lib/bin/*; do chmod u+x $i; done

# 3 ) Add python scripts to PATH
export PATH=$PATH:{{workingDir}}/.kestra_additional_python_lib/bin/

Add support for installing and managing declared Python packages
on all Dbt tasks and DbtCLI

Add new task properties `dependencies`, `pythonVersion`
and `dependencyCacheEnabled`.

Related-to: kestra-io/kestra-ee#3530
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Status: To review

Development

Successfully merging this pull request may close these issues.

1 participant