Skip to content

Update based on new templates and add a script for future updates#93

Merged
lennartkats-db merged 5 commits intomainfrom
update-templates-with-script
Aug 25, 2025
Merged

Update based on new templates and add a script for future updates#93
lennartkats-db merged 5 commits intomainfrom
update-templates-with-script

Conversation

@lennartkats-db
Copy link
Copy Markdown
Contributor

This updates to the latest templates, adds lakeflow-pipelines-{python,sql}, and a script for future updates under scripts/`.

Reviewers, please review the script + whether references to personal addresses like lennart.kats@databricks.com are properly scrubbed.

# Extract project_name from JSON
local PROJECT_NAME=$(echo "$CONFIG_JSON" | grep -o '"project_name"[[:space:]]*:[[:space:]]*"[^"]*"' | cut -d'"' -f4)

# Use 'cli' if available, otherwise fall back to 'databricks'
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why cli?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cli might be a development build of databricks (it is on my system, at least :-o)


cd $(dirname $0)/..

init_bundle "default-python" "87d5a23e-7bc7-4f52-98ee-e374b67d5681" '{
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just to double check - it does not really matter that we reuse the same UUID here?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For future metrics purposes it might be helpful

local CONFIG_JSON="$3"

# Extract project_name from JSON
local PROJECT_NAME=$(echo "$CONFIG_JSON" | grep -o '"project_name"[[:space:]]*:[[:space:]]*"[^"]*"' | cut -d'"' -f4)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you use jq instead? It might be easier than parsing manually

@lennartkats-db lennartkats-db merged commit e7e4acf into main Aug 25, 2025
1 check passed
@lennartkats-db lennartkats-db deleted the update-templates-with-script branch August 25, 2025 09:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants