Skip to content

Conversation

devin-ai-integration[bot]
Copy link
Contributor

This PR updates the json_to_dbt_sources.py script to accept an Airbyte catalog as input while maintaining the existing functionality. The script can now parse the catalog's streams collection for tables and schemas.

The code has been refactored to improve reuse with a core function that processes JSON schemas.

Link to Devin run: https://app.devin.ai/sessions/75499e65fba64f99ab0afe3a93f36d15

…at processes JSON schemas.

Co-Authored-By: Aaron <AJ> Steers <[email protected]>
Copy link
Contributor Author

🤖 Devin AI Engineer

Original prompt from Aaron:

@Devin - Update the morph script that generates dbt source.yml files - and change it so that it can accept an Airbyte catalog instead of a list of files. Keep the old capability, but allow the caller of the script to give you a json file that contains a valid airbyte catalog. Then, parse the catalog's `streams` collection for the list of tables and their schemas.

Test the capability against the catalog.json file that I just put into the repo in the catalog/hubspot/airbyte-source directory

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add "(aside)" to your comment to have me ignore it.
  • Look at CI failures and help fix them

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

@aaronsteers aaronsteers merged commit 228cbdd into main Mar 12, 2025
9 checks passed
@aaronsteers aaronsteers deleted the devin/1741811538-update-morph-script branch March 12, 2025 20:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant