Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/workflows/auto-upgrade-certified-connectors-cdk.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:
- name: List certified connectors
id: list-connectors
run: |
json_array=$(tools/bin/bulk-cdk-auto-upgrade/list-connectors-to-upgrade.sh)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changed where the script lives since it is now being used not only in the auto-upgrade context

json_array=$(tools/bin/bulk-cdk/get-certified-connectors.sh)
echo "connectors=$json_array" >> $GITHUB_OUTPUT
echo "Found bulk CDK connectors to upgrade: $json_array"

Expand Down Expand Up @@ -107,7 +107,7 @@ jobs:
if: steps.check-changes.outputs.has_changes == 'true'
run: |
set -euo pipefail
new_version=$(tools/bin/bulk-cdk-auto-upgrade/bump-connector-metadata.sh "${{ matrix.connector }}")
new_version=$(tools/bin/bulk-cdk/auto-upgrade/bump-connector-metadata.sh "${{ matrix.connector }}")
echo "Updated dockerImageTag to $new_version"
echo "new_version=$new_version" >> $GITHUB_OUTPUT

Expand Down Expand Up @@ -141,7 +141,7 @@ jobs:
if: steps.check-changes.outputs.has_changes == 'true' && inputs.repositories != 'airbyte-enterprise'
run: |
set -euo pipefail
tools/bin/bulk-cdk-auto-upgrade/populate-connector-changelog.sh \
tools/bin/bulk-cdk/auto-upgrade/populate-connector-changelog.sh \
"${{ matrix.connector }}" \
"${{ steps.bump-version.outputs.new_version }}" \
"${{ steps.create-pr.outputs.pull-request-number }}" \
Expand Down
27 changes: 8 additions & 19 deletions .github/workflows/cdk-connector-compatibility-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,28 +14,16 @@ jobs:
runs-on: ubuntu-24.04
steps:
- name: Checkout Airbyte
uses: actions/checkout@08eba0b27e820071cde6df949e0beb9ba4906955 # v4.3.0
with:
submodules: true # Needed for airbyte-enterprise connectors (no-op otherwise)
fetch-depth: 0
Copy link
Contributor Author

@jpefaur jpefaur Oct 10, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we need this now since we are not using a git diff to know which connectors changed


- name: Setup Java
uses: actions/setup-java@c5195efecf7bdfc987ee8bae7a71cb8b11521c00 # v4.7.1
uses: actions/checkout@08eba0b27e820071cde6df949e0beb9ba4906955 # v4
with:
distribution: "zulu"
java-version: "21"
submodules: true # Needed for when airbyte-enterprise calls this workflow

- name: Setup Gradle
uses: gradle/actions/setup-gradle@748248ddd2a24f49513d8f472f81c3a07d4d50e1 # v4.4.4
with:
gradle-version: "8.14"

- name: Trigger changes on all connectors using bulk cdk # this is just an easy way to get a list of all bulk cdk connectors
run: ./gradlew upgradeCdk --cdkVersion=local
- name: Install yq
run: sudo snap install yq

- name: Generate Connector Matrix from Changes
- name: Generate Connector Matrix
id: generate-matrix
run: echo "connectors_matrix=$(./poe-tasks/get-modified-connectors.sh --json --local-cdk)" | tee -a $GITHUB_OUTPUT
run: echo "connectors_matrix=$(tools/bin/bulk-cdk/get-certified-connectors.sh)" | tee -a $GITHUB_OUTPUT
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

reuse auto bump script


outputs:
connectors-matrix: ${{ steps.generate-matrix.outputs.connectors_matrix }}
Expand All @@ -50,7 +38,8 @@ jobs:
DD_TAGS: "connector.name:${{ matrix.connector }}"

strategy:
matrix: ${{ fromJson(needs.generate-matrix.outputs.connectors-matrix) }}
matrix:
connector: ${{ fromJson(needs.generate-matrix.outputs.connectors-matrix) }}
max-parallel: 5 # Limit number of parallel jobs
fail-fast: false # Don't stop on first failure
steps:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ set -euo pipefail

# Performs a patch version bump in the metadata.yaml of the given connector.
# Prints the new version number.
# Usage: tools/bin/bulk-cdk-auto-upgrade/bump-connector-metadata.sh destination-dev-null
# Usage: tools/bin/bulk-cdk/auto-upgrade/bump-connector-metadata.sh destination-dev-null

connector_name=$1

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
set -euo pipefail

# Adds a new changelog entry for the given connector.
# Usage: tools/bin/bulk-cdk-auto-upgrade/populate-connector-changelog.sh <connector> <new_connector_version> <pr_number> <changelog_text>
# E.g.: tools/bin/bulk-cdk-auto-upgrade/populate-connector-changelog.sh destination-dev-null 1.2.3 1234 'upgrade foo'
# Usage: tools/bin/bulk-cdk/auto-upgrade/populate-connector-changelog.sh <connector> <new_connector_version> <pr_number> <changelog_text>
# E.g.: tools/bin/bulk-cdk/auto-upgrade/populate-connector-changelog.sh destination-dev-null 1.2.3 1234 'upgrade foo'

connector_id="$1"
new_version="$2"
Expand Down
Loading