Skip to content

Add GCSToAzureBlobStorageOperator for GCS to Azure Blob transfer#64966

Open
yuseok89 wants to merge 9 commits intoapache:mainfrom
yuseok89:feat/gcs-to-azure-blob-operator
Open

Add GCSToAzureBlobStorageOperator for GCS to Azure Blob transfer#64966
yuseok89 wants to merge 9 commits intoapache:mainfrom
yuseok89:feat/gcs-to-azure-blob-operator

Conversation

@yuseok89
Copy link
Copy Markdown
Contributor

@yuseok89 yuseok89 commented Apr 9, 2026

Adds GCSToAzureBlobStorageOperator to copy objects from Google Cloud Storage to Azure Blob Storage.
There was no existing operator for this path (GCS → Azure Blob), so this fills that gap. The implementation follows the same overall patterns as S3ToAzureBlobStorageOperator.

Test Screenshots

Source files (GCS)

image

Default structure

image image

Flatten structure

image image
Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)
    • Cursor

  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

@yuseok89 yuseok89 force-pushed the feat/gcs-to-azure-blob-operator branch from 715aaeb to 20b3f6f Compare April 10, 2026 16:07
@kaxil kaxil requested a review from Copilot April 10, 2026 19:55
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@yuseok89 yuseok89 force-pushed the feat/gcs-to-azure-blob-operator branch from 0090bd7 to 104ab09 Compare April 11, 2026 14:54
@yuseok89 yuseok89 marked this pull request as ready for review April 12, 2026 12:31
@potiuk potiuk marked this pull request as draft April 22, 2026 18:10
@potiuk
Copy link
Copy Markdown
Member

potiuk commented Apr 22, 2026

@yuseok89 This PR has been converted to draft because it does not yet meet our Pull Request quality criteria.

Issues found:

  • Merge conflicts: this branch has conflicts with main and cannot be merged as-is. Rebase onto the current main to resolve: git fetch upstream main && git rebase upstream/main, resolve, force-push.

What to do next:

  • Rebase onto the current main to clear the merge conflicts.
  • Make sure static checks pass locally: prek run --from-ref main --stage pre-commit.
  • Mark the PR as "Ready for review" when you're done.

Converting a PR to draft is not a rejection — it is an invitation to bring the PR up to the project's standards so that maintainer review time is spent productively. There is no rush — take your time and work at your own pace. We appreciate your contribution and are happy to wait for updates. If you have questions, feel free to ask on the Airflow Slack.

@yuseok89 yuseok89 force-pushed the feat/gcs-to-azure-blob-operator branch from 49cf818 to 753db45 Compare April 24, 2026 14:00
…lob-operator

Made-with: Cursor

# Conflicts:
#	uv.lock
@yuseok89 yuseok89 force-pushed the feat/gcs-to-azure-blob-operator branch from 753db45 to 3809d5f Compare April 24, 2026 14:01
…lob-operator

Made-with: Cursor

# Conflicts:
#	uv.lock
@yuseok89 yuseok89 marked this pull request as ready for review April 25, 2026 12:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants