Skip to content

[Feature][Transform-V2] Implement StructEvolution transform for structural changes #9266

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 3 commits into
base: dev
Choose a base branch
from

Conversation

corgy-w
Copy link
Contributor

@corgy-w corgy-w commented May 5, 2025

…ctural changes

Purpose of this pull request

For details, please refer to doc

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request implements the StructEvolution transform for handling structural changes in table schemas as part of Transform‑V2.

  • Adds unit tests for validating the transform behavior.
  • Introduces a new transform factory and multi‑catalog transform class to support schema evolution.
  • Updates API classes and documentation to incorporate new constructors and methods needed for schema evolution operations.

Reviewed Changes

Copilot reviewed 12 out of 13 changed files in this pull request and generated no comments.

Show a summary per file
File Description
seatunnel-transforms-v2/src/test/java/org/apache/seatunnel/transform/structevolution/StructEvolutionTransformTest.java Adds unit tests for the StructEvolution transform.
seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/structevolution/StructEvolutionTransformFactory.java Implements the factory to produce StructEvolution transform instances.
seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/structevolution/StructEvolutionMultiCatalogTransform.java Provides multi-catalog support by delegating to the StructEvolution transform.
seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/structevolution/StructEvolutionConfig.java Introduces configuration classes and JSON aliases for schema evolution options.
Other files Updates to common transform classes and API classes for improved handling of comments, primary keys, and constraint keys; documentation updated accordingly.
Files not reviewed (1)
  • plugin-mapping.properties: Language not supported
Comments suppressed due to low confidence (1)

seatunnel-transforms-v2/src/test/java/org/apache/seatunnel/transform/structevolution/StructEvolutionTransformTest.java:204

  • [nitpick] Consider renaming the variable 'StructEvolutionTransform' to follow Java lower camel-case naming conventions (e.g., 'transform') to avoid confusion with the class name.
StructEvolutionTransform StructEvolutionTransform = new StructEvolutionTransform(config, catalogTable);

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant