Skip to content

[FIX][starter]Fix the missing dependency on the transform JAR in the Spark engine. #9259

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: dev
Choose a base branch
from

Conversation

Neilxzn
Copy link

@Neilxzn Neilxzn commented Apr 30, 2025

Purpose of this pull request

because of transform jar missing in spark executor env, job will fail. This patch will fix this bug
#9238

Does this PR introduce any user-facing change?

no

How was this patch tested?

test spark example pass

Check list

@github-actions github-actions bot added the core SeaTunnel core module label Apr 30, 2025
@hailin0 hailin0 requested a review from Copilot May 3, 2025 03:26
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes the missing dependency on the transform JAR in the Spark executor environment by adding the necessary import and plugin discovery call to include transform plugins.

  • Added import for SeaTunnelTransformPluginDiscovery.
  • Instantiated SeaTunnelTransformPluginDiscovery and incorporated its plugin JAR paths into the dependency list.

@hailin0
Copy link
Member

hailin0 commented May 3, 2025

Please add testcase

@Hisoka-X
Copy link
Member

Hisoka-X commented May 6, 2025

Please follow the guide to open ci on your fork repository. Thanks https://github.com/apache/seatunnel/pull/9259/checks?check_run_id=41407284853

@Hisoka-X
Copy link
Member

Hisoka-X commented May 7, 2025

Thanks @Neilxzn for update! Please rebese on dev, we can skip dead link check after rebese. Then the other ci can be trigger normally.

@Neilxzn Neilxzn force-pushed the fix/transform_jar_missing_dev branch from c17bf49 to 74a23e6 Compare May 7, 2025 03:37
@Neilxzn
Copy link
Author

Neilxzn commented May 7, 2025

Thanks @Neilxzn for update! Please rebese on dev, we can skip dead link check after rebese. Then the other ci can be trigger normally.

Done. Rebase it.

@Neilxzn Neilxzn force-pushed the fix/transform_jar_missing_dev branch from 74a23e6 to 92af07f Compare May 7, 2025 06:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core SeaTunnel core module
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants