Skip to content

[FLINK-39312][pipeline][HUDI] Fix Hudi connector packaging to include…#4332

Open
cshuo wants to merge 2 commits intoapache:masterfrom
cshuo:FLINK-39312
Open

[FLINK-39312][pipeline][HUDI] Fix Hudi connector packaging to include…#4332
cshuo wants to merge 2 commits intoapache:masterfrom
cshuo:FLINK-39312

Conversation

@cshuo
Copy link
Contributor

@cshuo cshuo commented Mar 24, 2026

flink-metrics-dropwizard dependency

Describe the issue this Pull Request addresses

The Hudi pipeline connector declared flink-metrics-dropwizard with test scope in its module pom.xml, which restricted the dependency to test classpaths only, and leads to the failure of job, like:

Caused by: java.lang.NoClassDefFoundError: org/apache/flink/dropwizard/metrics/DropwizardMeterWrapper
at org.apache.hudi.metrics.FlinkStreamWriteMetrics.<init>(FlinkStreamWriteMetrics.java:91) 
at org.apache.hudi.sink.StreamWriteFunction.registerMetrics(StreamWriteFunction.java:457) 
at org.apache.hudi.sink.StreamWriteFunction.open(StreamWriteFunction.java:164) 

This PR removes that scope restriction so the dependency is resolved as a regular module dependency, aligning packaging/classpath behavior for non-test builds and runtime usage of the connector.

Summary and Changelog

  • Removed <scope>test</scope> from dependency org.apache.flink:flink-metrics-dropwizard:${flink.version}.
  • No logic changes; this is a dependency-scope adjustment only.

@cshuo
Copy link
Contributor Author

cshuo commented Mar 24, 2026

I found a blocking bug in hudi pipeline connector, can you help review and land. cc @lvyanquan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant