Skip to content

Conversation

dossett
Copy link
Contributor

@dossett dossett commented Sep 18, 2025

A 2.0.0 release is being discussed so I took a pass at removing everything marked for deprecation in parquet-thrift. Some of the deprecations have been there for 10 years.

@dossett
Copy link
Contributor Author

dossett commented Sep 19, 2025

Some build errors I'll chase down when 2.0.0 is happening

@dossett
Copy link
Contributor Author

dossett commented Sep 19, 2025

Pushed several test fixes and removed some unneeded dependencies

String filterDesc, TBase toWrite, TBase toRead, Class<? extends TBase<?, ?>> thriftClass) throws Exception {
Configuration conf = new Configuration();
conf.set(ThriftReadSupport.THRIFT_COLUMN_FILTER_KEY, filterDesc);
conf.set(ThriftReadSupport.STRICT_THRIFT_COLUMN_FILTER_KEY, filterDesc);
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file was exclusively testing the deprecated thrift filter. I switched it to test the supported "strict" filter but could not recreate the functionality of several of the tests. This isn't really a regression in test coverage since the strict filter was not being tested at all.

@dossett
Copy link
Contributor Author

dossett commented Sep 19, 2025

Thank you for running the tests @gszadovszky , I was able to track down the problems and find some more things to remove.

@dossett dossett changed the title [TEST] [parquet-thrift] start removing things marked for deprecation [parquet-thrift] start removing things marked for deprecation Sep 22, 2025
@dossett
Copy link
Contributor Author

dossett commented Sep 22, 2025

I don't understand this build error:

Error:  Failed to execute goal com.github.siom79.japicmp:japicmp-maven-plugin:0.23.1:cmp (default) on project parquet-thrift: Execution default of goal com.github.siom79.japicmp:japicmp-maven-plugin:0.23.1:cmp failed: Could not load 'org.apache.pig.StoreFunc': org.apache.pig.StoreFunc. Please make sure that all libraries have been added to the classpath (CLASSPATH=:/home/runner/.m2/repository/com/google/code/gson/gson/2.2.4/gson-```

I don't see any references to `org.apache.pig.StoreFunc` left in the code

@dossett
Copy link
Contributor Author

dossett commented Sep 22, 2025

I think the error japicmp-maven-plugin is reporting that there are breaking changes in my PR. Which would be expected.

@gszadovszky
Copy link
Contributor

I'm not sure about this error either. But right, when we actually switch master for 2.0 development, we should disable japicmp until the first release. Or maybe it is intelligent enough to realized a major version change if we change it to 2.0.0-SNAPSHOT...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants