Enable feature specific unit tests

[parthchandra]

What is the problem the feature request solves?

We have certain features which are hidden behind feature flags (e.g. hdfs). Any unit tests written in the JVM side to test these features fails if the native side is built without the feature flag.

Describe the potential solution

We could provide a function in native that can be called via JNI that returns true if a feature is enabled. Tests can call this function to see if the feature they are testing is enabled in the build

Additional context

No response

[wForget]

Maybe we can use scalatest-maven-plugin's tagsToExclude/tagsToInclude to control whether to run a test suite

[parthchandra]

@wForget I was thinking more like: #2372
I tried to run the test test("test native_datafusion scan on fake fs") and the test itself failed. Do we need a local hdfs environment for this test to run successfully?

[wForget]

@wForget I was thinking more like: #2372

Thanks, that looks good.

I tried to run the test test("test native_datafusion scan on fake fs") and the test itself failed. Do we need a local hdfs environment for this test to run successfully?

No, this is for testing non-hdfs scheme (a fake local fs), which works well with hdfs-opendal feature. For hdfs feature it seems to depend on datafusion-contrib/fs-hdfs#29 . I added a test case ParquetReadFromHdfsSuite.scala for the hdfs feature in #2350

[parthchandra]

Ok. Let me look into why the test is failing in my environment with this PR

[parthchandra]

@andygrove @wForget this is ready for review. The test referred to above passes with hdfs-opendal