[KYUUBI #7369] KSHC support the PURGE TABLE

[maomaodev]

Why are the changes needed?

1. Support DROP TABLE ... PURGE syntax in KSHC, so users can explicitly purge table data.
2. Add a compatibility configuration spark.sql.kyuubi.hive.connector.dropTableAsPurgeTable (default: false) in KSHC. When set to true, DROP TABLE behaves like PURGE— data is removed immediately and HDFS Trash is bypassed (preserving the previous behavior). When set to false, DROP TABLE will move table data to the HDFS Trash instead.

How was this patch tested?

1. unit test
2. Manually test

Was this patch authored or co-authored using generative AI tooling?

no

[pan3793]

it would be great if you could add a test coverage for the newly introduced config, but this is optional if you think it's not easy to write.

[maomaodev]

it would be great if you could add a test coverage for the newly introduced config, but this is optional if you think it's not easy to write.

The newly introduced config is indeed not easy to cover with unit tests, but I tested it in my local environment and the parameter works correctly. Would you mind reviewing it again? Thanks.

1. drop table dy default, the data is actually moved to the .Trash/Current directory.

2. drop table by setting dropTableAsPurgeTable=true, the data is moved by skipping HDFS trash.

[pan3793]

please update the PR description to reflect the eventual state of this PR

[maomaodev]

please update the PR description to reflect the eventual state of this PR

updated.

[pan3793]

@maomaodev sorry, the CI stopped working due to ASF's recent change, I opened #7372 to fix it, and you need to rebase this PR after it gets merged (likely tomorrow). Apologies for the inconvenience.

[pan3793]

@maomaodev I merged #7372, could you please rebase master to trigger the CI?

[maomaodev]

@maomaodev I merged #7372, could you please rebase master to trigger the CI?

done

[pan3793]

thanks, merging to master

[maomaodev]

thanks, merging to master

Thanks for the quick review and merge!