-
Notifications
You must be signed in to change notification settings - Fork 4
Iceberg refactor into a separate lakehouse connector #1249
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: oss-main
Are you sure you want to change the base?
Iceberg refactor into a separate lakehouse connector #1249
Conversation
| option(VELOX_ENABLE_AGGREGATES "Build aggregates." ON) | ||
| option(VELOX_ENABLE_HIVE_CONNECTOR "Build Hive connector." ON) | ||
| option(VELOX_ENABLE_HIVE_CONNECTOR "Build the Hive connector." ON) | ||
| #option(VELOX_ENABLE_HIVE_NEW_CONNECTOR "Build the new Hive connector." ON) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Remove the unused lines
| # See the License for the specific language governing permissions and | ||
| # limitations under the License. | ||
|
|
||
| #if(${VELOX_BUILD_TESTING}) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can the tests run? If yes we need to uncomment this
| * See the License for the specific language governing permissions and | ||
| * limitations under the License. | ||
| */ | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The file names should not be ConnectorXXX any more. They need to be called IcebergXXX
| * See the License for the specific language governing permissions and | ||
| * limitations under the License. | ||
| */ | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Since it's already in the final leaf folder, there should not be XXXBase classes or files anymore. These Base classes shall be merged with the final classes, e.g. ConnectorConfigBase shall be merged into IcebergConfig
Moving all required classes for Iceberg into a new lakehouse connector removing dependencies on hive connector.