DuckLake as a Source/Target

[Karthilearns]

Feature Request / Improvement

DuckLake is a newbie in market and is lagging on format interoperability use cases.

Should check if any support here would help users.

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[vinishjail97]

Thanks for filing the feature request @Karthilearns, is the goal to allow DuckLake readers to consume tables written by other formats, or also to write back in a way compatible with them?

[Karthilearns]

yes @vinishjail97 , just like what we support for Iceberg , Delta and Hudi.

DuckLake can be a source format from which target (Hudi , iceberg , delta) meta can be generated or it can be at the target , where XTable should write metadata for DuckLake.

Im happy to contribute if this is considered for roadmap.

Thanks.

[vinishjail97]

Yes we can support it @Karthilearns, are you familiar with the DuckLake API's for supporting ConversionSource and ConversionTarget implementations?

https://github.com/apache/incubator-xtable/blob/main/xtable-api/src/main/java/org/apache/xtable/spi/sync/ConversionTarget.java

[djouallah]

wow, that will be awesome, I create a small python package just to annoy duckdb dev :)
https://github.com/djouallah/ducklake_delta_exporter