Can I use this project as a library instead of an extension?

[Xuanwo]

Hi, thank you for creating this project! I’m currently working on building a Lance extension for DuckDB at https://github.com/lance-format/lance-duckdb and feel that Substrait can help address several issues related to pushdown.

As it stands, Lance supports Substrait, but the only missing piece is that DuckDB needs to process Substrait in bytes. Based on what I understand, this functionality has already been implemented in this repository. However, this repo is built solely as an extension, which means I can’t directly use the existing logic.

Would it be possible to adapt this project so it can be used in other extensions?

[EpsilonPrime]

You should be able to use other extensions when constructing another extension. For instance, this extension requires iceberg which itself requires avro.

[EpsilonPrime]

The code isn't tied together strongly to do that (here's the only place where iceberg is referenced and you'll note the lack of header files):

duckdb-substrait-extension/src/from_substrait.cpp

Line 805 in 501d558

scan_rel = make_shared_ptr<TableFunctionRelation>(context, "iceberg_scan", parameters,

There might be a need for additional code to make it work for your case.