idea: Integrate with substrait to avoid expr transform

[Xuanwo]

Substrait has a duckdb extension too at https://github.com/substrait-io/duckdb-substrait-extension

Maybe we can integrate with substrait to avoid expr transform

[iceboundrock]

I’m interested in working on this issue, but before I start, could you please let me know what the acceptance certificate looks like and what the expected performance and correctness characteristics are? Thanks!

[Xuanwo]

Technically, we can pass Substrait bytes directly between DuckDB and Lance, so we don't need to build our own expression. However, the problem is that it's a bit difficult for us to use the existing DuckDB-Substrait extension. I think we need to figure out how to collaborate between our teams.