Hi, right now the API only provides a single function for passing Arrow data to the Rust runtime using "SessionContext#RegisterBatch" which takes a single RecordBatch and a table name.
I want to create a table from multiple record batches though, how can I achieve this with the current API?
The only way I found was to create an in-memory parquet file, serialize the records batches into there and pass the file to the context, but that seems like an unnecessary work-around, looking the code of the RegisterBatch function, nothing would stop one from taking an array of batches?
Hi, right now the API only provides a single function for passing Arrow data to the Rust runtime using "SessionContext#RegisterBatch" which takes a single RecordBatch and a table name.
I want to create a table from multiple record batches though, how can I achieve this with the current API?
The only way I found was to create an in-memory parquet file, serialize the records batches into there and pass the file to the context, but that seems like an unnecessary work-around, looking the code of the RegisterBatch function, nothing would stop one from taking an array of batches?