Rust & Adbc RecordBatchReader behviour

[idosilverwater-vast]

What would you like help with?

Must a RecordBatchReader be considered closed after it returns one error? Or could a RecordBatchReader implementation choose to have recovery which allows for calling next after a previous next returned an error?

Alternatively, this question might be equivalent to asking if next returning None means "No more data" or "All data received successfully".

The only hint I found was the c definition of get_next in adbc.h that says "if no error and the array is released, the stream has ended" which means if there is one error the stream has not ended and never will.

Finally, if next returns an error and is invoked again and then returns None is that valid behavior when it means the stream ended Unsuccessfully?

thank you

[lidavidm]

I think this is mostly an arrow-rs API question but I would say an error also ends the stream. Or would recovery be useful? I'd like to learn more about the context here if possible

[idosilverwater-vast]

thanks for the reply.

there aren't too many specifics. We just wanted to be sure the driver we are writing complies with expected behavior when an error is returned and then next is invoked again.

[lidavidm]

@amoeba think this is worth clarifying in the C Data Interface?