I have a file that's just loads of messagepack stuff in a row, and currently i'm using an ugly hack that feeds it to the streaming unpacker's input piece by piece
could there be a way to get the position in the input buffer after an object is emitted, or to get a subbuf of the leftovers? from my work on Compress::Zstd I can say that it's valuable to have a way to find the exact place where one chunk of data ends, but the API of Data::MessagePack is probably too different. After all, Compress::Zstd requires you to feed the decompressor with more data over and over and ask "did it finish in the mean time?".
Maybe you have an idea how to make all of this work sensibly.
I have a file that's just loads of messagepack stuff in a row, and currently i'm using an ugly hack that feeds it to the streaming unpacker's input piece by piece
could there be a way to get the position in the input buffer after an object is emitted, or to get a subbuf of the leftovers? from my work on Compress::Zstd I can say that it's valuable to have a way to find the exact place where one chunk of data ends, but the API of Data::MessagePack is probably too different. After all, Compress::Zstd requires you to feed the decompressor with more data over and over and ask "did it finish in the mean time?".
Maybe you have an idea how to make all of this work sensibly.