[Feedback wanted]: streamedQuery

[TkDodo]

We’ve recently released a new API to support streaming through AsyncIterables. You can read about that in the docs here, and we also have an example set-up here.

Since the API is currently marked as experimental, we would value your feedback if you can build the things you want to build with that API. Note that it’s not experimental because it “doesn’t work”, it’s merely marked as experimental so that we can adapt the API to your needs without releasing a new major version.

So please let us know if you’ve worked with the streamedQuery helper, if you like it, if there’s something missing etc. This will help us mark it as stable sooner. Thank you 🙏

[justmoon]

I'm working on a project where I want to sync server and client state. Here is my feedback on streamedQuery:

• Thank you so much for working on this feature. I think this is a common use case and currently whenever I want to do any kind of real-time data, I end up re-implementing parts of Tanstack Query. So I would very much love this to be supported.
• I'm using a reducer (which takes the streamed chunks and updates an immutable state object) so the current interface of streamedQuery doesn't quite work for me. You could add a reducer parameter which defaults to a reducer which concatenates the chunks into an array.
• I'm using Tanstack Router and because streamedQuery never finishes fetching, I couldn't use ensureQueryData in the loader like I normally would. I would be nice to change it somehow such that ensureQueryData returns once the first chunk has been received.
• Connections sometimes drop - re-connecting should probably be handled by the user but it would be nice to have an example for a streamedQuery which handled re-connecting automatically.

[TkDodo]

Thanks for the feedback 👍

I'm using a reducer (which takes the streamed chunks and updates an immutable state object) so the current interface of streamedQuery doesn't quite work for me. You could add a reducer parameter which defaults to a reducer which concatenates the chunks into an array.

I’m not opposed. It’s partially why I’ve made the input to streamedQuery an object - so that we can easily add more configs. Would you like to try and add that? It might be tricky on type level 🤔

I'm using Tanstack Router and because streamedQuery never finishes fetching, I couldn't use ensureQueryData in the loader like I normally would. I would be nice to change it somehow such that ensureQueryData returns once the first chunk has been received.

Ooh that’s a good point, I’ll have to think about that. The streaming makes more sense for observers because they update automatically, not so much for imperative fetches. However, we currently don’t know “how” a fetch was triggered, so we treat them all the same.

I also think this might be necessary for useSuspenseQuery because we throw a promise, and without that I guess react would just suspend until the stream is finished, which isn’t what we’d want. Are you using suspense by any chance?

Connections sometimes drop - re-connecting should probably be handled by the user but it would be nice to have an example for a streamedQuery which handled re-connecting automatically.

Does the Promise reject if the connection drops? If so, I’d expect our retry to kick in