Low-level buffer implementation for video

[jdgriffith]

First off, incredible library! I'm really thankful a project like this exists, making it easier to work with video in the browser.

I'm curious about the interest or need for a library/feature set that provides a nice abstraction for managing an encoded buffer in the browser, specifically for use cases where an app requires more control than what MSE and the video element offer (for the most part). I'm specifically thinking of the VideoDecoder API. Building an encoded buffer from scratch, which is able to handle optimized memory-efficient decoding for specific search and seek features, is more complex than you would think.

I realize browsers have come a long way and you can mostly get by with the latest APIs offered in major browsers today. But I'm curious if this ask resonates with others who might have a unique edge case where a custom buffer is required/preferred.

[Vanilagy]

Thank you!

I'm not entirely sure what you're talking about, I assume you're talking about the buffer of future encoded chunks that you need to keep around to ensure smooth video playback. If that's what you're referring to, there is dedicated Mediabunny API planned for this! The idea is that you're able to manually specify any prefetch pattern (how far into the future packets are preloaded based on access patterns), and then of course custom eviction patterns as well.

[jdgriffith]

Yes! This is what I'm referring to.

That's great it's on the roadmap.