Cache all HTTP data for offline use

[RangerMauve]

Most sites don't use service workers and the such so as soon as you go offline, nothing is available if it depended on HTTP. It'd be good if Agregore cached stuff specifically for offline usage

• Set up a leveldb (or sqlite? or fs?) http cache
• Listen on requests and cache responses for GET (maybe just top level frame content without css/js even?)
• Catch network errors in requests and serve from cache
• Provide option to clear offline cache
• Use an "Least Recently Used cache" to clear old data with some sort of user config for "num saved sites", maybe default to a few thousand or based on size? If size we should be able to configure it

[akhileshthite]

https://chromewebstore.google.com/detail/kiwix-js-browser-extensio/donaljnlmapmngakoipdmehbfcioahhk
https://github.com/kiwix/kiwix-js

[RangerMauve]

Regarding Kiwix, we already have WebRecorder built in so this wouldn't add anything.

That's a good point though that we could potentially do this as a browser extension instead of doing it in native code.

We already use webRequest to track history so it should be possible to have something that listens on something like webrequest.onErrorOccured and serve from an IndexedDB backed cache.

[RangerMauve]

THis might be relevant? https://github.com/gilmoreorless/chrome-cdn-offline-proxy

[akhileshthite]

THis might be relevant? https://github.com/gilmoreorless/chrome-cdn-offline-proxy

Yep, a browser extension is a good idea.