I'm building a project that isn't using Kalosm but I started off using readability, in part because I saw that you all were using it.
I ended up putting together a little tool to compare different HTML-to-text crates and found that readability seems to have some catastrophic misses where it fails to find the main content. It might be worth switching to something like dom_smoothie, which seems to perform better.
You can find my write-up here: https://emschwartz.me/comparing-13-rust-crates-for-extracting-text-from-html/
And the tool here: https://github.com/emschwartz/html-to-text-comparison
I'm building a project that isn't using Kalosm but I started off using
readability, in part because I saw that you all were using it.I ended up putting together a little tool to compare different HTML-to-text crates and found that
readabilityseems to have some catastrophic misses where it fails to find the main content. It might be worth switching to something likedom_smoothie, which seems to perform better.You can find my write-up here: https://emschwartz.me/comparing-13-rust-crates-for-extracting-text-from-html/
And the tool here: https://github.com/emschwartz/html-to-text-comparison