feat: Decentralize Search Query Resolution for IPFS Wikipedia Mirror

[akhileshthite]

Currently, our search functionality depends on the centralized Wikipedia API (https://en.wikipedia.org/w/api.php) to resolve and canonicalize article titles.

Issue:
Centralized Dependency: relying on the centralized API means that if en.wikipedia.org is censored or the API goes down, our search functionality will fail, which contradicts the purpose of hosting a decentralized mirror on IPFS.

Develop and integrate a decentralized search index that works directly on our mirrored Wikipedia snapshot:
https://github.com/eja/wikilite
https://github.com/magik6k/distributed-wiki-search

We do have a fallback function. If the API fails, it will capitalize the first letter of the word in the query (and replace spaces with underscores) to form a valid URL.

[akhileshthite]

ipfs/distributed-wikipedia-mirror#148 (comment)
ipfs/distributed-wikipedia-mirror#76

[akhileshthite]

https://meta.wikimedia.org/wiki/Grants:Project/Rapid

[Sameem-baba]

Can I work on this one?

[akhileshthite]

Hi! Thanks for your interest in this issue.

This feature will require quite a bit of additional planning, especially since I’m exploring potential funding opportunities to support this work. Because of that, I’m not able to open it up for contribution just yet.

[Sameem-baba]

Thanks for the update!

I’m still interested and happy to contribute once the planning is ready.