Rare diseases

[Popolechien]

• Website URL: https://rarediseases.info.nih.gov/
• License: ** Public domain**
• Desired ZIM Title: Rare Diseases
• Desired ZIM Description: Rare diseases database
• Desired ZIM Icon –png (URL or attach one): n/a
• Language (ISO 639-3): eng
• Is this a MediaWiki?: no

[MrnateGeek]

Got the icon in 5 seconds
https://rarediseases.info.nih.gov/favicon.apple-touch-icon.png

[RavanJAltaie]

Recipe created
https://farm.openzim.org/recipes/rarediseases.info.nih.gov_en_all
I'll update the library link once ready

[benoit74]

I cancelled the task and disabled the recipe, it looks like we have at least three issues:

• the website has a spanish subsection, we should create two distinct ZIMs
• the website seems to have a kind of bug which is creating fake search pages "forever", e.g. when I stopped the task it was looking for https://rarediseases.info.nih.gov/diseases?search=&page=92697 (page 92697 !!! where there is only 726 pages)
• zimit is probably not the appropriate scraper, or we need to identify proper strategy because most of the website is based on the "Browse disease" page (https://rarediseases.info.nih.gov/diseases?category=&page=1&letter=&search=) and most of this page is not going to work with zimit (selecting a letter and selecting a category will not work at least)

[benoit74]

Building a custom scraper is maybe even easier than fighting with existing website. At least a first glance at the website shows that list of diseases is available as JSON: https://rarediseases.info.nih.gov/assets/diseases.trimmed.json