I'm submitting a:

• bug report
• feature request

Description:

Include results from other trusted sites for a search term in addition to our current results.

To begin with, we may consider the following trusted sites:

• Wikipedia
• Tutorialspoint
• Stackoverflow

To fetch results, we may use create a crawler to crawl trusted sites or scrape the data from a search engine.

You may fetch a few of the top results from a search engine like Google. For a specific site, use search terms like linear search site:wikipedia.org. The number of results should vary for various sites. For instance, we can provide 1 Wikipedia result, 2 Tutorialspoint result and 4 StackOverflow results. This approach will have limitations so, we can cache results to avoid unnecessary scraping.

The ideal cached results may include the url and the metadata to enable further searches. Implementing this will include a scraping code to present results to users during searching.

Caching can be taken care of in a separate feature. For caching, a separate script can be used to collect results for a set of keywords and store it in a database. Additionally, searching should include our cached results as well.

This feature will make Cosmos-Search more usable in general and help us provide a complete learning experience. 👍