Web crawling is automated process where a program is browsing World Wide Web to index data from websites. Examples of web crawlers or web spiders are Googlebot, bingbot and others.
- PHPCrawl - Framework for crawling/spidering websites.
- spatie/crawler - Crawl all links found on a website.