Open
Description
- randomly choose https://github.com/jxlil/scrapy-impersonate/tree/master?tab=readme-ov-file#supported-browsers ?
- be slower in the scraper?
- skip LI in job checks altogether or figure out max retries / timeout and just ignore the errors?
- pay?
- rewrite the scraper to playwright?