Unable to bypass Cloudflare challenge for Quora URL #191
Description
Have you searched if there an existing feature request for this?
- I have searched the existing requests
Feature description
I’m trying to access a Quora URL, and initially the request works fine. However, after some time it starts hitting a Cloudflare challenge, and the request fails. I also tried using residential proxies and cookies, but I’m still getting the same issue.
URL: https://www.quora.com/How-long-do-you-think-it-will-be-before-America-quits-NATO
Below are the parameters I passed and the error I received.
fetcher_kwargs = {
"url": url,
"solve_cloudflare": self.solve_cloudflare,
"hide_canvas": self.hide_canvas,
"block_webrtc": self.block_webrtc,
"google_search": self.google_search,
"network_idle": self.network_idle,
"allow_webgl": self.allow_webgl,
"timeout": self.timeout,
"headless": self.headless,
"load_dom": self.load_dom,
"retries": self.retries,
"retry_delay": self.retry_delay,
"locale": self.locale or "en-US",
"page_action": cookie_extracting_action,
}
Error
[api] [2026-03-12 18:28:23] INFO: Cloudflare page didn't disappear after 10s, continuing...
[api] [2026-03-12 18:28:23] INFO: Looks like Cloudflare captcha is still present, solving again
[api] [2026-03-12 18:28:23] INFO: The turnstile version discovered is "managed"
[api] [2026-03-12 18:28:35] INFO: Cloudflare page didn't disappear after 10s, continuing...
[api] [2026-03-12 18:28:35] INFO: Looks like Cloudflare captcha is still present, solving again
[api] [2026-03-12 18:28:35] INFO: The turnstile version discovered is "managed"
[api] [2026-03-12 18:28:47] INFO: Cloudflare page didn't disappear after 10s, continuing...
[api] [2026-03-12 18:28:47] INFO: Looks like Cloudflare captcha is still present, solving again
[api] [2026-03-12 18:28:49] INFO: The turnstile version discovered is "managed"
[api] [2026-03-12 18:29:01] INFO: Cloudflare page didn't disappear after 10s, continuing...
[api] [2026-03-12 18:29:01] INFO: Looks like Cloudflare captcha is still present, solving again
[api] [2026-03-12 18:29:01] INFO: The turnstile version discovered is "managed"
[api] [2026-03-12 18:30:36] ERROR: Failed after 1 attempts: Locator.bounding_box: Timeout 90000ms exceeded.
[api] Call log:
[api] 2 × waiting for locator(".main-content p+div>div>div").last
[api]
[api] 2026-03-12 18:30:36.788 | WARNING | apps.api.src.services.quora_scraper:scrape_quora_question:774 - [QUORA] StealthyScraper failed: TimeoutError: Locator.bounding_box: Timeout 90000ms exceeded.
[api] Call log:
[api] 2 × waiting for locator(".main-content p+div>div>div").last```