Support for "Firecrawl Simple" as a data source

[zolgear]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:)
• Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I'm trying to crawl intranet websites using Dify + Firecrawl in a self-hosted setup. However, due to issues on both the Dify and Firecrawl sides (e.g., no way to adjust timeouts), crawling is effectively not working.

In contrast, a fork called [Firecrawl Simple](https://github.com/devflowinc/firecrawl-simple) performs fast and reliably, even in self-hosted environments.

Currently, Firecrawl Simple cannot be used out-of-the-box with Dify, because the FirecrawlAuth class does not support some required JSON parameters when adding a provider. Code changes are needed to make it work.

dify/api/services/auth/firecrawl/firecrawl.py

Lines 20 to 28 in 5a6219c

	def validate_credentials(self):
	headers = self._prepare_headers()
	options = {
	"url": "https://example.com",
	"includePaths": [],
	"excludePaths": [],
	"limit": 1,
	"scrapeOptions": {"onlyMainContent": True},
	}

Would there be interest in supporting Firecrawl Simple for self-hosted use?

2. Additional context or comments

No response

3. Can you help us with this feature?

• I am interested in contributing to this feature.