Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -194,6 +194,13 @@ Optionally, you can add it to a file called `.vscode/mcp.json` in your workspace
- `FIRECRAWL_RETRY_MAX_DELAY`: Maximum delay in milliseconds between retries (default: 10000)
- `FIRECRAWL_RETRY_BACKOFF_FACTOR`: Exponential backoff multiplier (default: 2)

##### Crawl Timeout Configuration

- `FIRECRAWL_CRAWL_TIMEOUT`: Maximum time in seconds to wait for a crawl job to complete (default: 120)
- Set to `0` to disable timeout and wait indefinitely (not recommended)
- Useful for self-hosted instances where crawls may take longer
- `FIRECRAWL_CRAWL_POLL_INTERVAL`: How often in seconds to check crawl job status (default: 2)

##### Credit Usage Monitoring

- `FIRECRAWL_CREDIT_WARNING_THRESHOLD`: Credit usage warning threshold (default: 1000)
Expand Down Expand Up @@ -230,6 +237,10 @@ export FIRECRAWL_API_KEY=your-api-key # If your instance requires auth
# Custom retry configuration
export FIRECRAWL_RETRY_MAX_ATTEMPTS=10
export FIRECRAWL_RETRY_INITIAL_DELAY=500 # Start with faster retries

# Crawl timeout configuration (recommended for self-hosted)
export FIRECRAWL_CRAWL_TIMEOUT=300 # 5 minutes for larger crawls
export FIRECRAWL_CRAWL_POLL_INTERVAL=5 # Check status every 5 seconds
```

### Usage with Claude Desktop
Expand Down
4 changes: 2 additions & 2 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "firecrawl-mcp",
"version": "3.6.2",
"version": "4.0.0",
"description": "MCP server for Firecrawl web scraping integration. Supports both cloud and self-hosted instances. Features include web scraping, search, batch processing, structured data extraction, and LLM-powered content analysis.",
"type": "module",
"mcpName": "io.github.firecrawl/firecrawl-mcp-server",
Expand Down
Loading