Firecrawl MCP Server
by mendableai
Firecrawl MCP Server is a Model Context Protocol (MCP) server implementation that integrates with Firecrawl for web scraping capabilities. It provides tools for scraping, crawling, searching, extracting, and deep research on the web.
Last updated: N/A
What is Firecrawl MCP Server?
The Firecrawl MCP Server is an implementation of the Model Context Protocol that leverages Firecrawl's web scraping technology. It allows users to perform various web-related tasks such as scraping content from websites, crawling for URLs, searching the web, extracting structured information, and conducting deep research using LLMs.
How to use Firecrawl MCP Server?
To use the Firecrawl MCP Server, you can install it using npm or npx and configure it with your Firecrawl API key. You can then integrate it with tools like Cursor, Windsurf, or Claude Desktop by providing the necessary configuration details. The server exposes several tools that can be called with specific arguments to perform web scraping and data extraction tasks.
Key features of Firecrawl MCP Server
Scrape, crawl, search, extract, deep research and batch scrape support
Web scraping with JS rendering
URL discovery and crawling
Web search with content extraction
Automatic retries with exponential backoff
Efficient batch processing with built-in rate limiting
Credit usage monitoring for cloud API
Comprehensive logging system
Support for cloud and self-hosted Firecrawl instances
Mobile/Desktop viewport support
Smart content filtering with tag inclusion/exclusion
Use cases of Firecrawl MCP Server
Automated data extraction from websites
Web crawling for research purposes
Content aggregation and analysis
Lead generation and market research
Building AI applications that require web data
FAQ from Firecrawl MCP Server
What is the Model Context Protocol (MCP)?
What is the Model Context Protocol (MCP)?
MCP is a protocol that allows models to access external context, such as web data, to improve their performance.
Do I need a Firecrawl API key to use this server?
Do I need a Firecrawl API key to use this server?
Yes, a Firecrawl API key is required when using the cloud API. However, it's optional when using a self-hosted Firecrawl instance with FIRECRAWL_API_URL
.
How do I configure the server for a self-hosted Firecrawl instance?
How do I configure the server for a self-hosted Firecrawl instance?
Set the FIRECRAWL_API_URL
environment variable to the URL of your self-hosted instance.
How do I monitor credit usage?
How do I monitor credit usage?
The server provides credit usage monitoring with configurable warning and critical thresholds. Set the FIRECRAWL_CREDIT_WARNING_THRESHOLD
and FIRECRAWL_CREDIT_CRITICAL_THRESHOLD
environment variables.
What tools are available in the server?
What tools are available in the server?
The server includes tools for scraping, batch scraping, checking batch status, searching, crawling, extracting data using LLMs, conducting deep research, and generating llms.txt files.