Firecrawl MCP Server logo

Firecrawl MCP Server

by mendableai

Firecrawl MCP Server is a Model Context Protocol (MCP) server implementation that integrates with Firecrawl for web scraping capabilities. It provides tools for scraping, crawling, searching, extracting, and deep research on the web.

View on GitHub

Last updated: N/A

What is Firecrawl MCP Server?

The Firecrawl MCP Server is an implementation of the Model Context Protocol that leverages Firecrawl's web scraping technology. It allows users to perform various web-related tasks such as scraping content from websites, crawling for URLs, searching the web, extracting structured information, and conducting deep research using LLMs.

How to use Firecrawl MCP Server?

To use the Firecrawl MCP Server, you can install it using npm or npx and configure it with your Firecrawl API key. You can then integrate it with tools like Cursor, Windsurf, or Claude Desktop by providing the necessary configuration details. The server exposes several tools that can be called with specific arguments to perform web scraping and data extraction tasks.

Key features of Firecrawl MCP Server

  • Scrape, crawl, search, extract, deep research and batch scrape support

  • Web scraping with JS rendering

  • URL discovery and crawling

  • Web search with content extraction

  • Automatic retries with exponential backoff

  • Efficient batch processing with built-in rate limiting

  • Credit usage monitoring for cloud API

  • Comprehensive logging system

  • Support for cloud and self-hosted Firecrawl instances

  • Mobile/Desktop viewport support

  • Smart content filtering with tag inclusion/exclusion

Use cases of Firecrawl MCP Server

  • Automated data extraction from websites

  • Web crawling for research purposes

  • Content aggregation and analysis

  • Lead generation and market research

  • Building AI applications that require web data

FAQ from Firecrawl MCP Server

What is the Model Context Protocol (MCP)?

MCP is a protocol that allows models to access external context, such as web data, to improve their performance.

Do I need a Firecrawl API key to use this server?

Yes, a Firecrawl API key is required when using the cloud API. However, it's optional when using a self-hosted Firecrawl instance with FIRECRAWL_API_URL.

How do I configure the server for a self-hosted Firecrawl instance?

Set the FIRECRAWL_API_URL environment variable to the URL of your self-hosted instance.

How do I monitor credit usage?

The server provides credit usage monitoring with configurable warning and critical thresholds. Set the FIRECRAWL_CREDIT_WARNING_THRESHOLD and FIRECRAWL_CREDIT_CRITICAL_THRESHOLD environment variables.

What tools are available in the server?

The server includes tools for scraping, batch scraping, checking batch status, searching, crawling, extracting data using LLMs, conducting deep research, and generating llms.txt files.