WaterCrawl MCP logo

WaterCrawl MCP

by watercrawl

WaterCrawl MCP is a Model Context Protocol server that provides AI systems with web crawling, scraping, and search capabilities. It's built with FastMCP and offers a standardized interface for interacting with WaterCrawl.

View on GitHub

Last updated: N/A

What is WaterCrawl MCP?

WaterCrawl MCP is a server that acts as an interface between AI models and WaterCrawl's web crawling, scraping, and search functionalities. It uses the Model Context Protocol (MCP) to provide a standardized way for AI systems to access these capabilities.

How to use WaterCrawl MCP?

You can use WaterCrawl MCP via npx without installation, or install it globally or locally using npm. It requires an API key for authentication. Configuration can be done through command-line options or environment variables. It supports SSE mode for integration with tools like Claude Desktop. The server provides several tools accessible through the MCP interface, such as scraping URLs, performing web searches, downloading sitemaps, and managing crawl and search requests.

Key features of WaterCrawl MCP

  • Web crawling and scraping

  • Web search capabilities

  • Standardized MCP interface

  • Command-line interface

  • SSE mode for Claude Desktop integration

  • Configuration via environment variables or command-line parameters

Use cases of WaterCrawl MCP

  • Providing AI models with access to real-time web data

  • Enabling AI agents to perform web research

  • Automating data extraction from websites

  • Integrating web crawling and scraping into AI workflows

FAQ from WaterCrawl MCP

What is WaterCrawl?

WaterCrawl is a platform that provides web crawling, scraping, and search capabilities.

How do I get a WaterCrawl API key?

You need to sign up for a WaterCrawl account and obtain an API key from their platform.

What is SSE mode?

SSE (Server-Sent Events) mode allows WaterCrawl MCP to stream data to clients, such as Claude Desktop, in real-time.

Can I use WaterCrawl MCP without installing it?

Yes, you can use it directly with npx.

What are the available tools?

The available tools are scrape-url, search, download-sitemap, manage-crawl, manage-search and monitor-request.