UseScraper MCP Server logo

UseScraper MCP Server

by tanevanwifferen

The UseScraper MCP Server is a TypeScript-based server that provides web scraping capabilities using the UseScraper API. It exposes a single tool 'scrape' that can extract content from web pages in various formats.

View on GitHub

Last updated: N/A

What is UseScraper MCP Server?

The UseScraper MCP Server is a server designed to be used with a Model Context Protocol (MCP) interface, such as Claude Desktop, to provide web scraping functionality. It leverages the UseScraper API to extract content from web pages.

How to use UseScraper MCP Server?

  1. Install the server manually or via Smithery. 2. Configure the server in your MCP client (e.g., Claude Desktop) by adding the server config to the appropriate configuration file. 3. Use the 'scrape' tool through the MCP interface, providing the URL and desired format as arguments.

Key features of UseScraper MCP Server

  • Extract content from webpages

  • Supports multiple formats (text, html, markdown)

  • Optional advanced proxy for bot detection

  • Extract specific data using extract_object parameter

Use cases of UseScraper MCP Server

  • Extracting data for analysis

  • Gathering content for research

  • Populating databases with web data

  • Creating summaries of web pages

FAQ from UseScraper MCP Server

What is the UseScraper API key used for?

The UseScraper API key is used to authenticate your requests to the UseScraper API, allowing you to access its web scraping capabilities.

How do I find the path to the server?

The path to the server is the location where you cloned the repository and built the server. It's the directory containing the build/index.js file.

What formats are supported for scraping?

The server supports scraping in text, html, and markdown formats.

How do I use the advanced proxy?

Set the advanced_proxy parameter to true when calling the 'scrape' tool. This will use an advanced proxy to circumvent bot detection.

How can I debug the server?

Use the MCP Inspector by running npm run inspector. This will provide a URL to access debugging tools in your browser.