UseScraper MCP Server
by tanevanwifferen
The UseScraper MCP Server is a TypeScript-based server that provides web scraping capabilities using the UseScraper API. It exposes a single tool 'scrape' that can extract content from web pages in various formats.
Last updated: N/A
What is UseScraper MCP Server?
The UseScraper MCP Server is a server designed to be used with a Model Context Protocol (MCP) interface, such as Claude Desktop, to provide web scraping functionality. It leverages the UseScraper API to extract content from web pages.
How to use UseScraper MCP Server?
- Install the server manually or via Smithery. 2. Configure the server in your MCP client (e.g., Claude Desktop) by adding the server config to the appropriate configuration file. 3. Use the 'scrape' tool through the MCP interface, providing the URL and desired format as arguments.
Key features of UseScraper MCP Server
Extract content from webpages
Supports multiple formats (text, html, markdown)
Optional advanced proxy for bot detection
Extract specific data using extract_object parameter
Use cases of UseScraper MCP Server
Extracting data for analysis
Gathering content for research
Populating databases with web data
Creating summaries of web pages
FAQ from UseScraper MCP Server
What is the UseScraper API key used for?
What is the UseScraper API key used for?
The UseScraper API key is used to authenticate your requests to the UseScraper API, allowing you to access its web scraping capabilities.
How do I find the path to the server?
How do I find the path to the server?
The path to the server is the location where you cloned the repository and built the server. It's the directory containing the build/index.js
file.
What formats are supported for scraping?
What formats are supported for scraping?
The server supports scraping in text, html, and markdown formats.
How do I use the advanced proxy?
How do I use the advanced proxy?
Set the advanced_proxy
parameter to true
when calling the 'scrape' tool. This will use an advanced proxy to circumvent bot detection.
How can I debug the server?
How can I debug the server?
Use the MCP Inspector by running npm run inspector
. This will provide a URL to access debugging tools in your browser.