MCP-RSS-Crawler
by mshk
MCP-RSS-Crawler is an MCP (Message Chain Protocol) server designed to fetch RSS feeds and share them with LLMs. It enables LLMs to access and utilize the latest information from RSS feeds.
Last updated: N/A
What is MCP-RSS-Crawler?
MCP-RSS-Crawler is a server that fetches RSS feeds and exposes them to Large Language Models (LLMs) via the Message Chain Protocol (MCP). It provides a way for LLMs to stay up-to-date with information from various RSS sources.
How to use MCP-RSS-Crawler?
To use MCP-RSS-Crawler, clone the repository, configure the claude_desktop_config.json file with your settings (including the Firecrawl API key), install dependencies using bun install, and start Claude Desktop or another MCP client. The server then exposes an MCP endpoint that accepts POST requests with a JSON body containing a messages array, returning a response with the latest feed items.
Key features of MCP-RSS-Crawler
Fetching and caching of RSS feeds (SQLite database)
MCP protocol implementation for seamless LLM integration
Support for filtering feeds by category, source, or keywords
Comprehensive API endpoints for feed management (add, update, delete feeds)
Support for fetching articles from Firecrawl
Use cases of MCP-RSS-Crawler
Providing LLMs with real-time news updates from specified sources
Enabling LLMs to answer questions based on the latest RSS feed content
Integrating RSS feeds into LLM-powered workflows and applications
Creating personalized news feeds for LLMs based on user preferences
FAQ from MCP-RSS-Crawler
What is the Message Chain Protocol (MCP)?
What is the Message Chain Protocol (MCP)?
MCP is a protocol that allows LLMs to access external data sources and tools.
What is Firecrawl?
What is Firecrawl?
Firecrawl is a service used to fetch articles, and an API key is required.
How do I configure the server?
How do I configure the server?
The server is configured through environment variables or a .env file, including the port, Firecrawl API key, and database directory.
What if I have connection issues?
What if I have connection issues?
Check your network settings and firewall configuration. Logs are available in the console to diagnose problems.
How do I enable more detailed logging?
How do I enable more detailed logging?
Set the DEBUG=mcp-rss:* environment variable.