mcpserver.so LogoMCPFly
Submit
MCP-OS logo

MCP-OS

by giao-123-sun

AI/Development ToolsContext ManagementOrchestrationVector Retrieval

MCP-OS is a Model Context Protocol Orchestration System that manages MCPs like an operating system manages processes, loading them on demand and unloading them when idle. It aims to help large language models focus on solving tasks by efficiently managing and retrieving relevant MCPs.

View on GitHub

Last updated: N/A

What is MCP-OS?

MCP-OS is a system designed to manage Model Context Protocols (MCPs) effectively. It addresses issues like prompt bloat, connection hygiene, and resource/security concerns associated with a large number of MCP servers.

How to use MCP-OS?

  1. Clone the repository and install dependencies using npm install. 2. Build the vector index using npm run build:index. 3. Start the retriever server with npm run start:retriever. 4. Wire it into your LLM or agent by configuring the path to the retriever or calling the REST endpoint.

Key features of MCP-OS

  • Vector Retrieval of MCPs

  • Slim Prompt Template to reduce token usage

  • Pluggable Back-ends for vector storage

  • Health-Check Daemon (in progress)

  • Runtime Manager for on-demand MCP start/stop (planned)

  • Policy Sandbox for fine-grained auth, rate, cost (planned)

Use cases of MCP-OS

  • Reducing prompt length for LLMs

  • Dynamically selecting relevant MCPs for a task

  • Managing the lifecycle of MCP servers

  • Improving the security and resource utilization of MCP deployments

FAQ from MCP-OS

Retrieval quality is poor—how do I tune it?

Increase topK for higher recall. Switch to a stronger embedding model. Refine task-text normalization rules.

How do I plug in my own vector store?

Implement the VectorStore interface: src/store/yourStore.ts.

What is MCP-Retriever?

MCP-Retriever is the first phase of MCP-OS, focusing on vector search to retrieve relevant MCPs based on task descriptions.

What is the purpose of the Health-Check Daemon?

The Health-Check Daemon automatically monitors the status of MCP servers and prunes inactive or unhealthy ones.

What does the Runtime Manager do?

The Runtime Manager allows for on-demand starting and stopping of MCP servers, optimizing resource usage.