Ollama MCP Server logo

Ollama MCP Server

by rawveg

An MCP (Model Context Protocol) server for Ollama that enables seamless integration between Ollama's local LLM models and MCP-compatible applications like Claude Desktop.

View on GitHub

Last updated: N/A

What is Ollama MCP Server?

Ollama MCP Server is a Model Context Protocol (MCP) server designed to bridge Ollama's local Large Language Models (LLMs) with applications that support the MCP standard, such as Claude Desktop. It allows these applications to seamlessly interact with and utilize Ollama's models.

How to use Ollama MCP Server?

  1. Install the server either via Smithery or manually using npm.
  2. Configure your MCP-compatible application (e.g., Claude Desktop) to use the Ollama MCP Server by adding the server's configuration to the application's MCP settings file.
  3. Start the server using the ollama-mcp command. You can optionally specify a port using the PORT environment variable.

Key features of Ollama MCP Server

  • List available Ollama models

  • Pull new models from Ollama

  • Chat with models using Ollama's chat API

  • Get detailed model information

  • Automatic port management

  • Environment variable configuration

Use cases of Ollama MCP Server

  • Integrating Ollama models with Claude Desktop for enhanced local LLM capabilities.

  • Enabling other MCP-compatible applications to access and utilize Ollama's LLMs.

  • Providing a standardized interface for interacting with Ollama models within different applications.

  • Facilitating local LLM development and experimentation with MCP support.

FAQ from Ollama MCP Server

What is MCP?

MCP stands for Model Context Protocol, a standard for communication between applications and LLM servers.

What is Ollama?

Ollama is a tool that allows you to run open-source large language models locally.

How do I change the server port?

Use the PORT environment variable when starting the server (e.g., PORT=3457 ollama-mcp).

What is the default Ollama API endpoint?

The default Ollama API endpoint is http://localhost:11434. You can change it using the OLLAMA_API environment variable.

Where can I find the Claude Desktop MCP settings file?

The Claude Desktop MCP settings file is located at claude_desktop_config.json in the Claude app data directory.