--- # GenPilot **GenPilot** streamlines the creation, development, and management of single and multi-agent systems powered by Generative AI. Adhering to the Model Context Protocol (MCP), it ensures seamless integration with a variety of MCP servers, enabling both developers and end-users to efficiently transform concepts and prototypes into fully realized solutions. All of this is facilitated through an intuitive, user-friendly terminal and web interface. ## Installation Require Python **3.10** or later. ```bash pip install genpilot ``` ## Usage The client is initialized using `litellm`. Please refer to [the guide for details on different providers](https://docs.litellm.ai/docs/providers). ```python import genpilot as gp import asyncio # 1. User Interface: Also supports Streamlit UI, allowing all agents to share the same chat interface. terminal = gp.TerminalChat() # 2. Define a Tool to search and summarize information def search_and_summarize(query): """Search for information on the internet and return a summary.""" return f"Here's the summary for '{query}': [Summarized info]." # 3. Define an Agent for summarizing search results info_explorer = gp.Agent( name="Information Explorer", model_config={ "name": "groq/llama-3.3-70b-versatile", }, chat=terminal, tools=[search_and_summarize], system=( "Your role is to search the internet and summarize relevant information for a given query. " "Use the search tool to find and condense information for the user, ensuring clarity and relevance." ), ) # 4. Run the Agent with a query response = asyncio.run(info_explorer("What's the latest news about AI advancements?")) print(response) ``` ## Why GenPilot? - **MCP Agent**: Leverage the MCP servers provided by the ecosystem to empower agents, allowing them to connect and interact within a richer, more expansive environment. - **Multi-Agent System**: Seamlessly scale from single-agent tasks to complex multi-agent workflows, inspired by [Routines and Handoffs](https://cookbook.openai.com/examples/orchestrating_agents#executing-routines). - **User-Friendly Interface**: Offers an intuitive interface for prototyping and quick implementation, whether through a web UI (Streamlit, Chainlit) or terminal. Get started quickly and effortlessly with minimal effort. - **Enhanced Autonomy**: GenPilot can internally register and invoke tools, reducing reliance on external agents and minimizing unnecessary interactions. - **Governed Actions** ![governed action](./asset/action.png) GenPilot's actions are governed by three permission levels: - **`auto`**: Permission requested only for system/environment-modifying actions - **`always`**: Permission requested for all actions - **`none`**: No permission requests - **Memory** [PROCESSING]: GenPilot enhances accuracy with customizable memory: 1. `ChatBufferMemory` A short-term memory solution designed to retrieve the most recent message along with the current session context. 2. `ChatVectorMemory` A long-term memory implementation based on LlamaIndex [vector memory](https://docs.llamaindex.ai/en/stable/examples/agent/memory/vector_memory/). > [MemGPT: Towards LLMs as Operating Systems](https://arxiv.org/pdf/2310.08560) > [CLIN: A CONTINUALLY LEARNING LANGUAGE AGENT FOR RAPID TASK ADAPTATION AND GENERALIZATION](https://arxiv.org/pdf/2310.10134) 3. `ChatPgMemory` ... - **RAG Support**: GenPilot integrates a retrieval agent that allows local resource or knowledge integration into the multi-agent system. The default implementation leverages LlamaIndex's [ChatEngine](https://docs.llamaindex.ai/en/stable/examples/chat_engine/chat_engine_best/). - **Typed Prompt and Auto Optimizer** - https://github.com/stanfordnlp/dspy - https://github.com/zou-group/textgrad ### Samples

This demo provides advice on what to wear when traveling to a city

[![Watch the demo](https://asciinema.org/a/686709.svg)](https://asciinema.org/a/686709)

This demo uses multi-agent troubleshooting for issues in RedHat ACM

#### Cluster Unknown [![Watch the demo](https://asciinema.org/a/687993.svg)](https://asciinema.org/a/687993) #### Addons Aren't Created [![Watch the demo](https://asciinema.org/a/689439.svg)](https://asciinema.org/a/689439)

generative AI

GenPilot