Unreal Engine Generative AI Support Plugin logo

Unreal Engine Generative AI Support Plugin

by prajwalshettydev

The Unreal Engine Generative AI Support Plugin allows game developers to integrate cutting-edge LLM/GenAI models without worrying about the integration layer. It currently integrates Model Control Protocol (MCP) and various LLM APIs with Unreal Engine 5.1 or higher.

View on GitHub

Last updated: N/A

What is Unreal Engine Generative AI Support Plugin?

The Unreal Engine Generative AI Support Plugin is a long-term support (LTS) plugin for various cutting-edge LLM/GenAI models, fostering a community around AI-driven game development. It includes support for OpenAI, Deepseek, Claude, Gemini, and Grok APIs and integrates Model Control Protocol (MCP) for controlling the Unreal Engine editor.

How to use Unreal Engine Generative AI Support Plugin?

To use the plugin, add it to your Unreal Engine project either as a Git submodule or through the Unreal Marketplace (coming soon). Set up API keys as environment variables or using the GenSecureKey::SetGenAIApiKeyRuntime function for packaged builds. Configure MCP by installing a client like Claude Desktop App or Cursor IDE and setting up the appropriate config JSON file. Enable the Python plugin in Unreal Engine and optionally enable AutoStart MCP server.

Key features of Unreal Engine Generative AI Support Plugin

  • LLM/GenAI API Support (OpenAI, Deepseek, Claude, Gemini, Grok)

  • Unreal MCP (Model Control Protocol) integration

  • Blueprint Auto Generation

  • Level/Scene Control for LLMs

  • Ability to run Python scripts and Console Commands

Use cases of Unreal Engine Generative AI Support Plugin

  • Spawning and controlling scene objects with AI

  • Generating blueprints, functions, and variables using LLMs

  • Creating agentic NPCs powered by OpenAI

  • Setting up new evals and ways to compare models in game battlefields

FAQ from Unreal Engine Generative AI Support Plugin

How do I set up API keys?

Set the environment variable PS_<ORGNAME> to your API key for the editor. For packaged builds, use GenSecureKey::SetGenAIApiKeyRuntime.

How do I set up MCP?

Install a client like Claude Desktop App or Cursor IDE, set up the mcp config json, install MCP[CLI], and enable the Python Editor Script Plugin in Unreal Engine.

How do I add the plugin to my project?

Add the plugin repository as a Git submodule, regenerate project files, and enable the plugin in the Unreal Editor.

What APIs are currently supported?

The plugin currently supports OpenAI, Deepseek, Claude, and Grok APIs for chat completions. Support for other APIs like Gemini and Meta AI is planned or in progress.

Is this plugin production-ready?

No, this plugin is still under rapid development and should not be used in production environments without version control.