AgentUX
v3.0.0AI-powered Unreal Editor control. Give your AI the ability to control the editor and understand the engine internals, something no AI model can do out of the box.
What is AgentUX?
AgentUX is a UE 5.6+ editor plugin that exposes the Unreal Editor as a JSON-RPC 2.0 API over WebSocket. It supports UE 5.6.0 through 5.7.x, with full functionality on 5.7+ and core features (403+ methods) on 5.6. It ships with an optional knowledge base, UE-GraphRAG, built from the actual UE source code across more than 27 releases.
Together, they give your AI the ability to control the editor and understand the engine internals. Both capabilities are exposed to Claude Code as MCP tools. Access is currently limited to Claude Code for focus on the power and value of leveraging the Pro and Max plans for development.
AgentUX can interact with Claude Code using your Pro or Max plan allotment until it reaches the hourly limits. If you need to continue, you can then switch to API based queries and continue. Or, wait until the allotment renews a few hours later and then resume work. The system will indicate which mode you are using and track API costs over time if in that mode.
Editor Control
558 JSON-RPC methods over WebSocket. Spawn actors, edit materials, control Sequencer, manipulate Blueprints, manage assets, and more. All operations are undo-able.
Required (core)Safety Guards
Two-layer crash prevention. Hardcoded guards block unsafe operations (saving during PIE, modifying dying actors). Every error includes actionable remediation for self-correction.
Built-in (always active)Engine Knowledge
19.1M+ indexed source nodes across 27 UE5 releases. Your AI verifies exact property names, function signatures, and class hierarchies before writing code. No hallucinated APIs.
Optional (recommended)Handler Coverage
AgentUX organizes its 558+ methods across 38 specialized handlers covering every major editor subsystem:
| Handler | Namespace | Methods |
|---|---|---|
| Blueprint | editor.blueprint | 90 |
| PCG | editor.pcg | 88 |
| Sequencer | editor.sequencer | 27 |
| Animation | editor.animation | 20 |
| Material | editor.material | 19 |
| Asset | editor.asset | 15 |
| Landscape | editor.landscape | 14 |
| Layers | editor.layers | 13 |
| + 27 more handlers | 186 | |
See the API Reference for complete method documentation across all 38 handlers.
Get Started
Quick Start
From zero to AI-controlled editor in under 10 minutes.
Installation
Detailed setup for plugin, MCP bridge, and optional GraphRAG.
API Reference
Complete reference for all 558+ JSON-RPC methods across 38 handlers.
GraphRAG Guide
19.1M+ node knowledge base with 20 MCP tools for engine understanding.
Requirements
| Requirement | Version | Notes |
|---|---|---|
| Unreal Engine | 5.6+ | Retail or source build (5.7+ recommended for full feature set) |
| Python | 3.10+ | MCP bridge + GraphRAG |
| Neo4j Community | 5.x | Optional, only needed for Engine Knowledge |
| Java | 21+ | Optional, required by Neo4j |
Plugin overhead: ~3.4ms total startup time. Zero background resource usage until a client connects. See Quick Start for the full setup walkthrough.