Virtual Production
ProductionVirtual Production ecosystem: real-time filmmaking with LED walls, camera tracking, and in-camera VFX (ICVFX) via nDisplay and Live Link.
/skill virtual-production What This Skill Does
Virtual Production helps you set up and operate UE5's VP ecosystem for real-time filmmaking. This skill covers the complete virtual production pipeline, from configuring nDisplay to render UE5 content across LED wall panels, to setting up Live Link camera tracking so the virtual environment updates its perspective in real-time as the physical camera moves, to enabling in-camera VFX (ICVFX) where the LED wall displays the correct parallax within the camera frustum. Whether you are planning pre-visualization, running a tech-vis session, or supporting a live shoot on an LED volume stage, this skill guides you through stage geometry, operator tools, color calibration, and VP-specific performance considerations.
Covers
- Virtual production concepts, workflow phases, and value proposition
- nDisplay: multi-display and LED wall rendering configuration
- Live Link: camera tracking from OptiTrack, Vive, Stype, and other systems
- ICVFX (In-Camera VFX): inner frustum rendering on LED walls with correct parallax
- Stage setup: geometry matching, calibration, and operator roles
- VP Sequencer workflows: pre-vis, tech-vis, and live shoot support
- VP-specific lighting considerations and color calibration
- Green screen compositing comparison and hybrid setups
Does Not Cover
- LED hardware installation → Physical infrastructure
- Detailed nDisplay cluster configuration → nDisplay Config (future skill)
- Facial motion capture performance → Face Capture
- Color science and ACES pipeline → Color Management (future skill)
How to Use
Invoke this skill in Claude Code:
/skill virtual-productionThis skill is also auto-detected when your prompt mentions virtual production, LED wall, ICVFX, nDisplay, live link, stage, or VP intent. AgentUX will automatically activate Virtual Production when it recognizes relevant context in your request.
Key Unreal Engine Concepts
| Concept | Description |
|---|---|
ADisplayClusterRootActor | The nDisplay root actor placed in the level that configures the multi-display rendering cluster and viewport assignments. |
nDisplay | UE5's multi-display rendering system that drives LED walls by rendering the correct perspective across multiple screens. |
ICVFX | In-Camera Visual Effects: the technique where the LED wall inner frustum renders from the physical camera's tracked perspective for correct parallax. |
Inner Frustum | The portion of the LED wall visible through the physical camera lens, rendered at full quality from the camera's exact perspective. |
Live Link | A plugin for streaming real-time tracking data (position, rotation, lens metadata) from external devices into UE5. |
Stage Geometry | The 3D mesh in UE5 that exactly matches the physical LED panel positions, angles, and dimensions for accurate projection. |
Related Skills
camera-placement
Camera setup for pre-vis shot planning and VP stage cameras
lighting-fundamentals
Scene lighting that directly illuminates physical talent via the LED wall
render-pipeline
Rendering configuration for real-time VP frame rate requirements
sequencer-basics
Sequencer for pre-vis shot planning and live shoot playback
What You'll Learn
- How the virtual production pipeline works from camera tracking through LED wall rendering
- How to configure nDisplay for LED wall stage geometry and viewport mapping
- How to set up Live Link camera tracking from various tracking systems
- How ICVFX inner frustum rendering creates correct parallax in-camera
- How VP lighting from the LED wall naturally illuminates physical talent and sets
- How to plan and execute a VP workflow from pre-vis through live shoot to post