Features

Find guides for all Convai Unreal Engine plugin features — lip sync, character actions, narrative design, long-term memory, vision, and more.

Features are the plugin's AI-powered capability modules. Each feature connects to Convai for a specific purpose — executing in-scene behaviors, expressing emotions, remembering players across sessions, following authored narrative graphs, or perceiving the world through a camera. Every section includes a conceptual overview, a quick start, Blueprint property references, usage examples, and troubleshooting guidance.

Select a feature to get started:

Character actions Let Convai return structured action sequences your Blueprint event handlers execute — move to objects, follow the player, or run any custom behavior.

Dynamic context Push live runtime state — health, inventory, zone, events — into the character's context window mid-session without restarting the connection.

Emotion Translate Convai emotion signals into per-emotion blendshape weights and scores on any skeletal character.

Long-term memory Give characters cross-session recall via Speaker IDs and session continuity — characters remember individual players, facts, and past interactions over time.

Narrative design Structure character behavior around an authored story graph — sections define objectives and tone, triggers advance the narrative, template keys inject live gameplay data.

Scene metadata Tag world actors with UConvaiObjectComponent so Convai characters know which objects exist in the scene and can reference them by name in conversation.

Vision Stream scene frames from a capture component to Convai so characters can perceive and discuss what the player sees in real time.

Gaze attention Use player line-of-sight to direct which scene object a character focuses on — sustained gaze promotes objects to active attention with configurable dwell timers.

Lip sync Drive mouth and face blendshapes in sync with Convai speech using UConvaiFaceSyncComponent — supports MetaHuman, ARKit, CC4, and viseme targets.