Convai Unity SDK

Add real-time AI characters to Unity training simulations, interactive experiences, and games — with speech, emotion, actions, and persistent memory.

The Convai Unity SDK connects Unity projects to Convai, bringing conversational AI into training simulations, interactive experiences, and games. Characters process speech in real time, respond with natural language, and synchronize lip movement, facial emotion, and body animation — all configurable per project. Each feature is a self-contained module: add only what your project needs, in the order that fits your workflow.

New to the SDK? Follow Getting started to install the package, configure your API key, and run your first AI character.

Learn the SDK

Overview What the SDK is, how it is structured, and when to use each module.

Compatibility and requirements Unity versions, render pipelines, platform support, and network requirements.

Core concepts Session lifecycle, turn-taking modes, and the SDK event system.

Embodiment Gaze, body animation, body language, conversation flow, and emotion modules for character behavior.

AI coding assistant Unity MCP integration that lets AI coding agents build Convai scenes from prompts.

Features

Each feature is a self-contained module you opt into.

Actions Characters execute structured in-scene commands dispatched by Convai.

Emotion Map Convai emotion signals to facial blendshapes or Animator parameters.

Long-term memory Characters remember each player across separate sessions.

Vision Characters see through a Unity camera, webcam, or Meta Quest passthrough.

Dynamic context Inject runtime state and events into character knowledge at any time.

Narrative design Trigger-based story section progression tied to conversation flow.

Scene metadata Characters automatically read contextual information about scene objects.

Reference and guides

UI and presentation Transcript UI, subtitle modes, notification system, and settings panel.

Scripting reference Full API reference for session events, character events, and the transcript system.

Platform guides WebGL, Android, iOS, and Meta Quest deployment guides.

Advanced topics Custom providers, performance, and SDK extension points.

Troubleshooting Common failure modes, diagnostic steps, and known issues.

Latest release

v4.6.0 introduces the embodiment family of character-behavior modules: Gaze, Body Animation, Body Language, Conversation Flow, and Emotion. The five modules share one per-character setup and read the same dialogue state, so a character looks, moves, and reacts as one behavior rather than five independent ones. This release also adds an Auth Token authentication mode that resolves a short-lived credential before each connection, so a player build ships without an account API key. The Actions Editor is rebuilt around a curated catalog of 21 built-in actions and provisions an action's executor and its character-side components in a single undoable operation. A new Convai > Troubleshooter window reports setup problems per module. The SDK requires Unity 6000.0.80f1 or later. See Release notes for the complete changelog.

Next steps

Install the Convai Unity SDK and connect your first AI character using the Getting started section. If you are evaluating the SDK before installing, review Compatibility and requirements to confirm platform and Unity version support.

Getting started