Lip sync

Animate a character's face in sync with Convai speech using precomputed blendshape data and the Convai Face Sync AnimGraph node.

Lip sync makes a character's mouth and face move in time with its voice. When the character speaks, Convai sends face animation data alongside the audio so the two stay in sync — with no extra processing cost in Unreal Engine.

How lip sync works Understand how Convai delivers face animation data alongside audio and how to choose the right mode for your character rig.

Lip sync quick start Add Face Sync to a MetaHuman character and hear lip-synced speech in Play In Editor.

Face Sync component reference All properties of the Convai Face Sync component and every lip-sync mode value.

Face Sync AnimGraph node reference Every property of the Convai Face Sync AnimGraph node: apply mode, alphas, smoothing, starvation, and mapping.

Record and replay lip sync Capture a live lip-sync sequence during a conversation and replay it later with the C++ recording API.

Lip sync usage examples Common setups including Add vs Override blending, smoothing tuning, and custom blendshape remapping.

Troubleshoot lip sync Fix no mouth movement, frame starvation, wrong blendshape map, and rig mismatch.

Next steps

Start with How lip sync works to understand the data pipeline and the six lip-sync modes. Then follow Lip sync quick start to get lip sync running on a MetaHuman character before moving into the reference pages.