Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
This document explains how to create MetaHuman Characters with Convai Plugin.
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
This stage explains how to add simple custom actions with Convai characters.
Loading...
Loading...
Loading...
Loading...
This guide is for customization of the the blueprints.
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
This documentation describes how to test micrphone in Ureal Engine.
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
This document explains how to add MetaHuman to your project.
Change AI Character Movement Speed - Unreal Engine Guide with Convai.
Open your AI character blueprint.
Select the Floating Pawn Movement
component from the components list.
Set the Max Speed
field under the details panel to your required speed.
Here are some Guides to get you started.
Set up the Convai Unreal Engine plugin and add conversational AI to your apps.
Get started with sample projects for some of our popular tutorials:
Install Convai plugin for Unreal Engine. Follow step-by-step instructions for Visual Studio and XCode setup.
Download Visual Studio from here.
Ensure having the required C++ toolchains mentioned here. If you already have Visual Studio installed, you may open the installer and select 'Modify' to add the above mentioned toolchains.
Download XCode from the app store
For UE 5.3 and UE 5.0, follow this guide to enable microphone permissions.
There are two methods to install the plugin depending on your requirements
Directly from the Marketplace Link: Recommended for easy installation and tracking updates to the plugin. (UE 5.1 - 5.3)
Building from Github Source: For source UE builds and for unsupported UE versions on the marketplace, but not guranteed as the marketplace approach. (UE 4.26 - 5.0)
From the top toolbar, go to Edit > Plugins.
Find the Convai plugin.
Click the checkbox to enable the plugin.
Restart Unreal Engine.
Go to Edit > Project Settings.
Choose Convai under the Plugins section on the left bar.
Paste the API key into the API Key field.
Convai Unreal Engine Plugin supports the following platforms.
Adjust Interaction Radius - Unreal Engine Guide for Convai integration.
Go to your player blueprint.
Set it to a number of your choice. Note: Set it to 0 for infinite distance.
This mini-guide provides instructions for setting up Convai with pixel streaming in Unreal Engine
To setup the Pixel Streaming server, we recommend taking a look over this excellent guide.
Ensure you have the latest Convai 3.1.0 plugin or later.
Enable Unreal Engine's Pixel Streaming
and the Pixel Streaming Player
Plugins from the Plugins window.
In the player blueprint which has the Convai Player component, add the PixelStreamingAudio component to the list of components.
Click on PixelStreamingAudio component, and in the details panel find Base Submix and choose AudioInput sound submix.
On Begin Play in the event graph, add the following blueprint function to initialize Pixel Streaming with the Player Component.
Now, pixel streaming mic input should be working. However, system microphone will no longer work. To change back and forth to and from system microphone, set Use Pixel Streaming Mic Input to true for enabling pixel streaming microphone and false to enable system microphone. This is found in the ConvaiPlayer component.
This gives the player the ability for conversation with the chat bot.
This can be applied to first person player (FPP) or third person player (TPP).
Steps to change parent class of a First person player (FPP): -
Create a new project as a first person project or import into your already existing project.
Steps to import : - Content Browser > Add > Add feature or content pack to the project > First Person > Add to Project.
Steps to make your game a default First Person game: -
Steps: - Edit > Project Settings > Maps and modes > Default Mode > Default GameMode > BP_FirstPersonGameMode
.
Then go to All > Content > FirstPerson > Blueprints > BP_FirstPersonCharacter
.
Click Class Settings then in the Details section Under ‘Class Options’
change the parent class to ‘ConvaiBasePlayer’.
Hit save and compile and you will be good to go.
For Third Person Player follow the same steps just by looking for Third Person
This enables AI conversational features to MetaHuman
Open content browser then Content > MetaHumans > MetaHuman blueprint
.
Go to Class Settings and then under Details panel > Class Options > Parent Class and set it to ConvaiBaseCharacter
.
To add animation to the body go to the 'body'
component and under the details > Animation > Anim Class
change it to ‘Convai_MetaHuman_BodyAnim’.
Similarly for the face go to the face component and under the details > Animation > Anim Class
change it to ‘Convai_MetaHuman_FaceAnim’.
Compile and you will be good to go.
Add lip sync to MetaHuman characters in Unreal Engine with Convai. Enhance realism and engagement.
Adds lip animation to MetaHuman
Head to your project folder and find the ‘Plugins’
folder. If not, create a new folder named ‘Plugins’.
Unzip the downloaded file and copy the folder named ‘ConvaiOVRLipSync’
into the ‘Plugins’
folder and restart the Unreal Engine.
Open the MetaHuman Blueprint and add a component named ‘ConvaiOVRLipSync’.
Make sure that the ‘Face’
component is using the ‘Convai_MetaHuman_FaceAnim’
animation class.
Platform | Supported Unreal Engine Versions |
---|---|
Click on the gear icon and select Show Inherited Variables
under My Blueprint
tab.
Search for the variable MaxChatDistance
.
Prior to advancing, ensure that you modify the parent class of your MetaHuman to ConvaiBaseCharacter, as indicated in the provided .
Download the plugin from this .
Link for.