This product lets human characters talk. Characters from the City Sample Crowd or MetaHuman Creator characters visualize speech by animate the lips in their face and display speech bubbles. The plugin assists developers importing text-to-speech assets they generated and downloaded from Amazon Polly, then to animate Meta Human faces to visualize talk and optionally show speech bubbles (or use other caption system).

• Video with Sample: click
• An overview of the available voices is available here.

It is intended as a low cost alterative of lips-synchronization for game creators and virtual production, offering a new opportunity for a multi-lingual visual, virtual production.

Process:

• Create and Download the speech files for your text from Amazon using Polly with your web browser.
• Import sound (need to convert to wav) and speechmarks (asset supported by plugin) into unreal.
• Optional: Editor Asset Utility allows to assign subtitles from speechmarks to sound wave.
• No runtime access to AWS is required; all sound files are imported during development.
• Configure characters in world outliner or sequencer. Most code is encapsulated in Actor Component blueprint.
• Invoke speech event. The Actor Component has an interpreter for the speech marks driving animation.