Description
NVIDIA ACE UE plugin currently supports Audio2Face (A2F), however NVIDIA Riva automatic speech recognition (ASR) and text-to-speech (TTS) capabilities are coming soon.
The NVIDIA ACE Unreal plugin allows you to send speech clips to an NVIDIA Audio2Face service and receive synchronized audio and ARKit-compatible facial animations. You can animate any character that has an ARKit-compatible pose mapping. The plugin includes a pose mapping asset for animating MetaHuman faces, for convenience.
Key Features:
- NVIDIA Audio2Face allows animating in-game characters' lips to match the voice audio.
- Use the API key to connect to the A2F backend service.
- Adjust A2F model parameters, such as blink strength or tongue offset, or emotion parameters, such as anger or joy.
Included formats
- versions