Omniverse Audio2Face

Omniverse Audio2Face is a revolutionary motion capture and generative video software that simplifies the animation of 3D characters to match any voice-over track. With a preloaded 3D character model, users can easily animate the character with a voice-over track. The audio input is then fed into a pre-trained Deep Neural Network, which drives the 3D vertices of the character mesh in real-time to create facial animation. The software also features a character transfer function that allows users to retarget to any 3D human or human-esque face, scale the output with multiple characters in the scene, and control the character’s emotion with an AI network. Additionally, it offers data conversion features that allow for blendshape conversion and blendweight export options, and supports export-import with Blendshapes for Blender and Epic Games Unreal Engine to generate motion for characters. With Omniverse Audio2Face, users can easily create high-quality and realistic animations with minimal effort.