Omniverse Audio2Face

An animation of a 3D character may be made to more easily match any voice-over recording with the help of the reference programme known as Omniverse Audio2Face. The audio input is routed into a pre-trained Deep Neural Network, and the output drives the 3D vertices of the character mesh to produce the face animation in real-time. It comes preloaded with a 3D character model that can be animated with a voice-over recording. In addition to this, it possesses a character transfer capability that enables users to retarget to any 3D human or human-like face. Furthermore, it enables users to scale the output with numerous characters in the scene and manage the emotion of the character using an AI network. Blendshapes may be exported and imported, and it supports exporting and importing with Blendshapes for Blender and Epic Games’ Unreal Engine so that motion can be generated for characters. It also offers data conversion tools that enable for blendshape conversion and blendweight export choices.

Leave a Reply

Your email address will not be published. Required fields are marked *