Design and Implementation of Virtual Character based on Facial Motion Capture

Abstract:
The metaverse is one of the hottest concepts right now. With the development of computer technology, digital virtual human gradually developed from concept to practical application. At present, virtual characters have gradually been launched on major video platforms. This paper introduces a virtual character implementation scheme based on facial motion capture technology. This article contains the entire process from 3D modeling, to model animation rigging, and facial motion capture, and finally applying the captured facial motion to model animation. In this paper, the Unity3d engine mainly implements the rendering of models and animations, while facial motion capture uses deep learning-based algorithms. Through the design and implementation of the entire system, it provides a set of solutions for AI engineers.