%A HUANG Yanhui, FAN Yangyu, SU Xuhui %T 3D facial expression tracking using a monocular RGB camera %0 Journal Article %D 2017 %J Journal of Shandong University(Engineering Science) %R 10.6040/j.issn.1672-3961.0.2016.466 %P 7-13 %V 47 %N 4 %U {http://gxbwk.njournal.sdu.edu.cn/CN/abstract/article_1618.shtml} %8 2017-08-20 %X There were two key problems in tracking 3D facial expression using a monocular RGB camera. One was how to reconstruct 3D facial model from a single image, and the other was how to establish the dense correspondences between the different 3D models. To solve the above problems, an effective 3D facial expression tracking algorithm was proposed. The feature points were automatically detected on each input facial image frame, and the 3D models of different expressions were reconstructed by Multilinear Model according to 2D feature points. By re-projecting the 3D models into the image space, the Optic Flow and Sift Flow correspondences between images were calculated. According to the correspondences of the images, the 3D models were rectified by Laplacian mesh deformation, and the dense 3D correspondences between different expressions were established. The experimental results showed that the proposed method could create more realistic 3D expression models, and could accurately track the continuous change of the 3D expression sequence.