团队简介   研究论文   研究人员   发明专利   研究资助   联系我们
视频驱动的语义表情基动画方法

王 涵 1,2   夏时洪 1

1 (中国科学院计算技术研究所前瞻研究实验室/移动计算与新型终端北京市重点实验室 北京 100190) 
2 (中国科学院大学 北京 100049)

摘 要 :
        为了重用视频内容中的表情信息, 提出一种语义表情构造与语义表情参数优化方法. 首先从带有噪声的稀疏特征点中定义出人脸表情的语义信息; 然后在语义表情空间中优化求解出最优表情参, 以提高人脸动画的真实感. 该方法既不需要标定相机参数, 也不需要预先建立表演者的3D 人脸模型及其表情基 , 因此除了可用于网络视频的表情重用, 也可用于开发实时在线的网络社交等. 实验结果表明, 对于头部摆动的俯仰角和侧角在[-15°, 15°]范围内的原始视频, 文中方法能够实时合成稳定、逼真的表情动画.
Semantic Blendshape Method for Video-Driven Facial Animation

Wang Han 1,2   Xia Shihong 1

1 (Beijing Key Lab of Mobile Computing and Pervasive Devices, Advanced Computing Research Laboratory, Institute Of Computing Technology Chinese Academy Of Sciences, Beijing, 100190) 
2 (University of Chinese Academy of Sciences, Beijing, 100049)

Abstract:
This paper proposes a novel method about semantic expression definition and optimization. The proposed method solves the real-time video-driven facial retargeting problem. First, it defines a set of semantic values,which represents the expression, from sparse 2D feature points with noise. Then, an extended optimization solved in semantic space is employed to improve the quality of expression retargeting. The method neither needs to calibrate camera, nor requires user-specific training to construct the special 3D model and blendshape. So, the proposed algorithm can be applied widely for retargeting expression of network video, real-time social networks,and so on. The experiments demonstrates that the proposed method can achieve accurate and stable facial animation results with the pitch and yaw ranged from -15° to 15°.
Video
Downloads

视频驱动的语义表情基动画方法.计算机辅助设计与图形学学报. 27(5): 873-882, 2015.(中国计算机图形学大会 2014) [PDF 6,029KB] [Video 12,440KB]