Author： Čereković Aleksandra Pandžić Igor
Publisher： Springer Publishing Company
ISSN： 1380-7501
Source： Multimedia Tools and Applications, Vol.54, Iss.1, 2011-08, pp. : 143-164
Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.
Abstract
Applications with intelligent conversational virtual humans, called Embodied Conversational Agents (ECAs), seek to bring human-like abilities into machines and establish natural human-computer interaction. In this paper we discuss realization of ECA multimodal behaviors which include speech and nonverbal behaviors. We devise RealActor, an open-source, multi-platform animation system for real-time multimodal behavior realization for ECAs. The system employs a novel solution for synchronizing gestures and speech using neural networks. It also employs an adaptive face animation model based on Facial Action Coding System (FACS) to synthesize face expressions. Our aim is to provide a generic animation system which can help researchers create believable and expressive ECAs.
Related content
By Liu Caixia Ham Jaap Postma Eric Midden Cees Joosten Bart Goudbeek Martijn
International Journal of Social Robotics, Vol. 5, Iss. 4, 2013-11 ,pp. :
Access to resources
Recommend
AUTONOMOUS AGENTS AS EMBODIED AI
Cybernetics and Systems, Vol. 28, Iss. 6, 1997-09 ,pp. :
Social learning in embodied agents
Connection Science, Vol. 20, Iss. 2-3, 2008-06 ,pp. :
User Modeling and User-Adapted Interaction, Vol. 15, Iss. 5, 2005-11 ,pp. :
By Lee Malrey Joo Suchong Kim HeeSook
Neural Computing & Applications, Vol. 13, Iss. 3, 2004-09 ,pp. :