Abstract
The MPEG-4 standards define a technique for 3D facial and body model animations (FAPS / BAPS respectively), as seen in animation systems such as Greta. The way this technique works is in contrast to the set of animation techniques currently used within modern games technologies and applications, which utilize more advanced, expressive animation systems such as Skeletal, Morph Target and Inverse Kinematics. This paper describes an object oriented, Java-based framework for the integration and transformation of MPEG4 standards-compliant animation streams known as Charisma. Charisma is designed for use with modern games animation systems; this paper illustrates the application of this framework on top of our Java / OpenGL-based games engine framework known as Homura.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., De Carolis, B.: Greta: A Believable Embodied Conversational Agent. In: Multimodal Intelligent Information Presentation, pp. 3–25. Springer, Heidelberg (2005)
Grammalidis, N., Sarris, N., Deligianni, F., Strintzis, M.G.: Three-Dimensional Facial Adaptation for MPEG-4 Talking Heads. EURASIP Journal on Applied Signal Processing (1), 1005–1020 (2002)
Forchheimer, R., Pandzic, I., Pakstas, A.: MPEG-4 Facial Animation: The Standard, Implementation and Applications. Wiley and Sons Inc., New York (2002)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (July 1999)
Deng, Z., Chiang, P.Y., Fox, P., Neumann, U.: Animating blendshape faces by cross-mapping motion capture data. In: Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games, pp. 43–48 (2006)
Tolani, D., Goswami, A., Badler, N.I.: Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs. Graphical Models 62(5), 353–388 (2000)
Ersotelos, N., Dong, F.: Building highly realistic facial modeling and animation: a survey. The Visual Computer: International Journal of Computer Graphics 24(1), 13–30 (2007)
Balci, K.: Xface: MPEG4 Open Source Toolkit for 3D Facial Animation. In: Proceedings of the Working Conference on Advanced Visual interfaces, Gallipoli, Italy, pp. 399–402 (2004)
de Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From Greta’s Mind to her Face: Modeling the Dynamics of Affective States in a Conversational Embodied Agent. International Journal of Human-Computer Studies 59(1-2), 81–118 (2003)
Image Metrics - Official Site (July 2010), http://www.image-metrics.com/
Zhang, Y., Ji, Q., Zhu, Z., Yi, B.: Dynamic Facial Expression Analysis and Synthesis With MPEG-4 Facial Animation Parameters. IEEE Transactions on Circuits and Systems for Video Technology 18(10), 1383–1396 (2008)
Pardas, M., Bonafonte, A., Landabaso, J.L.: Emotion Recognition based on MPEG4 Facial Animation Parameters. In: Proceedings of IEEE Acoustics, Speech, and Signal Processing, pp. 3624–3627 (2002)
Ahlberg, J., Pandzic, I., You, L.: Evaluating Face Models Animated by MPEG-4 FAPs. In: OZCHI Workshop on Talking Head Technology, Fremantle, Western Australia (November 2001)
Lavagetto, F., Pockaj, R.: The Facial Animation Engine: Toward a High-Level Interface for the Design of MPEG-4 Compliant Animated Faces. IEEE Transactions on Circuits and Systems for Video Technology 9(2), 277–289 (1999)
Pasquariello, S., Pelachaud, C.: Greta: A Simple Facial Animation Engine. In: Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications (2001)
Balci, K., Not, E., Zancanaro, M., Pianesi, F.: Xface open source project and smil-agent scripting language for creating and animating embodied conversational agents. In: Proceedings of the 15th International Conference on Multimedia, Augsburg, Germany, pp. 1013–1016 (2007)
Pandzic, I.S.: Facial Animation Framework for the Web. In: Proceedings of the Seventh International Conference on 3D Web Technology, Arizona, USA, pp. 27–34 (2002)
Carter, C.: Networking Middleware and Online-Deployment Mechanisms for Java-Based Games. In: 6th International Conference in Computer Game Design and Technology (GDTW), Holiday Inn., Liverpool, UK, November 12-13 (2008)
Carter, C., El-Rhalibi, A., Merabti, M., Price, M.: Homura and Net-Homura: The Creation and Web-based Deployment of Cross-Platform 3D Games. In: Proceedings of Ubiquitous Multimedia Systems and Applications (UMSA), St. Petersburg (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Carter, C., Cooper, S., El Rhalibi, A., Merabti, M. (2010). The Application of MPEG-4 Compliant Animation to a Modern Games Engine and Animation Framework. In: Boulic, R., Chrysanthou, Y., Komura, T. (eds) Motion in Games. MIG 2010. Lecture Notes in Computer Science, vol 6459. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16958-8_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-16958-8_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16957-1
Online ISBN: 978-3-642-16958-8
eBook Packages: Computer ScienceComputer Science (R0)