Skip to main content
Springer Nature Link
Log in

AAML Based Avatar Animation with Personalized Expression for Online Chatting System

  • Conference paper
Advances in Multimedia Information Processing - PCM 2008 (PCM 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5353))

Included in the following conference series:

Abstract

This paper presents an online chatting system with automatic expression animation and animated avatar. The system is constructed upon an XML based language AAML (Affective Animation Markup Language), which describes hierarchically affective content for online communication. Once the user types a chatting sentence, the AAML produces a piece of personalized facial animation. The animation would be sent to the remote client right now to enrich the chatting process. Comparatively, our system is designed with its dedicated feature that its structure is hierarchical and open, so the users can extend the AAML, defining their own tags to realize personal affective expression. In addition, caricature generation according to an input facial photograph is embedded in the framework, so the animation is synthesized based on the caricature with entertainment effect. Successful application of the online chatting system shows that our system can enhance affective interaction by the customized facial animation and the animated avatar that is similar with the user. The function can also be widely applied in online or mobile environment such as multimedia message synthesis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychologists Press Inc. (1978)

    Google Scholar 

  2. Bulterman, D.: SMIL-2. IEEE Multimedia (October 2001)

    Google Scholar 

  3. Cassell, J., Vihjalmsson, H., Bickmore, T.: BEAT: the Behavior Expression Animation Toolkit. In: Proceedings of SIGGRAPH 2001 (2001)

    Google Scholar 

  4. Beard, S., Reid, D.: MetaFace and VHML: A First Implementation of the Virtual Human Markup Language. In: Proceedings of Embodied conversational agents - let’s specify and evaluate them! for AAMAS 2002, Bologna, Italy, July 16th (2002)

    Google Scholar 

  5. Arya, A., Hamidzadeh, B.: An XML-Based Language for Face Modeling and Animation. In: Proceedings of IASTED Intl Conf. on Visualization, Imaging and Image Processing, VIIP-2002, Malaga, Spain, pp. 1–6 (2002)

    Google Scholar 

  6. Arya, A., Hamidzadeh, B.: ShowFace: A Framework for Personalized Face Animation. In: Proceedings of IEEE/EURASIP RichMedia-2003, Lausanne, Switzerland, October 16-17 (2003)

    Google Scholar 

  7. Koch, R.M., Gross, M.H., Bosshard, A.A.: Emotion Editing using Finite Elements. In: Proceedings of the Eurographics 1998, Lisbon, Portugal (1998)

    Google Scholar 

  8. Liu, J., Chen, Y., Gao, W., Fu, R., Zhou, R.: Creative Cartoon Face Synthesis System for Mobile Entertainment. In: Ho, Y.-S., Kim, H.-J. (eds.) PCM 2005. LNCS, vol. 3767, pp. 1027–1038. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  9. Cootes, T.F., Taylor, C.J., Cooper, D., Graham, J.: Active shape models–their training and application. Computer vision and image understanding 61(1), 38–59 (1995)

    Article  Google Scholar 

  10. Beier, T., Neely, S.: Feature-Based Image Metamorphosis. Computer Graphics (July 1992)

    Google Scholar 

  11. Liu, J., Chen, Y., Gao, W.: Mapping Learning in Eigenspace for Harmonious Caricature Generation. In: 14th ACM International Conference on Multimedia, Santa Barbara, USA, pp. 683–686, October 22-27 (2006)

    Google Scholar 

  12. Liang, L., Chen, H., Xu, Y.-Q., Shum, H.-Y.: Example-based Caricature Generation with Exaggeration. In: Proc. IEEE 10th Pacific Conference on Computer Graphics and Applications (2002)

    Google Scholar 

  13. Gooch, B., Reinhard, E., Gooch, A.: Human facial illustrations: Creation and psychophysical evaluation. ACM Trans. Graph. 23(1), 27–44 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China, 100190

    Junfa Liu, Yiqiang Chen, Xingyu Gao, Jinjing Xie & Wen Gao

  2. Graduate School of Chinese Academy of Sciences, Beijing, China, 100190

    Junfa Liu

  3. Institute of Digital Media, Peking University, Beijing, China, 100871

    Wen Gao

Authors
  1. Junfa Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yiqiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xingyu Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jinjing Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wen Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Engineering Science, National Cheng Kung University, No.1, University Road, 701, Tainan City, Taiwan

    Yueh-Min Ray Huang

  2. National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, 95, Zhongguancun East Road, 100190, Beijing, China

    Changsheng Xu

  3. Institute of Biomedical Engineering, National Cheng Kung University, No. 1, University Road, 701, Tainan City, Taiwan

    Kuo-Sheng Cheng

  4. Department of Electrical Engineering, National Cheng Kung University, No. 1, University Road, 701, Tainan City, Taiwan

    Jar-Ferr Kevin Yang

  5. Department of Electrical and Computer Engineering, Concordia University, S-EV005.139, 1515 St. Catherine West, Montreal, H4G 2W1, Quebec, Canada

    M. N. S. Swamy

  6. Microsoft Research Asia, 5/F, Beijing Sigma Center, No. 49, Zhichun Road, Hai Dian District, 100080, Beijing, China

    Shipeng Li

  7. Department of Information Management, National Kaohsiung University of Applied Sciences, No. 415, Jiangong Road, Sanmin District, 80778, Kaohsiung, Taiwan

    Jen-Wen Ding

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Liu, J., Chen, Y., Gao, X., Xie, J., Gao, W. (2008). AAML Based Avatar Animation with Personalized Expression for Online Chatting System. In: Huang, YM.R., et al. Advances in Multimedia Information Processing - PCM 2008. PCM 2008. Lecture Notes in Computer Science, vol 5353. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89796-5_66

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89796-5_66

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89795-8

  • Online ISBN: 978-3-540-89796-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics