Skip to main content
SpringerLink
Log in

Automated Gesturing for Embodied Agents

  • Conference paper
  • First Online:
Book cover New Frontiers in Artificial Intelligence (JSAI 2005)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4012))

Included in the following conference series:

  • 668 Accesses

Abstract

In this paper we present our recent results in automatic facial gesturing of graphically embodied animated agents. In one case, conversational agent is driven by speech in automatic Lip Sync process. By analyzing speech input, lip movements are determined from the speech signal. Another method provides virtual speaker capable of reading plain English text and rendering it in a form of speech accompanied by the appropriate facial gestures. Proposed statistical model for generating virtual speaker’s facial gestures, can be also applied as addition to lip synchronization process in order to obtain speech driven facial gesturing. In this case statistical model will be triggered with the input speech prosody instead of lexical analysis of the input text.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. McAllister, D.F., Rodman, R.D., Bitzer, D.L., Freeman, A.S.: Lip synchronization for Animation. In: Proceedings of SIGGRAPH 1997, Los Angeles, CA (1997)

    Google Scholar 

  2. Pandžic, I.S., Forchheimer, R. (eds.): MPEG-4 Facial Animation - The Standard, Implementation and Applications. John Wiley & Sons Ltd, Chichester (2002)

    Google Scholar 

  3. Axelsson, A., Björhall, E.: Real time speech driven face animation, Master Thesis at The Image Coding Group, Dept. of Electrical Engineering at Linköping University, Linköping (2003)

    Google Scholar 

  4. Dávila, J.J.: Genetic optimization of neural networks for the task of natural language processing, dissertation, New York (1999)

    Google Scholar 

  5. Rojas, R.: Neural networks. In: A Systematic Introduction, Springer, Heidelberg (1996)

    MATH  Google Scholar 

  6. Jones, A.J.: Genetic algorithms and their applications to the design of neural networks. Neural Computing & Applications 1(1), 32–45 (1993)

    Article  Google Scholar 

  7. Black Box Genetic algorithm, http://fdtd.rice.edu/GA/

  8. Pelachaud, C., Badler, N., Steedman, M.: Generating Facial Expressions for Speech. Cognitive, Science 20(1), 1–46 (1996)

    Article  Google Scholar 

  9. Radman, V.: Leksicka analiza teksta za automatsku proizvodnju pokreta lica, Graduate work no. 2472 on Faculty of Electrical Engineering and Computing, University of Zagreb (2004)

    Google Scholar 

  10. http://www.cogsci.princeton.edu/~wn/

  11. Microsoft Speech Technologies, http://www.microsoft.com/speech

Download references

Author information

Authors and Affiliations

  1. Department of Telecommunications, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, HR-10000, Zagreb, Croatia

    Goranka Zoric & Igor S. Pandzic

  2. Ericsson Nikola Tesla, Krapinska 45, HR-10002, Zagreb, F-91405, Croatia

    Karlo Smid

Authors
  1. Goranka Zoric
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karlo Smid
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Igor S. Pandzic
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. ISIR, Osaka University, 8-1, Mihogaoka, 567-0047, Osaka, Ibaraki, Japan

    Takashi Washio

  2. CREST, Japan Science and Technology Agency, Japan

    Akito Sakurai

  3. Dept. of Information Media, Tokyo Denki University, room 1009, 10th floor, building 11, 2-2, Kandanishikicho, Chiyodaku, 101-8457, Tokyo, Japan

    Katsuto Nakajima

  4. National Institute of Informatics, 2-1-2 Chiyoda-ku, 101-8430, Tokyo, Japan

    Hideaki Takeda

  5. Japan Advanced Institute of Science and Technology, Ishikawa, Japan

    Satoshi Tojo

  6. Department of ISEE, Kyushu University, 819-0395, Fukuoka, Japan

    Makoto Yokoo

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zoric, G., Smid, K., Pandzic, I.S. (2006). Automated Gesturing for Embodied Agents. In: Washio, T., Sakurai, A., Nakajima, K., Takeda, H., Tojo, S., Yokoo, M. (eds) New Frontiers in Artificial Intelligence. JSAI 2005. Lecture Notes in Computer Science(), vol 4012. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11780496_42

Download citation

  • DOI: https://doi.org/10.1007/11780496_42

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-35470-3

  • Online ISBN: 978-3-540-35471-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation