Skip to main content

A Study on Acquisition Method of Nonverbal Cues for Intelligent Agents: A Case Study on Facial Expression Analysis

  • Conference paper
Intelligent Autonomous Systems 12

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 194))

  • 4130 Accesses

Abstract

The paper proposes a method to acquire nonverbal cues for an intelligent agent that can be used in communications with human partner. A framework to extract the information that affords a key to understand intension, mental state, affect, or signs evoked by a person through nonverbal communication between the person and an intelligent agent. The aim of the framework is to make intelligent agents to be able to extract the nonverbal cues through trial-and-error style learning. A limited functionality of the framework is implemented and applied to a facial expression analysis as a case study. The main advantage of the method is that it would acquire the cues as some time-series information inherent to particular facial expressions. Thus the agent Result in a preliminary experiment shows that this implemented method have potential to extract nonverbal cues concerning with fake and real smiles.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Argyle, M.: Bodily communication, 2nd edn., Methuen (1988)

    Google Scholar 

  2. Hall, J.A.: Nonverbal communication. In: Sander, D., Scherer, K.R. (eds.) The Oxford Companion to Emotion and The Affective Sciences, pp. 282–283. Oxford University Press, Oxford (2009)

    Google Scholar 

  3. Hakura, J., Kurematsu, M., Fujita, H.: Facial Expression Invariants for Estimating Mental States of Person. In: Proceedings of the 2009 Conference on New Trends in Software Methodologies, Tools and Techniques: Proceedings of the Eighth Somet 2009, pp. 518–530 (2009)

    Google Scholar 

  4. Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognition 36, 259–276 (2003)

    Article  MATH  Google Scholar 

  5. Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal human-computer interaction. Proceedings of the IEEE 91, 1370–1390 (2003)

    Article  Google Scholar 

  6. Tian, Y., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 97–115 (2001)

    Article  Google Scholar 

  7. Oki Electronic Industry, Face Sensing Engine Version 4 Application Development Guide: FSE Feature Point Detector Edition (FP) (2008)

    Google Scholar 

  8. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6), 681–685 (2001)

    Article  Google Scholar 

  9. Kohonen, T.: Self-organization and associative memory. Springer, Berlin (1989)

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jun Hakura .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hakura, J., Kurematsu, M., Fujita, H. (2013). A Study on Acquisition Method of Nonverbal Cues for Intelligent Agents: A Case Study on Facial Expression Analysis. In: Lee, S., Cho, H., Yoon, KJ., Lee, J. (eds) Intelligent Autonomous Systems 12. Advances in Intelligent Systems and Computing, vol 194. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33932-5_76

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33932-5_76

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33931-8

  • Online ISBN: 978-3-642-33932-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics