Skip to main content

The Positive Effect of Negative Feedback in HRI Using a Facial Expression Robot

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9549))

Abstract

This research explores the use of facial expressions in robots and their effect in collaborative tasks between humans and robots. The positive effect is determined during a task in human - robot collaboration, derived from a negative facial expression issued as feedback by the robot (sad face) when a failure in the execution of the task occurs. This study analyzes whether or not human intervention exists on the initial presence of an unexpected failure, the response time of the intervention and the accuracy of the task. A comparison with a neutral facial expression is also performed.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.arduino.cc.

  2. 2.

    Statistical significance calculated by Exact Fisher method for an experiment with a power of 0.9 for a sample of 15 per case.

  3. 3.

    Statistical significance calculated by Pair t-test method for an experiment with a power of 0.9 for a sample of 15 per case.

References

  1. Breazeal, C.: Functions meets style: insights from emotion theory applied to HRI. IEEE Trans. Man Cybern. Syst. Part C 34(2), 187–194 (2003)

    Google Scholar 

  2. Marsella, S., Gratch, J., Petta, P.: Computational models of emotion. In: A Blueprint for Affective Computing - A Sourcebook and Manual, vol. 11(1), pp. 21–46 (2010)

    Google Scholar 

  3. Knapp, M., Hall, J., Horgan, T.: Nonverbal Communication in Human Interaction, 8th edn. (2012). Cengage Learning

    Google Scholar 

  4. Fong, T., Nourbakhsh, I., Dautenhahn, K.: A Survey of Socially Interactive Robots: Concepts, Design, and Applications. The Robotics Institute, Pittsburgh (2002)

    MATH  Google Scholar 

  5. Arkin, R., Moshkina, L.: Affect in human-robot interaction. In: Calvo, R.D., ed. The Oxford Handbook of Affective Computing (2014)

    Google Scholar 

  6. Scheutz, M., Schermerhorn, P., Kramer, J.: The utility of affect expression in natural language interactions in joint human-robot tasks. In: HRI 2006 Proceedings of the 1st ACM SIGCHI/SIGART, Salt Lake City, Utah, USA, pp. 226–233. ACM (2006)

    Google Scholar 

  7. Breazeal, C., Kidd, C., Lockerd Thomaz, A., Hoffman, G., Berlin, M.: Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In: 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IROS 2005), Alberta, Canada, pp. 708–713. IEEE (2005)

    Google Scholar 

  8. Samer, A., Gabriel, S.: Perception of gaze direction for situated interaction. In: 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction. DiVa, Santa Monica (2012)

    Google Scholar 

  9. Boucher, J., Pattacini, U., Lelong, A., Bailly, G., Elisei, F., Fagel, S.: I reach faster when I see you look: gaze effects in human–human and human–robot face-to-face cooperation. Front. Neurorobotic 6(3), 1–11 (2012)

    Google Scholar 

  10. Nieuwenhuisen, M., Behnke, S.: Human-like interaction skills for the mobile communication robot robotinho. Int. J. Soc. Robot. 5, 549–561 (2013)

    Article  Google Scholar 

  11. Kondo, Y., Takemura, K., Takamatsu, J., Ogasawara, T.: A gesture-centric android system for multy-party human-robot interaction. J. Hum. Robot Interact. 2(1), 133–151 (2013)

    Google Scholar 

  12. Haddadi, A., Crof, E., Gleeson, B., MacLean, K., Alcazar, J.: Analysis of task-based gestures in human-robot interaction. In: IEEE International Conference on Robotics and Automation (ICRA) Karlsruhe, Germany, pp. 2138–2144. IEEE (2013)

    Google Scholar 

  13. Seib, V., Giesen, J., Grüntjens, D., Paulus, D.: Enhancing human-robot interaction by a robot face with facial expressions and synchronized lip movements. In: En V. S.-U. Agency (ed.) Communication Papers Proceedings: 21st International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision in co-operation with EUROGRAPHICS Association, pp. 70–77 (2013)

    Google Scholar 

  14. Eastwood, J., Smilek, D., Merikle, P.: Negative facial expression captures attention and disrupts performance. Percept. Psychophys. 3, 352–358 (2003)

    Article  Google Scholar 

  15. Midden, C., Ham, J.: Using negative and positive social feedback from a robotic agent to save energy. In: Persuasive 2009 Proceedings of the 4th International Conference on Persuasive Technology. ACM (2009)

    Google Scholar 

  16. Ekman, P., Friesen, W.: Unmasking the Face: A Guide to Recognizing Emotions from Facial. Malor Books, Los Altos (2003)

    Google Scholar 

  17. Pineda, L.A., Rodríguez, A., Fuentes, G., Rascon, C., Meza, I.: Concept and functional structure of a service robot. Int. J. Adv. Robot. Syst. 12, 6 (2015)

    Google Scholar 

  18. Bennett, C.C., Šabanović, S.: Deriving minimal features for human-like facial expressions in robotic faces. Int. J. Soc. Robot. 6(3), 367–381 (2014)

    Article  Google Scholar 

  19. Berns, K., Hirth, J.: Control of facial expressions of the humanoid robot head ROMAN. In: RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3119–3124. IEEE (2006)

    Google Scholar 

  20. Miwa, H., Itoh, K., Matsumoto, M., Zecca, M., Takanobu, H., Rocella, S., Carrozza, M.C., Dario, P., Takanishi, A.: Various emotional expressions with emotion expression humanoid robot WE-4RII. In: Technical Exhibition Based Conference on Robotics and Automation, pp. 35–36. IEEE (2004)

    Google Scholar 

  21. Eastwood, J., Smilek, D., Mer, P.: Differential attentional guidance by unattended faces expressing positive and negative emotion. Percept. Psychophys. 6, 1004–1013 (2001)

    Article  Google Scholar 

  22. Nomura, T., Kanda, T., Suzuki, T.: Experimental investigation into influence of negative attitudes toward robots on human–robot interaction. AI Soc. 20(2), 138–150 (2006)

    Article  Google Scholar 

Download references

Acknowledgment

This research was financed by PCIC-UNAM, PASPA program and by CONACyT project 178673, PAPIIT-UNAM project IN107513 and CIDI, UNAM.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mauricio Reyes .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Reyes, M., Meza, I., Pineda, L.A. (2016). The Positive Effect of Negative Feedback in HRI Using a Facial Expression Robot. In: Koh, J., Dunstan, B., Silvera-Tawil, D., Velonaki, M. (eds) Cultural Robotics. CR 2015. Lecture Notes in Computer Science(), vol 9549. Springer, Cham. https://doi.org/10.1007/978-3-319-42945-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42945-8_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42944-1

  • Online ISBN: 978-3-319-42945-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics