skip to main content
10.1145/2459236.2459243acmotherconferencesArticle/Chapter ViewAbstractPublication PagesahConference Proceedingsconference-collections
research-article

Manipulation of an emotional experience by real-time deformed facial feedback

Published:07 March 2013Publication History

ABSTRACT

The main goals of this paper involved assessing the efficacy of computer-generated emotion and establishing a method for integrating emotional experience. Human internal processing mechanisms for evoking an emotion by a relevant stimulus have not been clarified. Therefore, there are few reliable techniques for evoking an intended emotion in order to reproduce this process.

However, in the field of cognitive science, the ability to alter a bodily response has been shown to unconsciously generate emotions. We therefore hypothesized emotional experience could be manipulated by having people recognize pseudo-generated facial expressions as changes to their own facial expressions. Our results suggest that this system was able to manipulate an emotional state via visual feedback from artificial facial expressions. We proposed the Emotion Evoking system based on the facial feedback hypothesis.

References

  1. W. James: The principles of psychology, vol. 2. Dover Publications, New York, 1950.Google ScholarGoogle Scholar
  2. S. Schachter, L. Berkowits(Ed.): The interaction of cognitive and physiological determinants of emotional state, Advances in Experimental Social Psychology; Academic Press, New York, vol.1, 1964.Google ScholarGoogle Scholar
  3. S. Tomkins: Affect, imagery, and consciousness: The Positive affects; Springer, New York, vol.1, 1962.Google ScholarGoogle Scholar
  4. C. Simion and S. Shimojo: Interrupting the cascade-orienting contributes to decision making even in the absence of visual stimulation; Perception and Psychophysics, vol.69, no.4, pp.591--595, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  5. P. Ekman and K. Scherer: Expression and the Nature of Emotion, Approaches to emotion; Lawrence Erlbaum, Hillsdale, 1984.Google ScholarGoogle Scholar
  6. A. R. Damasio: Looking for Spinoza: Joy, Sorrow, and the Feeling Brain; Houghton Mifflin Harcourt, Boston, 2003.Google ScholarGoogle Scholar
  7. F. Strack, F. Martin and S. Stepper: Inhibiting and facilitating conditions of the human smile: A non-obtrusive test of the facial feedback hypothesis; Journal of Personality and Social Psychology, vol.54, no.5, pp.768--777, 1988.Google ScholarGoogle ScholarCross RefCross Ref
  8. C. L. Kleinke, T. R. Peterson and T. R. Rutledge: Effects of self-generated facial expressions on mood; Journal of Personality and Social Psychology, vol.74, no.1, pp.272--279, 1998.Google ScholarGoogle ScholarCross RefCross Ref
  9. D. Dutton and A. Aron: Some evidence for heightened sexual attraction under conditions of high anxiety; Journal of Personality and Social Psychology, vol.30, no.4, pp. 510--517, 1974.Google ScholarGoogle ScholarCross RefCross Ref
  10. S. Valins: Cognitive Effects of False Heart-Rate Feedback; Journal of Personality and Social Psychology, vol.4, no.4, pp.400--408, 1966.Google ScholarGoogle ScholarCross RefCross Ref
  11. N. Nishimura, A. Ishi, M. Sato, S. Fukushima and H. Kajimoto: Facilitation of Affection by Tactile Feedback of False Heartbeat; In Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems, pp.2321--2326, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. T. Narumi, T. Akagawa, Y. A. Seong and M. Hirose: An Entertainment System using Thermal Feedback for Increasing Communication and Social Skills, The 4th International Conference on E-Learning and Games, pp.184--195, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. H. Tsujita and J. Rekimoto: Smiling Makes Us Happier: Enhancing Positive Mood and Communication with Smile-Encouraging Digital Appliances; In Proceedings of the 13th international conference on Ubiquitous computing. ACM, pp.1--10, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Tear machine: http://www.weststarland.com/wp/2011/04/tear-machine-tearful-reflection/Google ScholarGoogle Scholar
  15. P. Ekman and W. Friesen: The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, vol.1, pp.49--98, 1969.Google ScholarGoogle ScholarCross RefCross Ref
  16. P. Ekman and W. Friesen: Facial Action Coding System: A Technique for the Measurement of Facial Movement; Consulting Psychologists Press, Palo Alto, 1978.Google ScholarGoogle Scholar
  17. J. Saragih, S. Lucey and J. Cohn: Deformable Model Fitting by Regularized Landmark Mean-Shifts; International Journal of Computer Vision, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. S. Schaefer, T. McPhail and J. Warren: Image deformation using moving least squares; ACM Trans. Graph, vol.25, no.3, pp.533--540, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. P. Ekman and W. Friesen: Unmasking the Face; Prentice Hall, Inc., Englewood Cliffs, New Jersey, 1975.Google ScholarGoogle Scholar
  20. L. A. Clark and D. Watson: Mood and the mundane: Relations between daily life events and self-reported mood; Journal of Personality and Social Psychology, vol.54, pp.296--308, 1988.Google ScholarGoogle ScholarCross RefCross Ref
  21. D. Watson, L. A. Clark and A. Tellegen: Cross-cultural convergence in the structure of mood: A Japanese replication and comparison with U. S. findings; Journal of Personality and Social Psychology, vol.47, pp.127--144, 1984.Google ScholarGoogle ScholarCross RefCross Ref
  22. L. A. Clark and D. Watson: The Japanese Positive and Negative Affect Schedule: Factor-based scales for the assessment of mood; unpublished manuscript. University of Iowa, 1989.Google ScholarGoogle Scholar
  23. A. Criminisi, J. Shotton, A. Blake, and P. H. S. Torr. 2003. Gaze Manipulation for One-to-one Teleconferencing. In Proceedings of the Ninth IEEE International Conference on Computer Vision, Vol. 2, pp.191--198, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. R. Yang and Z. Zhang: Eye Gaze Correction with Stereovision for Video-Teleconferencing; IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.26, no.7, pp.956--960, July, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. C. Kuster, T. Popa, J. Bazin, C. Gotsman and M. Gross: Gaze Correction for Home Video Conferencing; ACM Trans. Graph. (Proc. of ACM SIGGRAPH ASIA), vol.31, no.6, pp.174--180, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Manipulation of an emotional experience by real-time deformed facial feedback

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      AH '13: Proceedings of the 4th Augmented Human International Conference
      March 2013
      254 pages
      ISBN:9781450319041
      DOI:10.1145/2459236

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 7 March 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      AH '13 Paper Acceptance Rate49of69submissions,71%Overall Acceptance Rate121of306submissions,40%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader