skip to main content
10.1145/3397482.3450729acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
Work in Progress

OYaYa: A Desktop Robot Enabling Multimodal Interaction with Emotions

Published: 14 April 2021 Publication History

Abstract

We demonstrate a desktop robot OYaYa that imitates users’ emotional facial expressions and helps users manage emotions. Multiple equipped sensors in OYaYa enable multimodal interaction; for example, it recognizes users’ emotions from facial expressions and speeches. Besides, a dashboard illustrates how users interact with OYaYa and how their emotions change. We expect that OYaYa allows users to manage their emotions in a fun way.

References

[1]
Sharon C Bolton. 2004. Emotion management in the workplace. Macmillan International Higher Education.
[2]
Patrick Bourgeois and Ursula Hess. 2008. The impact of social context on mimicry. Biological psychology 77, 3 (2008), 343–352.
[3]
Cynthia Breazeal and Brian Scassellati. 1998. Infant-like social interactions between a robot and a human caretaker. Adaptive Behavior 8, 1 (1998).
[4]
Mariam Hassib, Max Pfeiffer, Stefan Schneegass, Michael Rohs, and Florian Alt. 2017. Emotion actuator: Embodied emotional feedback through electroencephalography and electrical muscle stimulation. In Proc. of CHI 2017. ACM, 6133–6146.
[5]
Ursula Hess and Agneta Fischer. 2014. Emotional mimicry: Why and when we mimic emotions. Social and Personality Psychology Compass 8, 2 (2014), 45–57.
[6]
Sooyeon Jeong, Cynthia Breazeal, Deirdre Logan, and Peter Weinstock. 2018. Huggable: The Impact of Embodiment on Promoting Socio-emotional Interactions for Young Pediatric Inpatients. In Proc. of CHI 2018. ACM, 495.
[7]
Hajin Lim, Dan Cosley, and Susan R Fussell. 2018. Beyond Translation: Design and Evaluation of an Emotional and Contextual Knowledge Interface for Foreign Language Social Media Posts. In Proc. of CHI 2018. ACM, 217.
[8]
Zhe Liu, Anbang Xu, Yufan Guo, Jalal U Mahmud, Haibin Liu, and Rama Akkiraju. 2018. Seemo: A Computational Approach to See Emotions. In Proc. of CHI 2018. ACM, 364.
[9]
Adam Lobel, Marientina Gotsis, Erin Reynolds, Michael Annetta, Rutger CME Engels, and Isabela Granic. 2016. Designing and utilizing biofeedback games for emotion regulation: The case of nevermind. In Proc. of CHI 2016. ACM, 1945–1951.
[10]
Luis-Alberto Perez-Gaspar, Santiago-Omar Caballero-Morales, and Felipe Trujillo-Romero. 2016. Multimodal emotion recognition with evolutionary computation for human-robot interaction. Expert Systems with Applications 66 (2016), 42–61.
[11]
Eliska Prochazkova and Mariska E Kret. 2017. Connecting minds and sharing emotions through mimicry: A neurocognitive model of emotional contagion. Neuroscience & Biobehavioral Reviews 80 (2017), 99–114.
[12]
Peter Salovey and John D Mayer. 1990. Emotional intelligence. Imagination, cognition and personality 9, 3 (1990), 185–211.
[13]
Minna Vuorela and Lauri Nummenmaa. 2004. Experienced emotions, emotion regulation and student activity in a web-based learning environment. European Journal of Psychology of Education 19, 4 (2004), 423–436.

Index Terms

  1. OYaYa: A Desktop Robot Enabling Multimodal Interaction with Emotions
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      IUI '21 Companion: Companion Proceedings of the 26th International Conference on Intelligent User Interfaces
      April 2021
      101 pages
      ISBN:9781450380188
      DOI:10.1145/3397482
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 14 April 2021

      Check for updates

      Author Tags

      1. emotion management
      2. emotional interaction
      3. multimodal interaction
      4. small Robots

      Qualifiers

      • Work in progress
      • Research
      • Refereed limited

      Conference

      IUI '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 746 of 2,811 submissions, 27%

      Upcoming Conference

      IUI '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 181
        Total Downloads
      • Downloads (Last 12 months)21
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 15 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media