Abstract
Emotions are important in many aspects of human behavior. Emotions are displayed on human faces, they are reflected in human memory, and they even influence human intelligence. The creation of robots that try to mimic humans arises the question of how the concept of emotion can be transferred to robots. There is no unique answer to the question, however many robots that leverage emotions exist. By summarizing the work done on these robots we try to enlighten the relations between robots and emotions from several perspectives. We first identify how artificial emotion can be defined in a robotic system. Next, we investigate the possible roles of emotions in robotic behavior models and analyze different implementations of the concept of emotion in these models. Finally, we elaborate on the evaluation of how emotions influence human-robot interaction. For this purpose, we qualitatively analyzed a selected set of robots that include emotions in their model. Considering the diversity of state-of-the-art approaches to using emotions in robots, we try to present the findings in a structured and comprehensive way that could be valuable for future researchers.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Cherry, K.: Overview of the 6 Major Theories of Emotion. Verywellmind. https://www.verywellmind.com/theories-of-emotion-2795717. Accessed May 2019 (2019)
Xin, L., Lun, X., Zhi-Iang, W., Dong-mei, F.: Robot emotion and performance regulation based on HMM. Int. J. of Adv. Robot. Syst. 10(160), 1–6 (2013)
Hokuma. Plutchik’s Wheel of Emotions: What is it and How to Use it in Counseling?. Positive Psychology Articles. https://positivepsychologyprogram.com/emotion-wheel/ Accessed September 2017 (2017)
Ekman, P.: Basic Emotions. In: Dalgeleish, T., Power, M. (eds.) Handbook of Cognition and Emotion. Wiley, New York (1999)
Plutchik, R.: Emotion: a Psychoevolutionary Synthesis. Harper and Row, New York (1980)
Frijda, N.: Emotions are Functional, Most of the Time. In: Ekman, P., Davidson, R (eds.) The Nature of Emotion, pp 112–122. Oxford University Press, New York (1994)
Scherer, K.R.: What are emotions? and how can they be measured?. Soc. Sci. Inf. 44(4), 695–729 (2005)
Plutchik, R.: The Emotions. University Press of America, Lanham (1991)
Ziemke, Z., Lowe, R.: On the role of emotion in embodied cognitive architectures: from organisms to robots. Cogn. Comput. 1, 104–117 (2009)
Yang, F., Zhen, X.: Research on the Agent’s behavior decision-making based on artificial emotion. J. Inf. and Comput. Sci. 8(11), 2723–2722 (2014)
Bartneck, C., Forlizzi, J.: A design-centered Framework for social-human interaction. RO-MAN, 591–594 (2004)
Ruthger, R., Gelder, B.D.: Context influences early perceptual analysis of faces—an electrophysiological study. Cereb. Cortex 16(9), 1249–1257 (2005)
Levenson, R.: Human emotions: a functional view. In: Ekman, P., Davidson, R (eds.) The Nature of Emotion, pp 123–126. Oxford University Press, New York (1994)
Dautenhahn, K.: I could be you: the phenomenological dimension of social understanding. Cybern. and Syst. 28(5), 417– 453 (1997)
Ekman, P.: Darwin’s contributions to our understanding of emotional expressions. Philos. Trans. of the Royal Soc. B Biol. Sci. 364(1535), 3449–3451 (2009)
Mowrer, O.H.: Learning theory and behavior. Wiley, New York (1960)
Bozinovski, S.: A self-learning system using secondary reinforcement. In: Trappl, R. (ed.) Cybernatics and Systems Research, pp 397–402, North-Holland (1982)
Bozinovski, S., Dobnikar, A., et al: Crossbar adaptive array: the first connectionist network that solved the delayed reinforcement learning problem. In: Artificial Neural Networks and Genetic Algorithms. Springer (1999)
Braezael, C.: Function meets style: insights from emotion theory applied to HRI. IEEE Trans. Syst. Man Cybern. (Part C) 34(2), 187–194 (2004). https://doi.org/10.1109/TSMCC.2004.826270
Slowan, A., Croucher, M.: Why robots will have emotions. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, vol. 1, pp 197–202 (1981)
Salichs, M., Barber, R., et al.: Maggie: a robotic platform for Human-Robot social interaction. In: IEEE Conference on Robotics, Automation and Mechatronics, pp 1–7 (2006)
Arkin, R.C.: Moving up the food chain: motivation and emotion in behavior-based robots. In: Fellous, J. (ed.) Who Needs Emotions: the Brain Meets the Robot. Oxford University Press (2005)
Minsky, M.: The emotion Machine:Commonsense thinking, artificial intelligence, and the future of the human mind. Simon and Schuster, New York (2006)
Hayes-Roth, B.: Agents on stage: Advancing the state of the art of AI. In: Proceedings of the 14th International. Joint Conference on Artificial Intelligence, pp 967–971 (1995)
Paiva, A., Leite, I., Riberie, T.: Emotion modeling for social robots. In: Calvo, R., et al. (eds.) The Oxford Handbook of Affective Computing. Oxford University Press (2015)
Arkin, R.C., Moshkina, L.: Affect in human-robot interaction. In: Calvo, R., et al. (eds.) The Oxford Handbook of Affective Computing. Oxford University Press (2015)
Kirandziska, V., Ackovska, N.: A survey of models of robotic behavior for emotional robots. In: 14th International Conference on Informatics and Information Technologies, pp 158–162 (2017)
Michelle, M., et al.: Body movements for affective expression: a survey of automatic recognition and generation. IEEE Trans. on Affect. Comput. 4(4), 341–359 (2013)
Bethel, C.L., Murphy, R.R.: Survey of non-facial/non-verbal affective expressions for appearance-constrained robots. IEEE Trans. on Syst, Man and Cybern. - Part C 38(1), 83–92 (2008)
Fong, T., Nourbakhsh, I., Dautenhahn, K.: A Survey of socially interactive robots: Concepts, Design and Applications. Technical Report CMU-RI-TR (2002)
Leite, I., Martinho, C., Paiva, A.: Social robots for Long-Term interaction: a survey. Int. J. Soc. Robot. 5(2), 291–308 (2013)
Yan, H., Ang, M.H., Poo, A.N.: A survey on perception methods for Human–Robot interaction in social robots. Int. J. Soc. Robot. 6(1), 85–119 (2014)
Rizzo, P.: Emotional agents for user entertainment: discussing the underlying assumptions. In: Proceedings of the International Workshop on Affect in Interactions the EC 13 programme (1999)
iPal robot. https://www.ipalrobot.com/. Accessed August 2018 (2017)
McGinn, C., Bourke, E: Meet stevie: a socially assistive robot developed through application of a “design-thinking” approach. J. Intell. Robot. Syst. (2019)
Daniels, M.: It’s ERWIN the friendly robot. University of Lincoln. http://www.lincoln.ac.uk/news/2014/02/841.asp. Accessed August 2019 (2014)
Brooks, R., et al.: The Cog project: building humanoid robot, Computation for Metaphors, Analogy and Agents. Lecture notes in Artificial Intelligence 1562 Springer (1998)
Kozima, H., et al.: Infanoid. In: Dautenhahn, K. (ed.) Socially Intelligent Agents, pp 157–164. Springer, US (2002)
Kozima, H., Nakagawa, C., Yasuda, Y.: Designing and observing human-robot interactions for the study of social development and its disorders. In: IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA), pp 41–46 (2005), https://doi.org/10.1109/CIRA.2005.1554252
Toshihiro, T., Sachihiro, S., Toshimi, K., Masaharu, O., Takanori, S.: Interactive pet robot with an emotion model. Adv. Robot. 13(3), 225–226 (1998)
Scheeff, M., et al.: Expressions with sparky: a social robot. In: Dautenhahn, K., Bond, A. H., Cañamero, L., Edmonds, B (eds.) Socially Intelligent Agents: Creating Relationships with Computers and Robots, pp 173–180. Springer, US (2002)
Bittermann, A., Kühnlenz, K., Buss, M.: On the evaluation of emotion expressing robots, pp 2138–2143 (2007), https://doi.org/10.1109/ROBOT.2007.363637
FACE team: http://www.faceteam.it/. Accessed August 2018 (2016)
Canamero, L.D.: Playing the emotion game with feelix. In: Dautenhahn, K., Bond, A. H., Cañamero, L., Edmonds, B (eds.) Socially Intelligent Agents: Creating Relationships with Computers and Robots, pp 69–76. Springer, US (2002)
Emotion Expression Humanoid Robot WE-4R. http://www.takanishi.mech.waseda.ac.jp/top/research/we/we-4r/index.htm (2003). Accessed June 2018
Miwa, H., Ioh, K., Ito, D., Takanobu, H., Takanishi, A.: Introduction of the need model for humanoid robots to generate active behavior. In: Proceedings of IEEE International Conference on Intelligent Robots and Systems (IROS), vol. 2, pp 1400–1406 (2003), https://doi.org/10.1109/IROS.2003.1248840
Miwa, H., Okuchi, T., Itoh, K., Takanobu, H., Takanishi, A.: A new mental model for humanoid robots for human friendly communication introduction of learning system, mood vector and second order equations of emotion. In: Proceedings - IEEE International Conference on Robotics and Automation, vol. 3 , pp 3588–3593 (2003), https://doi.org/10.1109/ROBOT.2003.1242146
Mobahi, H., Ansari, S.: Fuzzy perception, emotion and expression for interactive robots. IEEE Trans. Syst. Man Cybern. 4, 3918–3923 (2003). https://doi.org/10.1109/ICSMC.2003.1244500
Austermann, A., Esau, N., Kleinjohann, L., Kleinjohann, B.: Prosody based emotion recognition for MEXI. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 1138–1144 (2005), https://doi.org/10.1109/IROS.2005.1545341
Esau, N., Wetzel, E., Kleinjohann, L., Kleinjohann, B.: Real-Time Facial expression recognition using a fuzzy emotion model. In: IEEE International Fuzzy Systems Conference, pp 1–6 (2007), https://doi.org/10.1109/FUZZY.2007.4295451
Esau, N., Kleinjohann, L., Kleinjohann, B.: An adaptable fuzzy emotion model for emotion recognition. In: Proceedings of the Conference of the European Society for Fuzzy Logic and Technology, pp 73–78 (2005)
Hirth, J., Schmitz, N., Berns, K.: Emotional architecture for the humanoid robot head ROMAN. In: International Conference on Robotics and Automation (ICRA), pp 2150–2155 (2007), https://doi.org/10.1109/ROBOT.2007.363639
Strupp, S., Schmitz, N., Berns, K.: Visual-Based Emotion Detection for Natural Man-Machine Interaction. In: Dengel, A. R., Berns, K., Breuel, T. M., Bomarius, F., Roth-Berghofer, T. R. (eds.) KI 2008: Advances in Artificial Intelligence. Lecture Notes in Computer Science 5243, pp 356–363. Springer, Berlin (2008)
Braezal, C.: Designing Sociable Robots. MIT Press, Cambridge (2002)
Braezal, C., Aryananda, L.: Recognition of affecitve communicative intent in robot-directed speech. Auton Robots 12(1), 83–104 (2002)
Braezal, C.: Emotion and sociable humanoid robots. Int. J. Human-Comput Stud 59, 119–155 (2003)
Doroftei, I., et. al.: Facial expressions recognition with an emotion expressive robotic head. In: IOP Conference Series: Materials Science and Engineering, vol. 147 (2016)
Movellan, J.R., Tanaka, F., Fortenberry, B., Aisaka, K.: The RUBI/QRIO project: origins, principles, and first steps. In: Proceedings of IEEE International Conference on Development and Learning (ICDL), pp 80–86 (2005), https://doi.org/10.1109/DEVLRN.2005.1490948
Movellan, J.R., et al.: The RUBI project: a progress report. In: Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction(HRI), pp 333–339 (2007), https://doi.org/10.1145/1228716.1228761
Bartneck, C., Okada, M.: eMuu - An emotional robot. In: Demonstration at the RoboFesta (2001)
Bartneck, C.: Emuu an Embodied Emotional Character for the Ambient Intelligent Home. Unpublished Ph.D. thesis ,Eindhoven University of Technology (2002)
Leite, I., Martinho, C., Pereira, A., Paiva, A.: ICAt: An affective game buddy based on anticipatory mechanisms. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, vol. 3, pp 1229–1232 (2008), https://doi.org/10.5555/1402821.140283
Leite, I., Martinho, C., Pereira, A., Paiva, A.: As Time goes by: Long-term evaluation of social presence in robotic companions. RO-MAN, 669–674 (2009)
Zecca, M., et al.: Whole body emotion expressions for KOBIAN humanoid robot - Preliminary experiments with different emotional patterns. RO-MAN, 381–386 (2009)
Hideki, K., Marek, P.M., Cocoro, N.: Keepon a playful robot for research, therapy, and entertainment. Int. J. Soc. Robot. 1(1), 3–18 (2009)
Hyun, E., Yoon, H., Son, S.: Relationships between user experiences and children’s perceptions of the education robot. In: 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp 199–200 (2010), https://doi.org/10.1109/HRI.2010.5453197
Braezal, C., et al.: Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In: International Conference on Intelligent Robots and Systems, pp 708–713 (2005), https://doi.org/10.1109/IROS.2005.1545011
Brooks, G.A., Gray, J., Hoffman, G.: Robot’s play: interactive games with sociable machines. Comput. Entertain. 2(3), 1–18 (2004)
Impact of Kaspar. http://www.herts.ac.uk/kaspar/impact-of-kaspar (2018). Accessed August 2018
Dautenhahn, K., et al.: KASPAR – A minimally expressive humanoid robot for human–robot interaction research. Appl. Bionics Biomech. 6(3–4), 369–397 (2009)
SMART PROJECT. A synergy between a humanoid robot and a personal mobile device tool for children with Autism Spectrum Disorder. https://smartproject.mk (2019). Accessed
Schulte, J., Rosenberg, C., Thrun, S.: Spontaneous short-term interaction with mobile robots in public places. In: Proceedings of IEEE International Conference on Robotics and Automation, pp 658–663 (1999), https://doi.org/10.1109/ROBOT.1999.770050
Emotion robotics. http://www.emotion-robotics.com/ (2010). Accessed June 2018
Barakova, E.I., Lourens, T.: Expressing and interpreting emotional movements in social games with robots. Pers. Ubiquitous Comput. 14, 457–467 (2010)
Erden, M.S.: Emotional postures for the Humanoid-Robot nao. Int. J. Soc. Robot. 5(4), 441–456 (2013)
Nanty, A., Gelin, R.: Fuzzy controlled PAD emotional state of a NAO robot. In: Conference on Technologies and Applications of Artificial Intelligence, pp 90–96 (2013), https://doi.org/10.1109/TAAI.2013.30
Miskam, M.A., Shamsuddin, S., Samat, M.A., Yussof, H., Ainudin, H.A., Omar, A R.: Humanoid robot NAO as a teaching tool of emotion recognition for children with autism using the Android app. In: International Symposium on Micromechatronics and Human Science, pp 1–5 (2014), https://doi.org/10.1109/MHS.2014.7006084
Andreasson, R., Alenljung, B., Billing, E., Lowe, R.: Affective touch in Human-Robot interaction: conveying emotion to the nao robot. Int. J. Soc. Robot. 10, 473–491 (2018)
Tutsoy, O., Gongo, F., Barkana, D.E., Kose, H.: An emotion analysis algorithm and implementation to Nao humanoid robot. In: The Eurasia Proceedings of Science, Technology, Engineering & Mathematics (EPSTEM) , vol. 1, pp 316–330 (2017)
Tanevska, A., Ackovska, N., Kirandziska, V.: Assistive robotics as therapy for autistic children. In: International Conference for Electronics, Telecommunications, Automation and Informatics (2016)
Stojanovska, F., Toshevska, M., Kirandziska, V., Ackovska, N.: Emotion-Aware Teaching Robot: Learning to Adjust to User’s Emotional State. In: Kalajdziski, S., Ackovska, N (eds.) ICT Innovations 2018 Engineering and Life Sciences. Communications in Computer and Information Science. Accessed 2019, vol. 940, pp 59–74. Springer, Cham (2018)
Pepper - SoftBank Corp. https://www.softbank robotics.com/ (2018). Accessed September 2018
SoftBank Corp: Pepper—the World’s First Personal Robot that Reads Emotions, New Breeze Autumn 2015, 18–20 (2015)
Bechade, L., Dubuisson-Duplessis, G., Pittaro, G., Garcia, M.: Devillers L.: Towards Metrics of Evaluation of Pepper Robot as a Social Companion for Elderly People. In: Eskenazi, M., Devillers, L., Mariani, J (eds.) Advanced Social Interaction with Agents. Lecture Notes in Electrical Engineering 510, pp 89–101. Springer, Cham (2019)
Dang, T L.Q., Tuyen, N.T.V., Jeong, S., Chong, N.Y.: Encoding cultures in robot emotion representation. RO-MAN, 547–552 (2017)
Cassata, C. Can a Robot Help People Overcome Loneliness?. https://www.healthline.com/health-news/can-robots-help-people-overcome-loneliness. Accessed September 2018 (2017)
Zenbo. https://zenbo.asus.com/ (2018). Accessed September 2018
Qidwai, U., Kashem, S.B.A., Conor, O.: Humanoid robot as a teacher’s assistant: helping children with autism to learn social and academic skills. J. Intell. Robot Syst. (2019)
New ‘emotional’ robots aim to read human feelings. https://www.fin24.com/Tech/new-emotional-robots-aim-to-read-human-feelings-20180111 (2018). Accessed 2019
Goodwin, A. Honda debuts four very different robotics concepts at CES. https://www.cnet.com/roadshow/news/honda-3e-robotics-concepts/ (2018). Accessed 2018
Mehrabian, A., Russell, J.A.: An Approach to Environmental Psychology. MIT Press, Cambridge (1974)
Scheutz, M.: Using roles of emotions in artificial agents: a case study from artificial life. In: Proceedings of 19th National Congress on Artificial Intelligence, pp 42–47 (2004)
Wang, Z.I.: Artificial psychology and artificial emotions. CAAI Trans. Intell. Syst. 1, 38–43 (2006)
Murphy, R.R., Lisetti, C., Tardiff, R., Irish, L.: Gage, a: Emotion based control of cooperating heterogeneous mobile robots. IEEE Trans. Robot. Autom. 18(5), 744–757 (2002). https://doi.org/10.1109/TRA.2002.804503
Kirandziska, V., Ackovska, N.: Tendencies and Perspectives of the Emotions Usage in Robotics. In: Trajanov, D., Bakeva, V (eds.) ICT Innovations 2017 Communications in Computer and Information Science, vol. 778, pp 154–164. Springer, Cham (2017)
Stephens-Fripp, B., Naghdy, F., Stirling, D., et al.: Automatic affect perception based on body gait and posture: a survey. Int. J. Soc. Robotics. 9(5), 617–641 (2017)
Kirandziska, V., Ackovska, N., Madevska – Bogdanova, A.: Comparing emotion recognition from voice and facial data using time invariant features. Int. J. Comput. Electric. Autom. Control Inf. Eng. 10(5), 737–741 (2016). World Acad Sci Eng Technol
Bruce, A., Nourbakhsh, I., Simmons, R.: The role of expressiveness and attention in human-robot interaction. In: Proceedings of the IEEE International Conference on Robotics and Automation, vol. 4, pp 4138–4142 (2002), https://doi.org/10.1109/ROBOT.2002.1014396
Kirandziska, V., Ackovska, N.: A concept for building more humanlike social robots and their ethical consequence. Comput. Sci. and Inf. Syst. 9(2), 19–37 (2015)
Tanevska, A., Ackovska, N., Kirandziska, V.: Robot-assisted therapy: considering the social and ethical aspects when working with autistic children. In: Proceedings of the 9th International Workshop on Human-Friendly Robotics, pp 57–60 (2016)
Park, J.W., Lee, H., Chung, M.: Generation of realistic robot facial expressions for human robot interaction. J. Intell. Robot. Syst. 78(3), 443–462 (2015)
LaViers, A., et al.: Choreographic and somatic approaches for the development of expressive robotic systems. Arts 7(2), 11 (2018)
Laban, R., Ullman, L.: The Mastery of Movement. Macdonald & Evans, London (1971)
Samadani, A.A., et al.: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII), pp 343–348 (2013), https://doi.org/10.1109/ACII.2013.63
Coulson, M.: Attributing emotion to static body pbehaostures: recognition accuracy, confusions, and viewpoint dependence. J. Nonverbal Behav. 28(2), 117–139 (2004)
Heather, K., Gray, M.: Acting lesson with robot: Emotional gestures. In: Proceedings of ACM/IEEE International Conference on Human-Robot Interaction, pp 407–407 (2012), https://doi.org/10.1145/2157689.2157821
Rao, R.P.N., Shon, A.P., Maltzoff, A.N.: A Bayesian Model of Imitation in Infants and Robots. In: Nehaniev, C. L., Dautenhahn, K (eds.) Imitation and Social Learning in Robots, Humans and Animals, pp 217–247. Cambridge University Press, New York (2007)
Ortony, A., Clore, G.L., Collins, C.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1990)
Malfaz, M., Salichs, M.A.: A new architecture for autonomous robots based on emotions. In: IFAC/EURON Symposium on Intelligent Autonomous Vehicles, pp 805–809 (2004)
Mirzadeh, M., et al.: Design adaptive fuzzy inference controller for robot arm. Int. J. Inf. Techn. Comput. Sci. 9, 66–73 (2014)
Tee, K.P., Ge, S.S., Tay, E.H.: Barrier Lyapunov functions for the control of output-constrained nonlinear systems. Automatica 45(4), 918–927 (2009)
Ren, B., Ge, S.S., Tee, K.P., Lee, T.H.: Adaptive neural control for output feedback nonlinear systems using a barrier Lyapunov function. IEEE Trans. on Neural Networks 21(8), 1339–1345 (2010)
Sun, K., Mou, S., Qiu, J., Wang, T., Gao, H.: Adaptive fuzzy control for nontriangular structural stochastic switched nonlinear systems with full state constraints. Proc. of IEEE Trans. on Fuzzy Syst. 27(8), 1587–1601 (2019). https://doi.org/10.1109/TFUZZ.2018.2883374
Fang, W., Chao, F., Lin, C.M., Yang, L., Shang, C., Zhou, C.: An improved fuzzy brain emotional learning model network controller for humanoid robots. Front Neurorobotics 13 (2019)
Broekens, J.: Emotion and reinforcement: affective facial expressions facilitate robot learning. In: Huang, T.S., Nijholt, A. (eds.) Artificial Intelligence for Human-Computing, vol. 4451, pp 113–132. Springer (2007)
Kozima, H., Nakagawa, C.: Interactive robots as facilitators of children’s social development. Mobile robots, Towards New Appl. 269–286 (2006)
Acknowledgements
This paper is partially financed by the Faculty of Computer Science and Engineering.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Dimitrievska, V., Ackovska, N. Behavior Models of Emotion-Featured Robots: A Survey. J Intell Robot Syst 100, 1031–1053 (2020). https://doi.org/10.1007/s10846-020-01219-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-020-01219-8