Abstract
Affective computing has increased its significance both in terms of academic and industry attention and investment. Alongside, immersive digital environments have settled as a reliable domain, with progressively inexpensive hardware solutions. Having this in mind, the authors envisioned the automatic real-time user emotion extraction through biometric readings in an immersive digital environment. In the running example, the environment consisted in an aeronautical simulation, and biometric readings were based mainly on galvanic skin response, respiration rate and amplitude, and phalanx temperature. The assessed emotional states were also used to modify some simulation context variables, such as flight path, weather conditions and maneuver smoothness level. The results were consistent with the emotional states as stated by the users, achieving a success rate of 77%, considering single emotions and 86% considering a quadrant-based analysis.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Kozima H, Michalowski MP, Nakagawa C (2009) A playful robot for research, therapy, and entertainment. Int J Soc Rob 1(1):3–18
Kim J-H, Jeong I-B, Park I-W, Lee K-H (2009) Multi-layer architecture of ubiquitous robot system for integrated services. Int J Soc Rob 1(1):19–28
Mayo Clinic (2008) Phobias. Available online at http://www.mayoclinic.com/health/phobias/DS00272/DSECTION=symptoms. Accessed December 2008
Stoller G (2006) Fear of flying can cripple workers. USA Today, March 2006. Available online at http://www.usatoday.com/educate/college/business/articles/20060326.htm. Accessed December 2008
Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39:1161–1178
Damásio AR (1998) Emotions and the human brain. Department of Neurology, Iowa, USA
Damásio AR (1994) Descartes error: emotion, reason and human brain. Europa-América
Altarriba J, Basnight DM, Canary TM (2003) Emotion representation and perception across cultures. In: Lonner WJ, Dinnel DL, Hayes SA, Sattler DN (eds) Read in psychol and cult. Center for Cross-Cultural Research, Western Washington University, Bellingham (Unit 4, Chap 5)
Benovoy M, Cooperstock J, Deitcher J (2008) Biosignals analysis and its application in a performance setting—towards the development of an emotional-imaging generator. In: Proc of the first int conf on biomedic electron and devices (Biosignals 2008), pp 253–258
Teixeira J, Vinhas V, Oliveira E, Reis LP (2008) Emotion assessment tool for human-machine interfaces—using EEG data and multimedia stimuli towards emotion classification. In: Int conf on signal process and multimed appl (SIGMAP 2008), pp 185–188
Vinhas V, Oliveira E, Reis LP (2008) Realtime dynamic multimedia storyline based on online audience biometric information. In: KES intell interact multimed syst and serv (KES IIMSS), pp 545–554
Kim J, André E (2008) Multi-channel biosignal analysis for automatic emotion recognition. In: Int conf on bio-inspired syst and signal process (Biosignals 2008)
Katsis C, Katertsidis N, Ganiatsas G, Fotiadis D (2008) Towards emotion recognition in car-racing drivers: a biosignal processing approach. IEEE Trans Syst Man Cybern, Part A, Syst Hum 38(3):502–512
Simtrain LLC (2008) Available online at http://www.simtrain.net/index.html. Accessed December 2008
Gimenes R, Silva DC, Reis, LP, Oliveira E (2008) Flight simulation environments applied to agent-based autonomous UAVs. In: Int conf on enterp inf syst (ICEIS 2008), pp 243–246
Lewis M, Jacobson J (2002) Game engines in scientific research. Commun ACM 45(1):27–31
Kahan M, Tanzer J, Darvin D, Borer F (2000) Virtual reality-assisted cognitive-behavioral treatment for fear of flying: acute treatment and follow-up. Cyberpsychol Behav 3(3):387–392
da Costa R, Sardinha A, Nardi A (2008) Virtual reality exposure in the treatment of fear of flying. Aviat Space Environ Med 79(9):899–903
Anderson P, Jacobs CH, Lindner GK, Edwards S, Zimand E, Hodges L, Rothbaum BO (2006) Cognitive behavior therapy for fear of flying: sustainability of treatment gains after September 11. Behav Ther 37(1):91–97
Rothbaum BO, Anderson P, Zimand E, Hodges L, Lang D, Wilson J (2006) Virtual reality exposure therapy and standard (in vivo) exposure therapy in the treatment for the fear of flying. Behav Ther 37(1):80–90
Virtual Aviation (2008) Available online at http://www.virtualaviation.co.uk/. Accessed December 2008
Bird S (2005) You’re cleared for take-off—how to tackle a fear of flying on a virtual plane. The Times. Available online at http://www.timesonline.co.uk/tol/life_and_style/health/features/article549165.ece. Accessed December 2008
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Silva, D.C., Vinhas, V., Reis, L.P. et al. Biometric Emotion Assessment and Feedback in an Immersive Digital Environment. Int J of Soc Robotics 1, 307–317 (2009). https://doi.org/10.1007/s12369-009-0029-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-009-0029-z