Abstract
In order to build a human-computer interface that is sensitive to a user’s expressed emotion, we propose a neural network based emotion estimation algorithm using heart rate variability (HRV) and galvanic skin response (GSR). In this study, a video clip method was used to elicit basic emotions from subjects while electrocardiogram (ECG) and GSR signals were measured. These signals reflect the influence of emotion on the autonomic nervous system (ANS). The extracted features that are emotion-specific characteristics from those signals are applied to an artificial neural network in order to recognize emotions from new signal collections. Results show that the proposed method is able to accurately distinguish a user’s emotion.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Heart Rate Variability Standard of Measurement physiological interpretation, and clinical use Task Force of The European Society of Cardiology and The North American Society of Pacing and Electrophysiology (Membership of the Task Force listed in the Appendix). European Heart Journal 17, 354–381 (996)
Lang, P.J., Bradley, M.M., Cuthbert, B.N.: NIMH Center for the Study of Emotion and Attention: International Affective Picture System (IAPS). Technical Manual and Affective Ratings (1995)
Rollin Mccraty, M.A., Atkinson, M., Tiler, W.A.: The Effects of Emotions on Short-term power spectrum analysis of heart rate variability 76(14) 1089–1093 (1995)
Tompkins, W.J.: Biomedical Digital Signal processing. Prentice Hall international, Englewood Cliffs
Task Force of the ESC and the NASPE. Heart rate variability: Standards of Measurement. Physiological Interpretation, and Clinical Use. Circulation 5, 1043–1065 (1993)
Moody, G.B.: ECG-based indices of Physical Activity. In: Computers in Cardiology, pp. 403–406. IEEE Computer Society Press, Los Alamitos (1992)
Bourke, E., Sowers, J.R.: The Autonomic Nervous System and Blood Pressure Regulation in the Elderly. Interdiscipl Top Gerontol, vol. 33, pp. 45–52. Basel, Karger (2004)
Holzapfel, H., Denecke, M., Fuegen, C., Waibel, A.: Integrating Emotional Cues into a Framework for Dialogue Management. In: Fourth IEEE International Conference on Multimodal Interfaces (ICMI 2002), October 14 - 16 (2002)
Cacioppo, J.T., Berntson, G.G., Larsen, J.T., Poehlmann, K.M., Ito, T.A.: The psychophysiology of Emotion, 2nd edn. The handbook of emotion, pp. 173–191. Guilford Press, New York
Jain, A.K., Mao, J., Mohiuddin, K.M.: Artificial Neural Networks: A tutorial. IEEE Computer Society 29(3) (March 1996)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall, New Jersey (1999)
Rajapakse, J.C., Wang, L.P. (eds.): Neural Information Processing: Research and Development. Springer, Berlin (2004)
Picard, R.W.: Affective Computing. MIT Press, London (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yoo, S.K., Lee, C.K., Park, Y.J., Kim, N.H., Lee, B.C., Jeong, K.S. (2005). Neural Network Based Emotion Estimation Using Heart Rate Variability and Skin Resistance. In: Wang, L., Chen, K., Ong, Y.S. (eds) Advances in Natural Computation. ICNC 2005. Lecture Notes in Computer Science, vol 3610. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11539087_110
Download citation
DOI: https://doi.org/10.1007/11539087_110
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28323-2
Online ISBN: 978-3-540-31853-8
eBook Packages: Computer ScienceComputer Science (R0)