Abstract
Although many emotion recognition methods have been developed, monitoring a driver’s emotions during driving is still a challenge because some special requirements must be met. This study begins with the classification of emotion, and then proceeds to emotion recognition. In particular, this study presents the applications of blood volume pressure, skin conductance, skin temperature, gripping force, respiration rate, and facial expression in emotion recognition. Experiments are designed and carried out to find the mapping relation among heart rate, skin conductance, and skin temperature to two kinds of emotions: fear and amusement. The experimental results demonstrate the feasibility of using the selected physiological parameters to monitor drivers’ emotions.
Chapter PDF
Similar content being viewed by others
References
NHTSA, Virginia Tech Transportation Institute. Breakthrough Research on Real-World Driver Behavior Released (2006), http://nhtsa.gov
Healey, J.A.: Wearable and automotive systems for affect recognition from physiology, Doctoral thesis (2000)
Kollias, S., Karpouzis, K.: Multimodal emotion recognition and expressivity analysis. In: IEEE International Conference on Multimedia and Expo, ICME 2005, vol. 2005, pp. 779–783 (2005)
Nakasone, A., Prendinger, H., Ishizuka, M.: Emotion recognition from electromyography and skin conductance. In: Proceedings 5th International Workshop on Biosignal Interpretation (BSI-05). Tokyo, Japan, pp. 219–222 (2005)
Leon, E., Clarke, G., Sepulveda, F., Callaghan, V.: Neural network-based improvement in class separation of physiological signals for emotion classification. Cybernetics and Intelligent Systems, IEEE Conference, vol. 2, pp. 724–728 (December 1-3, 2004)
Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): Technical manual and affective rating, NIMH center for the study of emotion and attention. University of Florida
Schlosberg, H.: Three dimensions of emotion. Psychological Review 61, 81–88 (1954)
Russell, J.A.: A circumplex model of affect. Journal of personality and social psychology 39(6), 1161–1178 (1954)
Lang, P.J.: The emotion probe: studies of motivation and attention. American Psychologist 50(5), 372–385 (1995)
Takahashi, K., Tsukaguchi, A.: Remarks on emotion recognition from multi-modal bio-potential signals. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 2, pp. 1654–1659 (2003)
Kim, K.H., Bang, S.W., Kim, S.R.: Emotion recognition system using short-term monitoring of physiological signals. Medical and Biological Engineering and Computing 42(3), 419–427 (2004)
Cohen, I., Garg, A., Huang, T.S.: Emotion Recognition from Facial Expressions using Multilevel HMM. Neural Inf. Process Syst. (2000)
Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal human-computer interaction. In: Proceedings of the IEEE, Human-Computer Multimodal Interface. vol. 91(9), pp. 1370–1390 (September 2003)
Wang, Y., Guan, L.: An investigation of speech-based human emotion recognition. Multimedia Signal Processing. In: IEEE 6th Workshop on (29 September -1 October), pp. 15–18 (2004)
Lin, Y.L., Wei, G.: Speech emotion recognition based on HMM and SVM. International Conference on Machine Learning and Cybernetics, ICMLC, pp. 4898–4901 (2005)
Busso, C., Deng, Z., Yildirim, S., Bulut, M., Lee, C., Kazemzadeh, A., Lee, S., Neumann, U., Narayanan, S.: Analysis of emotion recognition using facial expressions, speech and multimodal information. In: ICMI 2004 - Sixth International Conference on Multimodal Interfaces, pp. 205–211 (2004)
Hoch, S., Althoff, F., McGlaun, G., Rigoll, G.: Bimodal fusion of emotional data in an automotive environment. IEEE International Conference on Acoustics, Speech and Signal Processing - In: Proceedings, v II, ICASSP 2005 - Proceedings - Image and Multidimensional Signal Processing Multimedia Signal Processing, pp. II1085–II1088 (2005)
Ekman, P., Levenson, R.W., Friesen, W.V.: Autonomic nervous system activity distinguishes among emotions. Science 221(4616), 1208–1210 (1983)
Palomba, D., Sarlo, M., Angrilli, A., Mini, A.: Cardiac responses associated with affective processing of unpleasant film stimuli. International Journal of Psychophysiology 36(1), 45–57 (2000)
Haag, A., Goronzy, S., Schaich, P., Williams, J.: Emotion recognition using bio-sensors: First steps towards an automatic system. Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science), Affective Dialogue Systems. vol. 3068, pp. 36–48 (2004)
Gross, J.J., Levenson, R.W.: Hiding feelings: the acute effects of inhibiting negative and positive emotion. Journal of Abnormal Psychology 106(1), 95–103 (1997)
Levenson, R.W., Ekman, P., Friesen, W.V.: Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology 27, 363–384 (1990)
Sinha, R., Parsons, O.: Multivariate response patterning of fear and anger. Cognition and Emotion 10(2), 173–198 (1996)
Kroemer, K.: Ergonomics: How to design for ease & efficiency (2nd edition), 2nd edn. Prentice-Hall, NJ (2001)
Rada, H., Dittmar, A., Delhomme, G., Collet, C., Roure, R., Vernet-Maury, E., Priez, A.: Bioelectric and microcirculation cutaneous sensors for the study of vigilance and emotional response during tasks and tests. Biosensors & Bioelectronics 10, 7–15 (1995)
Picard, R., Healey, J.: Affective wearables. In: Proc. of the 1st Int’l Symposium on Wearable Computers (1997)
Polychronopoulos, A., Amditis, A., Bekiaris, E.: Information data flow in AWAKE multi-sensor driver monitoring system, IEEE Intelligent Vehicles Symposium. In: Proceedings, 2004 IEEE Intelligent Vehicles Symposium, pp. 902–906 (2004)
Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal human-computer interaction. In: Proceedings of the IEEE, Human-Computer Multimodal Interface. vol. 91(9), pp. 1370–1390 (September 2003)
Sebe1, N., Cohen, I., Huang, T.S.: Multimodal emotion recognition, WSPC/Trim Size: 9.75in x 6.5in for Review Volume emotion, vol. 16(2) (June 18, 2004)
Lisetti, C.L., Nasoz, F.: Using noninvasive wearable computers to recognize human emotions from physiological signals. Eurasip Journal on Applied Signal Processing 2004(11), 1672–1687 (2004)
Anolli, L., Mantovani, F., Mortillaro, M., Vescovo, A., Agliati, A., Confalonieri, L., Realdon, O., Zurloni, V., Sacchi, A.: A multimodal database as a background for emotional synthesis, recognition and training in E-learning systemS. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 566–573. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Leng, H., Lin, Y., Zanzi, L.A. (2007). An Experimental Study on Physiological Parameters Toward Driver Emotion Recognition. In: Dainoff, M.J. (eds) Ergonomics and Health Aspects of Work with Computers. EHAWC 2007. Lecture Notes in Computer Science, vol 4566. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73333-1_30
Download citation
DOI: https://doi.org/10.1007/978-3-540-73333-1_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73332-4
Online ISBN: 978-3-540-73333-1
eBook Packages: Computer ScienceComputer Science (R0)