Abstract
The purpose of the current study was to examine the effectiveness of galvanic skin responses (GSRs) in emotion recognition using nonlinear approaches. GSR of 35 healthy students was recorded while subjects were listening to emotional music clips. The signals were comprehensively characterized by nonlinear features. Applying three dimensionality reduction methods, including sequential forward selection (SFS), sequential floating forward selection, and random subset feature selection (RSFS) in combination with four classification approaches, including K-nearest neighbor, least-square support vector machine, Fisher discriminant analysis, and quadratic analysis, discrimination between emotional classes was evaluated. In addition, two classification strategies were examined, including binary (BIC) and one vs. rest. The results showed that higher recognition rates were achieved for Fisher. In this case, the BIC accuracy rates were higher than 99% in all emotional states and all feature selection methodologies. The maximum classification rate of 99.98% was obtained using RSFS and Fisher in sadness. Among all emotion categories, better recognition rates were achieved for peacefulness and fear. This study demonstrates that nonlinear GSR characteristics can provide an informative measure to investigate the physiological fluctuations in different emotional states during music.
Similar content being viewed by others
References
Picard, R., Vyzas, E., Healey, J.: Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1175–1191 (2001)
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.G.: Emotion recognition in human–computer interaction. IEEE Signal Process. Mag. 18(1), 32–80 (2001)
Kim, J., Andre, E.: Emotion recognition based on physiological changes in music listening. IEEE Trans. Pattern Anal. Mach. Intell. 30, 2067–2083 (2008)
Sudheesh, N.N., Joseph, K.P.: Investigation into the effects of music and meditation on galvanic skin response. ITBM-RBM 21, 158–163 (2000)
Lajevardi, S.M., Hussain, Z.M.: Automatic facial expression recognition: feature extraction and selection. Signal Image Video Process. 6, 159–169 (2012)
Zhalehpour, S., Akhtar, Z., Erdem, C.E.: Multimodal emotion recognition based on peak frame selection from video. Signal Image Video Process. 10, 827–834 (2015)
Lin, Y.P., Wang, C.H., Wu, T.L., Jeng, S.K., Chen, J.H.: EEG-based emotion recognition in music listening: a comparison of schemes for multiclass support vector machine, In: IEEE International Conference on Acoustics, Speech and Signal Processing—Proceedings ICASSP, Taipei, pp. 489–492 (2009)
Sohaib, A.T., Quareshi, S., Hagelback, J., Hilborn, O., Jercic, P.: Evaluating classifiers for emotion recognition using EEG. In: Foundations of Augmented Cognition, Las Vegas, pp. 492–501 (2013)
Murugappan, M., Rizon, M., Nagarajan, R., Yaacob, S., Hazry, D., Zunaidi, I.: Time-frequency analysis of EEG signals for human emotion detection. In: 4th Kuala Lumpur International Conference on Biomedical Engineering, Kuala Lumpur, pp. 262–265 (2008)
Behbahani, S., Nasrabadi, A.M.: The relation of susceptibility levels of hypnosis and different mental tasks. Signal Image Video Process. 9, 903–911 (2015)
Kumar, Y., Dewal, M.L., Anand, R.S.: Epileptic seizures detection in EEG using DWT-based ApEn and artificial neural network. Sig. Image Video Process. 8, 1323–1334 (2014)
Cheng, J., Guangyuan, L.I.U., Xiangwei, L.A.I.: Calculation of nonlinear features of SC for emotion recognition. J. Comput. Inf. Syst. 10(6), 2331–2339 (2014)
Xianhai, G.: Study of emotion recognition based on electrocardiogram and RBF neural network. Proc. Eng. 15, 2408–2412 (2011)
Li, L., Chen, J.-H.: Emotion recognition using physiological signals. In: 16th International Conference on Artificial Reality and Telexistence, Hangzhou, pp. 437–446 (2006)
Nasoz, F., Alvarez, K., Lisetti, C.L., Finkelstein, N.: Emotion recognition from physiological signals using wireless sensors for presence technologies. Cogn. Technol. Work 6, 4–14 (2003)
Maaoui, C., Pruski, A.: Emotion recognition through physiological signals for human–machine communication. In: Kordic, V. (ed.) Cutting Edge Robotics, pp. 317–332. InTech (2010). http://www.intechopen.com/books/cutting-edge-robotics-2010/emotion-recognitionthrough-physiological-signals-for-human-machine-communication
Zhu, X.: Emotion recognition of EMG based on BP neural network. In: Proceedings of the 2nd International Symposium on Networking and Network Security (ISNNS’10), Jinggangshan, pp. 227–229 (2010)
Jang, E.H., Park, B.J., Park, M.S., Kim, S.H., Sohn, J.H.: Analysis of physiological signals for recognition of boredom, pain, and surprise emotions. J. Physiol. Anthropol. 34, 25 (2015)
Vieillard, S., Peretz, I., Gosselin, N., Khalfa, S., Gagnon, L., Bouchard, B.: Happy, sad, scary and peaceful musical excerpts for research on emotions. Cognit. Emot. 22, 720–752 (2008)
Goshvarpour, A., Abbasi, A., Goshvarpour, A.: Evaluating autonomic parameters: the role of sleepyduration in emotional responses to music. Iran J Psychiatry 11, 59–63 (2016)
Goshvarpour, A., Goshvarpour, A., Rahati, S.: Analysis of lagged Poincaré plots in heart rate signals during meditation. Digit. Signal Process. 21, 208–214 (2011)
Lerma, C., Infant, O., Perez-Grovas, H., Jose, M.: Poincaré plot indexes of heart rate variability capture dynamic adaptations after haemodialysis in chronic renal failure patients. Clin. Physiol. Funct. Imaging 23(2), 72–80 (2003)
Karmakar, C., Khandoker, A., Gubbi, J., Palaniswami, M.: Complex correlation measure: a novel descriptor for Poincaré plot. Biomed. Eng. Online 8, 17 (2009)
Zbilut, J.P., Webber, C.L.: Embeddings and delays as derived from quantification of recurrence plots. Phys. Lett. A 171(3–4), 190–203 (1992)
Webber, C.L., Zbilut, J.P.: Dynamical assessment of physiological systems and states using recurrence plot strategies. J. Appl. Physiol. 76(2), 965–973 (1994)
Marwan, N., Romano, M.C., Thiel, M., Kurths, J.: Recurrence plots for the analysis of complex systems. Phys. Rep. 438, 237–329 (2007)
Guo, R., Wang, Y., Yan, J., Yan, H.: Recurrence quantification analysis on pulse morphological changes in patients with coronary heart disease. J. Tradit. Chin. Med. 32(4), 571–577 (2012)
Pincus, S.M.: Approximate entropy as a measure of system complexity. Proc. Natl. Acad. Sci. USA 88, 2297 (1991)
Rosenstein, M.T., Collins, J.J., DeLuca, C.J.: A practical method for calculating largest Lyapunov exponents from small data sets. Phys. D 65, 117 (1993)
Valenza, G., Allegrini, P., Lanata, A., Scilingo, E.P.: Dominant Lyapunov exponent and approximate entropy in heart rate variability during emotional visual elicitation. Front. Neuroeng. Article 3, 5, 1–7 (2012)
Kennel, M.B., Brown, R., Abarbanel, H.D.I.: Determining embedding dimension for phase space reconstruction using a geometrical construction. Phys. Rev. A 45(6), 3403–3411 (1992)
Peng, C.K., Havlin, S., Stanley, H.E., Goldberger, A.L.: Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series. Chaos 5, 82–87 (1995)
Lempel, A., Ziv, J.: On the complexity of finite sequences. IEEE Trans. Inform. Theory 22, 75–81 (1976)
Moharreri, S., Rezaei, S., Dabanloo, N., Parvaneh, S.: Extended parabolic phase space mapping (EPPSM): novel quadratic function for representation of heart rate variability signal. Comput. Cardiol. 41, 417–420 (2014)
Whitney, A.W.: A direct method of nonparametric measurement selection. IEEE Trans. Comput. 20, 1100–1103 (1971)
Pudil, P., Novovicova, J., Kittler, J.: Floating search methods in feature selection. Pattern Recognit. Lett. 15, 1119–1125 (1994)
Räsänen, O., Pohjalainen, J.: Random subset feature selection in automatic recognition of developmental disorders, affective states, and level of conflict from speech. In: Interspeech, pp. 210–214 (2013)
Hu, Y.H., Hwang, J.N. (eds.): Handbook of neural network signal processing. Electrical engineering and applied signal processing (Series), CRC PRESS, New York (2002)
Suykens, J.A.K., Van Gestel, T., De Brabanter, J., De Moor, B., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific, Singapore (2002)
Suykens, J.A.K., Vandewalle, J.: Least squares support vector machine classifiers. Neural Process. Lett. 9, 293–300 (1999)
Zhou, J., Shi, J., Li, G.: Fine tuning support vector machines for short-term wind speed forecasting. Energ. Convers. Manag. 52, 1990–1998 (2011)
Pelckmans, K., Suykens, JAK., Gestel, VT., De Brabanter, J., Lukas, L., Hamers, B., De Moor, B., Vandewalle, J.: LS-SVMlab: a MATLAB/C Toolbox for Least Squares Support Vector Machines. ESAT-SCD-SISTA K.U. Leuven-Heverlee,
Dudoit, S., Fridlyand, J., Speed, T.P.: Comparison of discrimination methods for the classification of tumors using gene expression data. J. Am. Stat. Assoc. 97, 77–87 (2002)
Michie, D., Spiegelhalter, D.J., Taylor, C.C. (eds.): Machine Learning, Neural and Statistical Classification. Ellis Horwood Upper Saddle River, NJ, USA (1994)
Duin, R.P.W.: PRTools, Version 3.2, A MATLAB Toolbox for Pattern Recognition, Pattern Recognition Group, Delft University of Technology (2003)
Khazaei, D., Setarehdan, S.K., Zandi Mehran, Y.: The effectiveness of music on human biological signals. Biomed. Eng. Appl. Basis Commun. 28(1), 1650002 (2016)
Zong, C., Chetouani, M.: Hilbert-Huang transform based physiological signals analysis for emotion recognition. In: IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Ajman, pp. 334–339 (2009)
Verma, G.K., Tiwary, U.S.: Multimodal fusion framework: a multiresolution approach for emotion classification and recognition from physiological signals. Neuroimage 102, 162–172 (2014)
Rigas, G., Katsis, C.D., Ganiatsas, G., Fotiadis, D.I.: A user independent, biosignal based, emotion recognition method. In: 11th International Conference, UM 2007, Corfu, pp. 314–318 (2007)
Naji, M., Firoozabadi, M., Azadfallah, P.: Emotion classification during music listening from forehead biosignals. Signal Image Video Process. 9, 1365–1375 (2015)
Naji, M., Firoozabadi, M., Azadfallah, P.: A New Information Fusion approach for recognition of music-induced emotions, In: IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Valencia, pp. 205–208 (2014)
Goshvarpour, A., Abbasi, A., Goshvarpour, A., Daneshvar, S.: A novel signal-based fusion approach for accurate music emotion recognition. Biomed. Eng. Appl. Basis Commun. 28(6), 1650040 (2016)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Goshvarpour, A., Abbasi, A., Goshvarpour, A. et al. Discrimination between different emotional states based on the chaotic behavior of galvanic skin responses. SIViP 11, 1347–1355 (2017). https://doi.org/10.1007/s11760-017-1092-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-017-1092-9