Skip to main content
Log in

Discrimination between different emotional states based on the chaotic behavior of galvanic skin responses

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The purpose of the current study was to examine the effectiveness of galvanic skin responses (GSRs) in emotion recognition using nonlinear approaches. GSR of 35 healthy students was recorded while subjects were listening to emotional music clips. The signals were comprehensively characterized by nonlinear features. Applying three dimensionality reduction methods, including sequential forward selection (SFS), sequential floating forward selection, and random subset feature selection (RSFS) in combination with four classification approaches, including K-nearest neighbor, least-square support vector machine, Fisher discriminant analysis, and quadratic analysis, discrimination between emotional classes was evaluated. In addition, two classification strategies were examined, including binary (BIC) and one vs. rest. The results showed that higher recognition rates were achieved for Fisher. In this case, the BIC accuracy rates were higher than 99% in all emotional states and all feature selection methodologies. The maximum classification rate of 99.98% was obtained using RSFS and Fisher in sadness. Among all emotion categories, better recognition rates were achieved for peacefulness and fear. This study demonstrates that nonlinear GSR characteristics can provide an informative measure to investigate the physiological fluctuations in different emotional states during music.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Picard, R., Vyzas, E., Healey, J.: Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1175–1191 (2001)

    Article  Google Scholar 

  2. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.G.: Emotion recognition in human–computer interaction. IEEE Signal Process. Mag. 18(1), 32–80 (2001)

    Article  Google Scholar 

  3. Kim, J., Andre, E.: Emotion recognition based on physiological changes in music listening. IEEE Trans. Pattern Anal. Mach. Intell. 30, 2067–2083 (2008)

    Article  Google Scholar 

  4. Sudheesh, N.N., Joseph, K.P.: Investigation into the effects of music and meditation on galvanic skin response. ITBM-RBM 21, 158–163 (2000)

    Article  Google Scholar 

  5. Lajevardi, S.M., Hussain, Z.M.: Automatic facial expression recognition: feature extraction and selection. Signal Image Video Process. 6, 159–169 (2012)

    Article  Google Scholar 

  6. Zhalehpour, S., Akhtar, Z., Erdem, C.E.: Multimodal emotion recognition based on peak frame selection from video. Signal Image Video Process. 10, 827–834 (2015)

    Article  Google Scholar 

  7. Lin, Y.P., Wang, C.H., Wu, T.L., Jeng, S.K., Chen, J.H.: EEG-based emotion recognition in music listening: a comparison of schemes for multiclass support vector machine, In: IEEE International Conference on Acoustics, Speech and Signal Processing—Proceedings ICASSP, Taipei, pp. 489–492 (2009)

  8. Sohaib, A.T., Quareshi, S., Hagelback, J., Hilborn, O., Jercic, P.: Evaluating classifiers for emotion recognition using EEG. In: Foundations of Augmented Cognition, Las Vegas, pp. 492–501 (2013)

  9. Murugappan, M., Rizon, M., Nagarajan, R., Yaacob, S., Hazry, D., Zunaidi, I.: Time-frequency analysis of EEG signals for human emotion detection. In: 4th Kuala Lumpur International Conference on Biomedical Engineering, Kuala Lumpur, pp. 262–265 (2008)

  10. Behbahani, S., Nasrabadi, A.M.: The relation of susceptibility levels of hypnosis and different mental tasks. Signal Image Video Process. 9, 903–911 (2015)

    Article  Google Scholar 

  11. Kumar, Y., Dewal, M.L., Anand, R.S.: Epileptic seizures detection in EEG using DWT-based ApEn and artificial neural network. Sig. Image Video Process. 8, 1323–1334 (2014)

    Article  Google Scholar 

  12. Cheng, J., Guangyuan, L.I.U., Xiangwei, L.A.I.: Calculation of nonlinear features of SC for emotion recognition. J. Comput. Inf. Syst. 10(6), 2331–2339 (2014)

    Google Scholar 

  13. Xianhai, G.: Study of emotion recognition based on electrocardiogram and RBF neural network. Proc. Eng. 15, 2408–2412 (2011)

    Article  Google Scholar 

  14. Li, L., Chen, J.-H.: Emotion recognition using physiological signals. In: 16th International Conference on Artificial Reality and Telexistence, Hangzhou, pp. 437–446 (2006)

  15. Nasoz, F., Alvarez, K., Lisetti, C.L., Finkelstein, N.: Emotion recognition from physiological signals using wireless sensors for presence technologies. Cogn. Technol. Work 6, 4–14 (2003)

    Article  Google Scholar 

  16. Maaoui, C., Pruski, A.: Emotion recognition through physiological signals for human–machine communication. In: Kordic, V. (ed.) Cutting Edge Robotics, pp. 317–332. InTech (2010). http://www.intechopen.com/books/cutting-edge-robotics-2010/emotion-recognitionthrough-physiological-signals-for-human-machine-communication

  17. Zhu, X.: Emotion recognition of EMG based on BP neural network. In: Proceedings of the 2nd International Symposium on Networking and Network Security (ISNNS’10), Jinggangshan, pp. 227–229 (2010)

  18. Jang, E.H., Park, B.J., Park, M.S., Kim, S.H., Sohn, J.H.: Analysis of physiological signals for recognition of boredom, pain, and surprise emotions. J. Physiol. Anthropol. 34, 25 (2015)

    Article  Google Scholar 

  19. Vieillard, S., Peretz, I., Gosselin, N., Khalfa, S., Gagnon, L., Bouchard, B.: Happy, sad, scary and peaceful musical excerpts for research on emotions. Cognit. Emot. 22, 720–752 (2008)

    Article  Google Scholar 

  20. Goshvarpour, A., Abbasi, A., Goshvarpour, A.: Evaluating autonomic parameters: the role of sleepyduration in emotional responses to music. Iran J Psychiatry 11, 59–63 (2016)

    Google Scholar 

  21. Goshvarpour, A., Goshvarpour, A., Rahati, S.: Analysis of lagged Poincaré plots in heart rate signals during meditation. Digit. Signal Process. 21, 208–214 (2011)

    Article  Google Scholar 

  22. Lerma, C., Infant, O., Perez-Grovas, H., Jose, M.: Poincaré plot indexes of heart rate variability capture dynamic adaptations after haemodialysis in chronic renal failure patients. Clin. Physiol. Funct. Imaging 23(2), 72–80 (2003)

    Article  Google Scholar 

  23. Karmakar, C., Khandoker, A., Gubbi, J., Palaniswami, M.: Complex correlation measure: a novel descriptor for Poincaré plot. Biomed. Eng. Online 8, 17 (2009)

    Article  Google Scholar 

  24. Zbilut, J.P., Webber, C.L.: Embeddings and delays as derived from quantification of recurrence plots. Phys. Lett. A 171(3–4), 190–203 (1992)

    Google Scholar 

  25. Webber, C.L., Zbilut, J.P.: Dynamical assessment of physiological systems and states using recurrence plot strategies. J. Appl. Physiol. 76(2), 965–973 (1994)

  26. Marwan, N., Romano, M.C., Thiel, M., Kurths, J.: Recurrence plots for the analysis of complex systems. Phys. Rep. 438, 237–329 (2007)

    Article  MathSciNet  Google Scholar 

  27. Guo, R., Wang, Y., Yan, J., Yan, H.: Recurrence quantification analysis on pulse morphological changes in patients with coronary heart disease. J. Tradit. Chin. Med. 32(4), 571–577 (2012)

    Article  Google Scholar 

  28. Pincus, S.M.: Approximate entropy as a measure of system complexity. Proc. Natl. Acad. Sci. USA 88, 2297 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  29. Rosenstein, M.T., Collins, J.J., DeLuca, C.J.: A practical method for calculating largest Lyapunov exponents from small data sets. Phys. D 65, 117 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  30. Valenza, G., Allegrini, P., Lanata, A., Scilingo, E.P.: Dominant Lyapunov exponent and approximate entropy in heart rate variability during emotional visual elicitation. Front. Neuroeng. Article 3, 5, 1–7 (2012)

  31. Kennel, M.B., Brown, R., Abarbanel, H.D.I.: Determining embedding dimension for phase space reconstruction using a geometrical construction. Phys. Rev. A 45(6), 3403–3411 (1992)

    Article  Google Scholar 

  32. Peng, C.K., Havlin, S., Stanley, H.E., Goldberger, A.L.: Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series. Chaos 5, 82–87 (1995)

    Article  Google Scholar 

  33. Lempel, A., Ziv, J.: On the complexity of finite sequences. IEEE Trans. Inform. Theory 22, 75–81 (1976)

  34. Moharreri, S., Rezaei, S., Dabanloo, N., Parvaneh, S.: Extended parabolic phase space mapping (EPPSM): novel quadratic function for representation of heart rate variability signal. Comput. Cardiol. 41, 417–420 (2014)

    Google Scholar 

  35. Whitney, A.W.: A direct method of nonparametric measurement selection. IEEE Trans. Comput. 20, 1100–1103 (1971)

    Article  MATH  Google Scholar 

  36. Pudil, P., Novovicova, J., Kittler, J.: Floating search methods in feature selection. Pattern Recognit. Lett. 15, 1119–1125 (1994)

    Article  Google Scholar 

  37. Räsänen, O., Pohjalainen, J.: Random subset feature selection in automatic recognition of developmental disorders, affective states, and level of conflict from speech. In: Interspeech, pp. 210–214 (2013)

  38. Hu, Y.H., Hwang, J.N. (eds.): Handbook of neural network signal processing. Electrical engineering and applied signal processing (Series), CRC PRESS, New York (2002)

  39. Suykens, J.A.K., Van Gestel, T., De Brabanter, J., De Moor, B., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific, Singapore (2002)

    Book  MATH  Google Scholar 

  40. Suykens, J.A.K., Vandewalle, J.: Least squares support vector machine classifiers. Neural Process. Lett. 9, 293–300 (1999)

  41. Zhou, J., Shi, J., Li, G.: Fine tuning support vector machines for short-term wind speed forecasting. Energ. Convers. Manag. 52, 1990–1998 (2011)

    Article  Google Scholar 

  42. Pelckmans, K., Suykens, JAK., Gestel, VT., De Brabanter, J., Lukas, L., Hamers, B., De Moor, B., Vandewalle, J.: LS-SVMlab: a MATLAB/C Toolbox for Least Squares Support Vector Machines. ESAT-SCD-SISTA K.U. Leuven-Heverlee,

  43. Dudoit, S., Fridlyand, J., Speed, T.P.: Comparison of discrimination methods for the classification of tumors using gene expression data. J. Am. Stat. Assoc. 97, 77–87 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  44. Michie, D., Spiegelhalter, D.J., Taylor, C.C. (eds.): Machine Learning, Neural and Statistical Classification. Ellis Horwood Upper Saddle River, NJ, USA (1994)

  45. Duin, R.P.W.: PRTools, Version 3.2, A MATLAB Toolbox for Pattern Recognition, Pattern Recognition Group, Delft University of Technology (2003)

  46. Khazaei, D., Setarehdan, S.K., Zandi Mehran, Y.: The effectiveness of music on human biological signals. Biomed. Eng. Appl. Basis Commun. 28(1), 1650002 (2016)

  47. Zong, C., Chetouani, M.: Hilbert-Huang transform based physiological signals analysis for emotion recognition. In: IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Ajman, pp. 334–339 (2009)

  48. Verma, G.K., Tiwary, U.S.: Multimodal fusion framework: a multiresolution approach for emotion classification and recognition from physiological signals. Neuroimage 102, 162–172 (2014)

    Article  Google Scholar 

  49. Rigas, G., Katsis, C.D., Ganiatsas, G., Fotiadis, D.I.: A user independent, biosignal based, emotion recognition method. In: 11th International Conference, UM 2007, Corfu, pp. 314–318 (2007)

  50. Naji, M., Firoozabadi, M., Azadfallah, P.: Emotion classification during music listening from forehead biosignals. Signal Image Video Process. 9, 1365–1375 (2015)

    Article  Google Scholar 

  51. Naji, M., Firoozabadi, M., Azadfallah, P.: A New Information Fusion approach for recognition of music-induced emotions, In: IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Valencia, pp. 205–208 (2014)

  52. Goshvarpour, A., Abbasi, A., Goshvarpour, A., Daneshvar, S.: A novel signal-based fusion approach for accurate music emotion recognition. Biomed. Eng. Appl. Basis Commun. 28(6), 1650040 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ataollah Abbasi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goshvarpour, A., Abbasi, A., Goshvarpour, A. et al. Discrimination between different emotional states based on the chaotic behavior of galvanic skin responses. SIViP 11, 1347–1355 (2017). https://doi.org/10.1007/s11760-017-1092-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-017-1092-9

Keywords

Navigation