Abstract
Recent affective computing findings indicated that effectively identifying users’ emotional responses is an important issue to improve the quality of ambient intelligence. In the current study, two bipolar facial electromyography (EMG) channels over corrugator supercilii and zygomaticus major were employed for differentiating various emotional states in two dimensions of valence (negative, neutral and positive) and arousal (high and low) while participants looked at affective visual stimuli. The results demonstrated that corrugator EMG and zygomaticus EMG efficiently differentiated negative and positive emotions from others, respectively. Moreover, corrugator EMG discriminated emotions on valence clearly, whereas zygomaticus EMG was ambiguous in neutral and negative emotional states. However, there was no significant statistical evidence for the discrimination of facial EMG responses in the dimension of arousal. Furthermore, correlation analysis proved significant correlations between facial EMG activities and ratings of valence performed by participants and other samples, which strongly supported the consistency of facial EMG reactions and subjective emotional experiences. In addition, the repeatability of facial EMG indicated by intraclass correlation coefficient (ICC) were provided, in which corrugator EMG held an excellent level of repeatability, and zygomaticus EMG grasped only a poor level of repeatability. Considering these results, facial EMG is reliable and effective to identify negative and positive emotional experiences elicited by affective visual stimuli, which may offer us an alternative method in building a basis for automated classification of users’ affective states in various situations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
The data of this part has been reported in IEEE Symposium Series on Computational Intelligence - SSCI 2011, Paris.
References
Bradley MM, Lang PJ (2008) International affective picture system (IAPS) in the study of emotion and attention. In Coan JA and Allen JJ (Eds), Handbook of emotion elicitation and assessment. Oxford university press, pp 29–46
Bradley MM, Cuthbert BN, Lang PJ (1996) Picture media and emotion: effects of a sustained affective context. Psychophysiology 33:662–670
Cacioppo JT, Berntson GG (1994) Relationship between attitudes and evaluative space: a critical review, with emphasis on the separability of positive and negative substrates. Psychol Bull 115:401–423
Cacioppo JT, Petty RE (1981) Electromyograms as measures of extent and affectivity of information processing. Am Psychol 36(5):441–456
Cacioppo JT, Petty RE, Losch ME, Kim HS (1986) Electromyographic activities over facial muscle region can differentiate the valence and intensity of affective reactions. J Pers Soc Psychol 50:260–268
Davis WJ, Rahman MA, Smith LJ, Burns A, Senecal L, McArthur D et al (1995) Properties of human affect induced by static color slides (IAPS): dimensional, categorical and electromyographic analysis. Biol Psychol 41:229–253
Dimberg U (1990) Facial eletromyography and emotion reactions. Psychophysiology 27(5):481–494
Ekman P, Friesen WV (1975) Unmasking the face: a guide to recognizing emotions from facial clues. Prentice-Hall, Englewood Cliffs
Ekman P, Friesen WV, Ancoli S (1980) Facial signs of emotional experience. J Pers Soc Psychol 39(6):1125–1134
Falla D, Dall’Alba P, Rainoldi A, Merletti R, Jull G (2002) Repeatability of surface EMG variables in the sternocleidomastoid and anterior scalene muscles. Eur J Appl Physiol 87(6):542–549
Frantzidis CA, Bratsas C, Klados MA, Konstantinidis E, Lithari CD, Vivas AB, Papadelis CL, Kaldoudi E, Pappas C, Bamidis PD (2010) On the classification of emotional biosignals evoked while viewing affective pictures: an integrated data-mining-based approach for healthcare applications. IEEE Trans Inf Technol Biomed 14(2):309–318
Fridlund AJ, Cacioppo JT (1986) Guidelines for human electromyographic research. Psychophysiology 23:567–589
Granata KP, Padua DA, Abel MF (2005) Repeatability of surface EMG during gait in children. Gait & Posture 22:346–350
Lang PJ, Bradley MM, Cuthbert BN (1990) Emotion, attention, and the startle reflex. Psychol Rev 97:377–395
Lang PJ, Greenwald MK, Bradley MM, Hamm AO (1993) Looking at pictures: affective, facial, visceral, and behavioral reactions. Psychophysiology 30:261–273
Lang PJ, Bradley MM, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville
Larsen JT, Norris JI (2009) A facial electromyographic investigation of affective contrast. Psychophysiology 46:831–842
Larsen JT, Norris CJ, Cacioppo JT (2003) Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology 40:776–785
Mauss IB, Robinson MD (2009) Measures of emotion: a review. Cognition and Emotion 23(2):209–237
Mehrabian A (1995) Framework for a comprehensive description and measurement of emotional states. Genet Soc Gen Psychol 121(3):339–361
Neta M, Norris CJ, Whalen PJ (2009) Corrugator muscle responses are associated with individual differences in positivity-negativity bias. Emotion 9(5):640–648
Rainoldi A, Galardi G, Maderna L, Comi G, Lo Conte L, Merletti R (1999) Repeatability of surface EMG variables during voluntary isometric. J Electromyogr Kinesiol 9:105–119
Sato W, Fujimura T, Suzuki N (2008) Enhanced facial EMG activity in response to dynamic facial expressions. Int J Psychophysiol 70(1):70–74
Suvinen TI, Malmberg J, Forster C, Kemppainen P (2009) Postural and dynamic masseter and anterior temporalis muscle EMG repeatability in serial assessments. J Oral Rehabil 36:814–820
Tassinary LG, Cacioppo JT, Vanman EJ (2007) The skeleto-motor system: surface electromyography. In: Cacioppo JT, Tassinary LG, Berntson GG (eds) Handbook of psychophysiology, 3rd edn. Cambridge University Press, New York, pp 267–302
Teixeira-Silva F, Prado GB, Ribeiro LC, Leite JR (2004) Theanxiogenic video-recorded Stroop Color-Word Test: psychological and physiological alterations and effects of diazepam. Physiol Behav 82(2–3):215–230
Unz DC, Schwab F (2005) Viewers viewed: facial expression patternswhile watching TV news. In: Anolli L, JR Duncan S, Riva G (eds) The hidden structure of interaction: from neurons to culture patterns. IOS press, Amsterdam, pp 253–264
Van Boxtel A (2010) Facial EMG as a tool for inferring affective states. In: Proceedings of measuring behavior 2010, Eindhoven, the Netherlands, August 24–27, 2010
Walter S, Kessler H, Gruss S, Jerg-Bretzke L, Scheck A, Stroebel J, Hoffmann H, Traue HC (2011) The influence of neuroticism and psychological symptoms on the assessment of images in three dimensional emotion space. GMS Psychosoc Med 8:Doc04 (20060606)
Wolak ME, Fairbairn DJ, Paulsen YR (2011) Guidelines for estimating repeatability. Methods Ecol Evol. doi 10.1111/j.2041-210X.2011.00124.x
Acknowledgments
This research was supported by grants from the Transregional Collaborative Research Center SFB/TRR 62 “Companion-Technology for Cognitive Technical System” funded by the German Research Foundation (DFG) and a doctoral scholarship by the China Scholarship Council (CSC) for Jun-Wen Tan.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tan, JW., Walter, S., Scheck, A. et al. Repeatability of facial electromyography (EMG) activity over corrugator supercilii and zygomaticus major on differentiating various emotions. J Ambient Intell Human Comput 3, 3–10 (2012). https://doi.org/10.1007/s12652-011-0084-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-011-0084-9