Abstract
Previous research has demonstrated that threatening, compared to neutral pictures, can bias attention towards non-emotional auditory targets. Here we investigated which subcomponents of attention contributed to the influence of emotional visual stimuli on auditory spatial attention. Participants indicated the location of an auditory target, after brief (250 ms) presentation of a spatially non-predictive peripheral visual cue. Responses to targets were faster at the location of the preceding visual cue, compared to at the opposite location (cue validity effect). The cue validity effect was larger for targets following pleasant and unpleasant cues compared to neutral cues, for right-sided targets. For unpleasant cues, the crossmodal cue validity effect was driven by delayed attentional disengagement, and for pleasant cues, it was driven by enhanced engagement. We conclude that both pleasant and unpleasant visual cues influence the distribution of attention across modalities and that the associated attentional mechanisms depend on the valence of the visual cue.
Notes
IAPS slide numbers for unpleasant pictures: 1090, 1205, 1220, 1274, 1275, 1301, 2682, 2692, 3051, 6020, 6200, 6241, 6244, 9008, 9040, 9182, 9253, 9320, 9373, 9401; slide numbers for pleasant pictures: 1440, 1463, 1540, 1590, 1660, 1710, 1720, 1721, 1722, 5460, 5480, 8090, 8161, 8193, 8210, 8220, 8280, 8500, 8503, 8531; slide numbers for neutral pictures: 1121, 1350, 1616, 1947, 2410, 2720, 2880, 2980, 5395, 5531, 5532, 5535, 6150, 7130, 7170, 7190, 7211, 7236, 7490, 8010 (Lang et al. 2008).
Due to our trial randomization procedure, the number of valid and invalid trials may have differed between the first and the second half of the experiment. On average, there were 120.7 valid versus 119.3 invalid trials in the first half, and 119.3 valid and 120.6 invalid trials in the second half. We statistically compared the ratio of valid to invalid trials between the two halves and found no evidence of a difference in the ratios [t(26) = .687, p = .498]. We are therefore confident that our results do not contain a confound related to different ratios of valid to invalid trials across the first and second halves of the experiment.
Where appropriate, here and in subsequent analyses, Greenhouse–Geisser adjustments to the degrees of freedom were performed. Cohen’s d effect size for post hoc t tests is calculated according to the formula of Morris and DeShon (2002).
References
Bertels J, Kolinsky R, Morais J (2010) Emotional valence of spoken words influences the spatial orientating of attention. Acta Psychol 134:264–278
Bradley MM, Lang PJ, Cuthbert BN (1993) Emotion, novelty, and the startle reflex: habituation in humans. Behav Neurosci 107:970–980
Brosch T, Grandjean D (2013) Cross-modal modulation of spatial attention by emotion. In: Ethofer T, Belin P (eds) Integrating face and voice in person perception. Springer, Berlin, pp 207–223
Brosch T, Grandjean D, Sander D, Scherer KR (2008a) Behold the voice of wrath: cross-modal modulation of visual attention by anger prosody. Cognition 106:1497–1503
Brosch T, Sander D, Pourtois G, Scherer KR (2008b) Beyond fear: rapid spatial orienting toward positive emotional stimuli. Psychol Sci 19:362–370
Brosch T, Grandjean D, Sander D, Scherer KR (2009) Crossmodal emotional attention: emotional voices modulate early stages of visual processing. J Cogn Neurosci 21:1670–1679
Corbetta M, Schulman GL (2002) Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3:201–215
Demaree HA, Everhart DE, Youngstrom EA, Harrison DW (2005) Brain lateralization of emotional processing: historical roots and a future incorporating “dominance”. Behav Cogn Neurosci Rev 4:3–20
Ferrari V, Codispoti M, Cardinale R, Bradley MM (2008) Directed and motivated attention during processing of natural scenes. J Cogn Neurosci 20:1753–1761
Gerdes ABM, Wieser MJ, Alpers GW (2014) Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains. Front Psychol 5:1351
Harrison N, Davies S (2013) Modulation of spatial attention to visual targets by emotional environmental sounds. Psychol Neurosci 6:247–251
Koster EHW, Crombez G, Verschuere B, Van Damme S, Wiersema JR (2006) Components of attentional bias to threat in high trait anxiety: facilitated engagement, impaired disengagement, and attentional avoidance. Behav Res Ther 44:1757–1771
Lang PJ, Bradley MM, Cuthbert BN (1990) Emotion, attention, and the startle reflex. Psychol Rev 97:377–395
Lang PJ, Bradley MM, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville
Morris SB, DeShon RP (2002) Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychol Methods 7:105–125
Mulckhuyser M, Crombez G (2014) Disentangling attention from action in the emotional spatial cueing task. Cogn Emot 28:1–19
Nummenmaa L, Hyönä J, Calvo MG (2006) Eye movement assessment of selective attentional capture by emotional pictures. Emotion 6:257–268
Öhman A, Lundqvist D, Esteves F (2001) The face in the crowd revisited: a threat advantage with schematic stimuli. J Pers Soc Psychol 80:381–396
Posner MI (1980) Orienting of attention. Q J Exp Psychol 32:3–25
Posner MI, Peterson SE (1990) The attention system of the human brain. Annu Rev Neurosci 13:25–42
Pourtois G, Schettino A, Vuilleumier P (2012) Brain mechanisms for emotional influences on perception and attention: what is magic and what is not. Biol Psychol 92:492–512
Schock L, Bhavsar S, Demenescu LR, Sturm W, Mathiak K (2013) Does valence in the visual domain influence the spatial attention after auditory deviants? Exploratory data. Front Behav Neurosci 7:6
Selinger L, Domínguez-Borràs J, Escera C (2013) Phasic boosting of auditory perception by visual emotion. Biol Psychol 94:471–478
Simola J, Le Fevre K, Torniainen J, Baccino T (2015) Affective processing in natural scene viewing: valence and arousal interactions in eye-fixation-related potentials. NeuroImage 106:21–33
Tartar JL, de Almeida K, McIntosh RC, Rosselli M, Nash AJ (2012) Emotionally negative pictures increase attention to a subsequent auditory stimulus. Int J Psychophysiol 83:36–44
Van Damme S, Gallace A, Spence C, Crombez G, Moseley GL (2009) Does the sight of physical threat induce a tactile processing bias? Modality-specific attentional facilitation induced by viewing threatening pictures. Brain Res 1253:100–106
Yiend J, Mathews A (2001) Anxiety and attention to threatening pictures. Q J Exp Psychol A 54:665–681
Author information
Authors and Affiliations
Corresponding author
Additional information
Handling Editor: Bruno Laeng, University of Oslo, Norway.
Reviewers: Stefania D’Ascenzo, University of Modena; Reggio Emilia, Italy and an anonymous reviewer.
Rights and permissions
About this article
Cite this article
Harrison, N.R., Woodhouse, R. Modulation of auditory spatial attention by visual emotional cues: differential effects of attentional engagement and disengagement for pleasant and unpleasant cues. Cogn Process 17, 205–211 (2016). https://doi.org/10.1007/s10339-016-0749-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10339-016-0749-6