Skip to main content
Log in

Modulation of auditory spatial attention by visual emotional cues: differential effects of attentional engagement and disengagement for pleasant and unpleasant cues

  • Short communication
  • Published:
Cognitive Processing Aims and scope Submit manuscript

Abstract

Previous research has demonstrated that threatening, compared to neutral pictures, can bias attention towards non-emotional auditory targets. Here we investigated which subcomponents of attention contributed to the influence of emotional visual stimuli on auditory spatial attention. Participants indicated the location of an auditory target, after brief (250 ms) presentation of a spatially non-predictive peripheral visual cue. Responses to targets were faster at the location of the preceding visual cue, compared to at the opposite location (cue validity effect). The cue validity effect was larger for targets following pleasant and unpleasant cues compared to neutral cues, for right-sided targets. For unpleasant cues, the crossmodal cue validity effect was driven by delayed attentional disengagement, and for pleasant cues, it was driven by enhanced engagement. We conclude that both pleasant and unpleasant visual cues influence the distribution of attention across modalities and that the associated attentional mechanisms depend on the valence of the visual cue.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Notes

  1. IAPS slide numbers for unpleasant pictures: 1090, 1205, 1220, 1274, 1275, 1301, 2682, 2692, 3051, 6020, 6200, 6241, 6244, 9008, 9040, 9182, 9253, 9320, 9373, 9401; slide numbers for pleasant pictures: 1440, 1463, 1540, 1590, 1660, 1710, 1720, 1721, 1722, 5460, 5480, 8090, 8161, 8193, 8210, 8220, 8280, 8500, 8503, 8531; slide numbers for neutral pictures: 1121, 1350, 1616, 1947, 2410, 2720, 2880, 2980, 5395, 5531, 5532, 5535, 6150, 7130, 7170, 7190, 7211, 7236, 7490, 8010 (Lang et al. 2008).

  2. Due to our trial randomization procedure, the number of valid and invalid trials may have differed between the first and the second half of the experiment. On average, there were 120.7 valid versus 119.3 invalid trials in the first half, and 119.3 valid and 120.6 invalid trials in the second half. We statistically compared the ratio of valid to invalid trials between the two halves and found no evidence of a difference in the ratios [t(26) = .687, p = .498]. We are therefore confident that our results do not contain a confound related to different ratios of valid to invalid trials across the first and second halves of the experiment.

  3. Where appropriate, here and in subsequent analyses, Greenhouse–Geisser adjustments to the degrees of freedom were performed. Cohen’s d effect size for post hoc t tests is calculated according to the formula of Morris and DeShon (2002).

References

  • Bertels J, Kolinsky R, Morais J (2010) Emotional valence of spoken words influences the spatial orientating of attention. Acta Psychol 134:264–278

    Article  Google Scholar 

  • Bradley MM, Lang PJ, Cuthbert BN (1993) Emotion, novelty, and the startle reflex: habituation in humans. Behav Neurosci 107:970–980

    Article  CAS  PubMed  Google Scholar 

  • Brosch T, Grandjean D (2013) Cross-modal modulation of spatial attention by emotion. In: Ethofer T, Belin P (eds) Integrating face and voice in person perception. Springer, Berlin, pp 207–223

    Chapter  Google Scholar 

  • Brosch T, Grandjean D, Sander D, Scherer KR (2008a) Behold the voice of wrath: cross-modal modulation of visual attention by anger prosody. Cognition 106:1497–1503

    Article  PubMed  Google Scholar 

  • Brosch T, Sander D, Pourtois G, Scherer KR (2008b) Beyond fear: rapid spatial orienting toward positive emotional stimuli. Psychol Sci 19:362–370

    Article  PubMed  Google Scholar 

  • Brosch T, Grandjean D, Sander D, Scherer KR (2009) Crossmodal emotional attention: emotional voices modulate early stages of visual processing. J Cogn Neurosci 21:1670–1679

    Article  PubMed  Google Scholar 

  • Corbetta M, Schulman GL (2002) Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3:201–215

    Article  CAS  PubMed  Google Scholar 

  • Demaree HA, Everhart DE, Youngstrom EA, Harrison DW (2005) Brain lateralization of emotional processing: historical roots and a future incorporating “dominance”. Behav Cogn Neurosci Rev 4:3–20

    Article  PubMed  Google Scholar 

  • Ferrari V, Codispoti M, Cardinale R, Bradley MM (2008) Directed and motivated attention during processing of natural scenes. J Cogn Neurosci 20:1753–1761

    Article  PubMed  Google Scholar 

  • Gerdes ABM, Wieser MJ, Alpers GW (2014) Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains. Front Psychol 5:1351

    Article  PubMed  PubMed Central  Google Scholar 

  • Harrison N, Davies S (2013) Modulation of spatial attention to visual targets by emotional environmental sounds. Psychol Neurosci 6:247–251

    Article  Google Scholar 

  • Koster EHW, Crombez G, Verschuere B, Van Damme S, Wiersema JR (2006) Components of attentional bias to threat in high trait anxiety: facilitated engagement, impaired disengagement, and attentional avoidance. Behav Res Ther 44:1757–1771

    Article  PubMed  Google Scholar 

  • Lang PJ, Bradley MM, Cuthbert BN (1990) Emotion, attention, and the startle reflex. Psychol Rev 97:377–395

    Article  CAS  PubMed  Google Scholar 

  • Lang PJ, Bradley MM, Cuthbert BN (2008) International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville

  • Morris SB, DeShon RP (2002) Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychol Methods 7:105–125

    Article  PubMed  Google Scholar 

  • Mulckhuyser M, Crombez G (2014) Disentangling attention from action in the emotional spatial cueing task. Cogn Emot 28:1–19

    Article  Google Scholar 

  • Nummenmaa L, Hyönä J, Calvo MG (2006) Eye movement assessment of selective attentional capture by emotional pictures. Emotion 6:257–268

    Article  PubMed  Google Scholar 

  • Öhman A, Lundqvist D, Esteves F (2001) The face in the crowd revisited: a threat advantage with schematic stimuli. J Pers Soc Psychol 80:381–396

    Article  PubMed  Google Scholar 

  • Posner MI (1980) Orienting of attention. Q J Exp Psychol 32:3–25

    Article  CAS  PubMed  Google Scholar 

  • Posner MI, Peterson SE (1990) The attention system of the human brain. Annu Rev Neurosci 13:25–42

    Article  CAS  PubMed  Google Scholar 

  • Pourtois G, Schettino A, Vuilleumier P (2012) Brain mechanisms for emotional influences on perception and attention: what is magic and what is not. Biol Psychol 92:492–512

    Article  PubMed  Google Scholar 

  • Schock L, Bhavsar S, Demenescu LR, Sturm W, Mathiak K (2013) Does valence in the visual domain influence the spatial attention after auditory deviants? Exploratory data. Front Behav Neurosci 7:6

    Article  PubMed  PubMed Central  Google Scholar 

  • Selinger L, Domínguez-Borràs J, Escera C (2013) Phasic boosting of auditory perception by visual emotion. Biol Psychol 94:471–478

    Article  PubMed  Google Scholar 

  • Simola J, Le Fevre K, Torniainen J, Baccino T (2015) Affective processing in natural scene viewing: valence and arousal interactions in eye-fixation-related potentials. NeuroImage 106:21–33

    Article  PubMed  Google Scholar 

  • Tartar JL, de Almeida K, McIntosh RC, Rosselli M, Nash AJ (2012) Emotionally negative pictures increase attention to a subsequent auditory stimulus. Int J Psychophysiol 83:36–44

    Article  PubMed  Google Scholar 

  • Van Damme S, Gallace A, Spence C, Crombez G, Moseley GL (2009) Does the sight of physical threat induce a tactile processing bias? Modality-specific attentional facilitation induced by viewing threatening pictures. Brain Res 1253:100–106

    Article  PubMed  Google Scholar 

  • Yiend J, Mathews A (2001) Anxiety and attention to threatening pictures. Q J Exp Psychol A 54:665–681

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Neil R. Harrison.

Additional information

Handling Editor: Bruno Laeng, University of Oslo, Norway.

Reviewers: Stefania D’Ascenzo, University of Modena; Reggio Emilia, Italy and an anonymous reviewer.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Harrison, N.R., Woodhouse, R. Modulation of auditory spatial attention by visual emotional cues: differential effects of attentional engagement and disengagement for pleasant and unpleasant cues. Cogn Process 17, 205–211 (2016). https://doi.org/10.1007/s10339-016-0749-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10339-016-0749-6

Keywords

Navigation