Skip to main content
SpringerLink
Log in

Audio-visual crossmodal interactions in environmental perception: an fMRI investigation

  • Research Report
  • Published:
Cognitive Processing Aims and scope Submit manuscript

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

References

  • Beauchamp MS, Lee KE, Argall BD, Martin A (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809–823

    Article  CAS  PubMed  Google Scholar 

  • Bentin S, Mouchetant-Rostaing Y, Giard MH, Echallier JF, Pernier J (1999) ERP manifestations of processing printed words at different psycholinguistic levels: time course and scalp distribution. J Cogn Neurosci 11:235–260

    Article  CAS  PubMed  Google Scholar 

  • Boynton GM, Engel SA, Glover GH, Heeger DJ (1996) Linear systems analysis of functional magnetic resonance imaging in human V1. J Neurosci 16:4207–4241

    CAS  PubMed  Google Scholar 

  • Bunsey M, Eichenbaum H (1996) Conservation of hippocampal memory function in rats and humans. Nature 379:255–257

    Article  CAS  PubMed  Google Scholar 

  • Calvert GA, Brammer MJ, Bullmore E, Campbell R, Iversen SD, David A (1999) Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport 10:2619–2623

    CAS  PubMed  Google Scholar 

  • Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in human heteromodal cortex. Curr Biol 10:649–657

    Article  CAS  PubMed  Google Scholar 

  • Calvert GA (2001) Crossmodal processing in the human brain: insight from functional neuroimaging studies. Cereb Cortex 11:1110–1123

    Article  CAS  PubMed  Google Scholar 

  • Cox RW (1996) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29:162–173

    Article  CAS  PubMed  Google Scholar 

  • Delogu F, Auricchio L, Olivetti Belardinelli M (2004) Interazioni crossmodali semantiche nell’elaborazione del suono ambientale. Ricerche di Psicologia (submitted)

  • Driver J, Spence C (2000) Multisensory perception: Beyond modularity and convergence. Curr Biol 10:R731-R735

    Article  CAS  PubMed  Google Scholar 

  • Eichenbaum H (1992) The hippocampal system and declarative memory in animals. J Cogn Neurosci 4:217–231

    Google Scholar 

  • Ettlinger G, Wilson WA (1990) Cross-modal performance: Behavioural processes, phylogenetic considerations and neural mechanisms. Behav Brain Res 40:169–192

    Article  CAS  PubMed  Google Scholar 

  • Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, Noll DC (1995) Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn Reson Med 33:636–647

    CAS  PubMed  Google Scholar 

  • Friston KJ, Holmes AP, Worsley KJ, Poline JP, Frith CD, Frackowiak RSJ (1995) Statistical parametric maps in functional imaging: A general linear approach. Hum Brain Mapp 2:189–210

    Google Scholar 

  • Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: A behavioural and electrophysiological study. J Cogn Neurosci 11:473–490

    Article  CAS  PubMed  Google Scholar 

  • Gottfried JA, Dolan RJ (2003) The nose smells what the eye sees: Crossmodal visual facilitation of human olfactory perception. Neuron 39:375–386

    Article  CAS  PubMed  Google Scholar 

  • Hadjikhani N, Roland PE (1998) Cross-modal transfer of information between the tactile and the visual representation in the human brain: A positron emission tomographic study. J Neurosci 18:1072–1084

    CAS  PubMed  Google Scholar 

  • Henke K, Buck A, Weber B, Wieser HG (1997) Human hippocampus establishes associations in memory. Hippocampus 7(3):249–256

    Article  CAS  PubMed  Google Scholar 

  • Jackson O III, Schacter DL (2004) Encoding activity in anterior medial temporal lobe supports subsequent associative recognition. Neuroimage 21:456–462

    Article  PubMed  Google Scholar 

  • King AJ, Calvert G (2001) Multisensory integration: Perceptual grouping by eye and ear. Curr Biol 11:R322–325

    Article  CAS  PubMed  Google Scholar 

  • Macaluso E, Frith CD, Driver J (2000) Modulation of human visual cortex by crossmodal spatial attention. Science 289:1206–1208

    Article  CAS  PubMed  Google Scholar 

  • Martin A, Chao LL (2001) Semantic memory and the brain: Structure and processes. Curr Opin Neurobiol 11:194–201

    Article  CAS  PubMed  Google Scholar 

  • McClelland JL (1995) Constructive memory and memory distortions: A parallel-distributed processing approach. In: Schacter DL, Coyle JT, Fischbach GD, Mesulam M-M, Sullivan LE (eds) Memory distortion. Harvard University Press, Cambridge pp 69–90

    Google Scholar 

  • Mesulam M-M (1990) Large-scale neurocognitive networks and distributed processing for attention, language, and memory. Ann Neurol 28:597–613

    CAS  PubMed  Google Scholar 

  • Mesulam M-M (1998) From sensation to cognition. Brain 121:1013–1052

    Article  PubMed  Google Scholar 

  • Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cogn Brain 14:115–128

    Article  PubMed  Google Scholar 

  • Nadel L, Moscovitch M (1997) Memory consolidation, retrograde amnesia and the hippocampal complex. Curr Opin Neurobiol 7:217–227

    Article  CAS  PubMed  Google Scholar 

  • Price CJ, Friston KJ (1997) Cognitive conjunction: A new approach to brain activation experiments. Neuroimage 5:261–270

    Article  CAS  PubMed  Google Scholar 

  • Rombouts SARB, Machielsen WCM, Witter MP, Barkhof F, Lindeboom J (1997) Visual association encoding activates the medial temporal lobe: A functional magnetic resonance imaging study. Hippocampus 7(6):594–601

    Article  CAS  PubMed  Google Scholar 

  • Spence C, Driver J (2000) Attracting attention to the illusory location of a sound: Reflexive crossmodal orienting and ventriloquism. Neuroreport 11:2057– 2061

    CAS  PubMed  Google Scholar 

  • Squire LR, Zola SM (1996) Structure and function of declarative and nondeclarative memory systems. P NAS US 93:13515–13522

    Google Scholar 

  • Stark CE, Squire LR (2000) fMRI activity in the medial temporal lobe during recognition memory as a function of study-test interval. Hippocampus 10:329–337

    Article  CAS  PubMed  Google Scholar 

  • Stein BE, Meredith MA (1993) The merging of the senses. MIT Press, Cambridge

    Google Scholar 

  • Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain. Thieme, Stuttgart

    Google Scholar 

  • Thompson-Schill SL (2003) Neuroimaging studies of semantic memory: Inferring “how” from “where”. Neuropsychology 41:280–292

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, University of Rome “La Sapienza”, P. Le Aldo-Moro, Rome, Italy

    Marta Olivetti Belardinelli & Franco Delogu

  2. ECONA (Interuniversity Center for the Research on Cognitive Processing in Natural and Artificial Systems), University of Rome “La Sapienza”, P. Le Aldo-Moro, Rome, Italy

    Marta Olivetti Belardinelli, Rosalia Di Matteo & Franco Delogu

  3. Department of Clinical Sciences and Biomedical Imaging, University of Chieti-Pescara, Italy

    Carlo Sestieri, Rosalia Di Matteo, Cosimo Del Gratta, Antonio Ferretti, Massimo Caulo, Armando Tartaro & Gian Luca Romani

  4. Institute of Advanced Biomedical Technologies, University of Chieti-Pescara, Italy

    Cosimo Del Gratta, Antonio Ferretti, Massimo Caulo, Armando Tartaro & Gian Luca Romani

  5. INFM (National Institute for the Physics of Matter, Coordinated Group of Chieti), L’Aquila, Italy

    Cosimo Del Gratta, Antonio Ferretti & Gian Luca Romani

Authors
  1. Marta Olivetti Belardinelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carlo Sestieri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rosalia Di Matteo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Franco Delogu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Cosimo Del Gratta
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Antonio Ferretti
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Massimo Caulo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Armando Tartaro
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Gian Luca Romani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marta Olivetti Belardinelli.

Additional information

Edited by: Marie-Hélène Giard and Mark Wallace

Rights and permissions

Reprints and permissions

About this article

Cite this article

Olivetti Belardinelli, M., Sestieri, C., Di Matteo, R. et al. Audio-visual crossmodal interactions in environmental perception: an fMRI investigation. Cogn Process 5, 167–174 (2004). https://doi.org/10.1007/s10339-004-0024-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10339-004-0024-0

Keywords

Search

Navigation