Skip to main content

Pairing of Visual and Auditory Stimuli: A Study in Musicians on the Multisensory Processing of the Dimensions of Articulation and Coherence

  • Conference paper
  • First Online:
Artificial Intelligence in Neuroscience: Affective Analysis and Health Applications (IWINAC 2022)

Abstract

There are stimuli than can evoke us a feeling of connection between them. For example, we can easily appreciate differences when a musical piece is played in a continuous (legato) or discontinued way (martellato). This is called articulation, and this feature can be also applied to other sensorial modalities such as paintings or food images. In this framework, we wonder if the brain processing of a musical piece played in a discontinued way (i.e., martellato) could be similar to the brain processing of images with analogous features. We used Functional Magnetic Resonance Imaging (fMRI) to assess how the brain processes the dimensions of articulation in relation to discontinuity (time or space) and coherence. To avoid any potential bias due to the lack of knowledge of the articulations in music, all the participants were professional musicians. Although more studies are still needed, our results suggest that different areas of auditory and visual cortex are specialized in processing several types of articulations and that brain activity is greater when coherent stimuli were used.

O. de Juan-Ayala and V. Caruana—Contributed equally to this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arkhipova, A., et al.: Changes in brain responses to music and non-music sounds following creativity training within the “different hearing” program. Front. Neurosci. 15, 703620 (2021)

    Google Scholar 

  2. Blood, A.J., Zatorre, R.J.: Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc. Natl. Acad. Sci. U S A 98(20), 11818–23 (2001)

    Article  CAS  Google Scholar 

  3. Campos-Bueno, J.J., DeJuan-Ayala, O., Montoya, P., Birbaumer, N.: Emotional dimensions of music and painting and their interaction. Span J. Psychol. 18, E54 (2015)

    Article  CAS  Google Scholar 

  4. Chan, M.M.Y., Han, Y.M.Y.: The functional brain networks activated by music listening: a neuroimaging meta-analysis and implications for treatment. Neuropsychology 36(1), 4–22 (2022)

    Article  Google Scholar 

  5. De Juan Ayala, O.: La interrelación música pintura: un análisis comparativo actualizado de sus principales fundamentos técnicos y expresivos, pp. 163–164 (2010). http://hdl.handle.net/10201/19757

  6. De Juan Ayala, O.: Beethoven y Goya en tu cerebro, pp. 22,156. Compobel (2017)

    Google Scholar 

  7. Greenberg, D.M., Decety, J., Gordon, I.: The social neuroscience of music: understanding the social brain through human song. Am. Psychol. 76(7), 1172–1185 (2021)

    Article  Google Scholar 

  8. Jahn, A., et al.: justbennet: andrewjahn/andysbrainbook: (Jan 2022). https://doi.org/10.5281/zenodo.5879294

  9. Pearce, M.T., et al: Neuroaesthetics: the cognitive neuroscience of aesthetic experience. Perspect. Psychol. Sci. 11(2), 265–79 (2016)

    Google Scholar 

  10. Peretz, I., Zatorre, R.J.: Brain organization for music processing. Annu. Rev. Psychol. 56, 89–114 (2005)

    Article  Google Scholar 

  11. Poldrack, R., Mumford, J., Nichols, T.: Handbook of Functional MRI Data Analysis. Cambridge University Press (2011). https://books.google.es/books?id=OywOnwEACAAJ

  12. Shepherd, G.: Neurogastronomy: How the Brain Creates Flavor and Why It Matters. Columbia University Press (2011). https://books.google.es/books?id=gEigoDUBvA4C

Download references

Acknowledgements

This project has received funding by grant RTI2018-098969-B-100 from the Spanish Ministerio de Ciencia Innovación y Universidades and by grant PROMETEO/2019/119 from the Generalitat Valenciana (Spain).

We also want to thank Jose María García Santos, Head of the Radiology Department. University Hospital Morales Meseguer (Spain) for his support in this project, as well as to Francisco Fuentes, Chef of the Palacete La Seda Restaurant in Murcia.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eduardo Fernández .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

de Juan-Ayala, O., Caruana, V., Campos-Bueno, J.J., Ferrández, J.M., Fernández, E. (2022). Pairing of Visual and Auditory Stimuli: A Study in Musicians on the Multisensory Processing of the Dimensions of Articulation and Coherence. In: Ferrández Vicente, J.M., Álvarez-Sánchez, J.R., de la Paz López, F., Adeli, H. (eds) Artificial Intelligence in Neuroscience: Affective Analysis and Health Applications. IWINAC 2022. Lecture Notes in Computer Science, vol 13258. Springer, Cham. https://doi.org/10.1007/978-3-031-06242-1_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06242-1_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06241-4

  • Online ISBN: 978-3-031-06242-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics