Abstract
Studies in crossmodal perception often use very simplified auditory and visual contexts. While these studies have been theoretically valuable, it is sometimes difficult to see how the findings can be ecologically valid or practically valuable. This study hypothesizes that a musical parameter (tempo) may affect the perception of a human movement quality (speed) and finds that although there are clear limitations, this may be a promising first step towards widening both the contexts in which cross-modal effects are studied and the application areas in which the findings can be used.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alais, D., Burr, D.: The ventriloquist effect results from near-optimal bimodal integration. Current Biology 14(3), 257–262 (2004)
Arulampalam, S., Maskell, S., Gordon, N., Clapp, T.: Tutorial on particle filters for on-line nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing (2001)
Bishop, C.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)
Bregman, A.S.: Auditory scene analysis. MIT Press, Cambridge (1990)
Bolivar, V.J., Cohen, A.J., Fentress, J.C.: Semantic and formal congruency in music and motion pictures: Effects the interpretation of visual action. Psychomusicology 2, 38–43 (1994)
Clarke, E.F.: Meaning and the specification of motion in music. Musicae Scientiae 5, 213–234 (2001)
Cover, T.M., Thomas, J.A.: Elements of Information Theory. John Wiley, Chichester (1999)
Eitan, Z., Granot, R.: How music moves. Music Perception 23(3), 221–248 (2006)
Hodgins, P.: Relationships between score and choreography in 20th century music and dance: Music and metaphor. Mellen, London (1992)
Iwamiya, S.: Interactions between auditory and visual processing when listening to music in an audiovisual context. Psychomusicology 13, 133–154 (1994)
Jaynes, E.T.: Probability Theory: Logic of Science. Cambridge (2003)
Krumhansl, C.L., Schenck, D.L.: Can dance reflect the structural and expressive qualities of music?: A perceptual experiment on Balanchine’s choreography of Mozart’s Divertimento No. 5. Musicae Scientae 1(1), 63–85 (1997)
Laban, R.V.: The Language of Movement: A Guidebook to Choreutics: Plays, inc. (1974)
Laban, R.V.: Principles of dance and movement notation: With 114 basic movement graphs and their explanation. Macdonald & Evans, London (1956)
Lipscomb, S.D., Kendall, R.A.: Perceptual judgment of the relationship between musical and visual components in film. Psychomusicology 13, 60–98 (1994)
McGurk, H., MacDonald, J.W.: Hearing lips and seeing voices. Nature 264, 746–748 (1976)
McNeill, W.H.: Keeping together in time: dance and drill in human history. Harvard University Press, London (1995)
Mitchell, R.W., Gallaher, M.C.: Embodying music: Matching music and dance in memory. Music Perception 19(1), 65–85 (2001)
Moog, H.: The development of musical experience of children in the pre-school age. Psychology of Music 4, 38–45 (1976)
Murphy, K.: Dynamic Bayesian Networks:Representation, Inference and Learning. PhD thesis, University of California, Berkeley (2002)
O’Leary, A., Rhodes, G.: Cross-modal effects on visual and auditory object perception. Perception & Psychophysics 35, 565–569 (1984)
Papousek, M.: Intuitive parenting: A hidden source of musical stimulation in infancy. In: Deliege, I., Sloboda, J. (eds.) Musical Beginnings: Origins and Development of Musical Competence, pp. 88–112. Oxford University Press, Oxford, New York, and Tokyo (1996)
Pearl, J.: Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufmann Publishers, San Mateo, Calif. (1988)
Phillips-Silver, J., Trainor, L.J.: Hearing what the body feels: Auditory encoding of rhythmic movement. Cognition (in press, 2007)
Phillips-Silver, J., Trainor, L.J.: Feeling the beat: movement influences infants rhythm perception. Science 308, 1430 (2005)
Repp, B.H., Penel, A.: Auditory dominance in temporal processing: New evidence from synchronization with simultaneous visual and auditory sequences. Journal of Experimental Psychology: Human Perception and Performance 28(5), 1085–1099 (2002)
Savitzky, A., Golay, M.J.E.: Smoothing and differentiation of data by simplified least squares procedures. Analytical Chemistry, 1627–1639 (1964)
Sekuler, R., Sekuler, A.B., Lau, R.: Motion perception. Nature 385, 308 (1997)
Shams, L., Kamitani, Y., Shimojo, S.: Visual illusion induced by sound. Cognitive Brain Research 14, 147–152 (2002)
Thornburg, H.: Detection and Modeling of Transient Audio Signals with Prior Information, Stanford University, Department of Electrical Engineering (2005)
Vroomen, J., de Gelder, B.: Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of experimental psychology: Human perception and performance 26(5), 1583–1590 (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Afanador, K. et al. (2008). On Cross-Modal Perception of Musical Tempo and the Speed of Human Movement. In: Kronland-Martinet, R., Ystad, S., Jensen, K. (eds) Computer Music Modeling and Retrieval. Sense of Sounds. CMMR 2007. Lecture Notes in Computer Science, vol 4969. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85035-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-85035-9_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85034-2
Online ISBN: 978-3-540-85035-9
eBook Packages: Computer ScienceComputer Science (R0)