Abstract
A digital approach to audio-visual perception of object material and mass within unimodal and multimodal conditions. Similar research has been executed regarding the perception of physical object material, however little has been accomplished relating to virtual perceptions of object material. This study evaluates the effects of manipulating specific stimuli when inducing cross modal augmentation, intersensory biases and cross modal transfers. Three test conditions were established in order to determine perceptual accuracies and mass type dominance: auditory only stimuli, visual only stimuli and audio-visual stimuli.
The results indicated that multimodal perception was more accurate when perceiving object material and that vision was most dominant within unisensory conditions. No dominance was found within a multimodal environment when there was object incongruency, however when the visual stimuli was obscure, the auditory modality confirmed the final perception.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adelson, E., Rosenholtz, R., Sharan, L.: Material perception: what can you see in a brief glance? 9 (2009)
Fleming, R.W.: Visual perception of materials and their properties. 94, 62–75 (2013)
Shams, L., Kamitani, Y., Shimojo, S.: What you see is what you hear. 408, 788 (2000). Macmillan Magazines Ltd.
Fujisaki, W., Goda, N., Motoyoshi, I., Komatsu, H., Nishida, S.: Audiovisual integration in the human perception of materials. 14 (2014)
Bonneel, N., Suied, C., Viaud-Delmon, I., Drettakis, G.: Audio-visual perception of materials for virtual environments. (2009)
Martín, R., Iseringhausen, J., Weinmann, M., Hullin, M.B.: Multimodal Perception of Material Properties. 33–40 (2015)
Acknowledgments
We would like to thank The Study Board for the Media Technology at the Aalborg University for funding our project. In addition, we would like to thank our supervisor Stefania Serafin and all the test participants.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Anderson, R., Arro, J., Hansen, C.S., Serafin, S. (2016). Audio-Visual Perception - The Perception of Object Material in a Virtual Environment. In: De Paolis, L., Mongelli, A. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2016. Lecture Notes in Computer Science(), vol 9768. Springer, Cham. https://doi.org/10.1007/978-3-319-40621-3_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-40621-3_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40620-6
Online ISBN: 978-3-319-40621-3
eBook Packages: Computer ScienceComputer Science (R0)