Abstract:
People process information through multiple modalities and many studies have been done that show interaction among the auditory, haptic and visual modes. This paper repor...Show MoreMetadata
Abstract:
People process information through multiple modalities and many studies have been done that show interaction among the auditory, haptic and visual modes. This paper reports on a correlation between the haptic property of roughness and each of the audio properties of pitch and loudness. There were four experiments: given a roughness, match a loudness level to it and vice versa and given a roughness, match a pitch to it and vice versa. Subjects showed a strong correlation in the first two experiments, associating louder sounds with rougher textures and softer sounds with smoother textures. They also showed, although not always in the same direction, a strong correlation between pitch (high/low) and roughness. Applications of this study are to multimodal user interfaces and to music cognition.
Published in: Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004.
Date of Conference: 16-16 July 2004
Date Added to IEEE Xplore: 09 August 2004
Print ISBN:0-7695-2177-0
Print ISSN: 1093-9547