Abstract
We developed a mixed reality (MR) system which merges the real and the virtual worlds in both audio and visual senses. Our new approach “RealSound Interaction” is based on the idea that the sound events in the real world can work as interaction devices with an MR space. Firstly, we developed a sound detection system which localizes a sound source. The system consisted of two types of microphone arrays, fixed type and wearable type. Secondly, we evaluated the accuracy of the system, and proposed three practical usages of the sound events as interactive devices for MR attractions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Irawati, S., Calderon, D., Ko, H.: Spatial ontology for semantic integration in 3D multimodal interaction framework. In: Proc. of VRCIA 2006, pp. 129–135 (2006)
Mihara, Y., Shibayama, E., Takahashi, S.: The Migratory Cursor: Accurate Speech Based Cursor Movement by moving Multiple Ghost Cursors using Non-Verbal Vocalization. In: Proc. of ASSETS 2005, pp. 76–83 (2005)
Nagai, T., Kondo, K., Kaneko, M., Kurematsu, A.: Estimation of Source Location Based on 2-D MUSIC and Its Application to Speech Recognition in Cars. In: IEEE Proc of ICASSP 2001, vol. 5, pp. 3041–3044 (2001)
Omologo, M., Svaizer, P.: Acoustic Event Location Using a Crosspower -Spectrum Phase Based Technique. In: IEEE Proc. of ICASSP 1994, Adelaide, vol. 2, pp. 273–276 (1994)
Nishiura, T., Yamada, T., Nakamura, S., Shikano, K.: Localization of multiple sound sources based on a CSP analysis with a microphone array. In: IEEE Proc. of ICASSP 2000, vol. 2, pp. 1053–1056 (2000)
Denda, Y., Nishiura, T., Yamasita, Y.: A Study of Weighted CSP Analysis with Average Speech Spectrum for Noise Robust Talker Localization. In: Proc. of 9th EUROSPEECH 2005, Lisbon, pp. 2321–2324 (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Otsuki, M., Kimura, A., Nishiura, T., Shibata, F., Tamura, H. (2007). RealSound Interaction: A Novel Interaction Method with Mixed Reality Space by Localizing Sound Events in Real World. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Platforms and Techniques. HCI 2007. Lecture Notes in Computer Science, vol 4551. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73107-8_73
Download citation
DOI: https://doi.org/10.1007/978-3-540-73107-8_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73106-1
Online ISBN: 978-3-540-73107-8
eBook Packages: Computer ScienceComputer Science (R0)