Abstract
We propose a novel paradigm of consuming rich web content in a mobile setting (which are often eyes-free), through a predominantly 3D audio interface. Web content, formatted in audio, is streamed via the mobile device’s network connection, and placed virtually in a 3D audio space. The user moves in the virtual space, using a variety of human computer interaction (HCI) means, such as voice input, touching, rotating, and shaking the device, as well as hand and head gesturing. We provide applications benefitting from this paradigm of rich mobile 3D audio web consumption. We provide system designs, and a system architecture for mobile 3D audio. Finally, we implement our ideas in a system prototype using the Apple iOS mobile platform.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Announcing Eyes-Free Shell For Android (April 2009), http://google-opensource.blogspot.com/2009/04/announcing-eyes-free-shell-for-android.html
Parker-Pope, T.: What Clown on a Unicycle? Studying Cellphone Distraction, New York Times (October 2009), http://well.blogs.nytimes.com/2009/10/22/what-clown-on-a-unicycle-studying-cell-phone-distraction/
Richtel, M.: Forget Gum. Walking and Using Phone Is Risky, New York Times (January 2010), http://www.nytimes.com/2010/01/17/technology/17distracted.html
The Snapdragon Platform. Qualcomm, http://www.qualcomm.com/products_services/chipsets/snapdragon.html
Evolution to LTE report. Global Mobile Suppliers Association (April 2010), http://www.gsacom.com/news/gsa_298.php4
Cherry, E.C.: Some Experiments on the Recognition of Speech, with One and with Two Ears. Journal of the Acoustical Society of America 25(5), 975–979 (1953)
Bronkhorst, A.W.: The Cocktail Party Phenomenon: A Review of Research on Speech Intelligibility in Multiple-Talker Conditions. Acta Acustica united with Acustica 86, 117–128 (2000)
Shinn-Cunningham, B.G., Ihlefeld, A.: Selective and Divided Attention: Extracting Information from Simultaneous Sound Sources. In: International Conference on Auditory Display (ICAD), Sydney, Australia (July 2004)
Best, V., Gallun, F.J., Ihlefeld, A., Shinn-Cunningham, B.G.: The Influence of Spatial Separation on Divided Listening. Journal of the Acoustical Society of America 120(3), 1506–1516 (2006)
Ihlefeld, A., Shinn-Cunningham, B.G.: Spatial Release from Energetic and Informational Masking in a Divided Speech Identification Task. Journal of the Acoustical Society of America 123(6), 4380–4392 (2008)
Lumsden, J., Brewster, S.: A Paradigm Shift: Alternative Interaction Techniques for Use with Mobile and Wearable Devices. In: Conference of the Centre for Advanced Studies on Collaborative Research (CASCON), Toronto, Canada, pp. 197–210 (October 2003)
Marentakis, G., Brewster, S.: A Study on Gestural Interaction with a 3D Audio Display. In: Brewster, S., Dunlop, M.D. (eds.) Mobile HCI 2004. LNCS, vol. 3160, pp. 180–191. Springer, Heidelberg (2004)
Brewster, S., Murray-Smith, R., Crossan, A., Vasquez-Alvarez, Y., Rico, J.: The GAIME project: Gestural and Auditory Interactions for Mobile Environments. In: Whole Body Interaction Workshop, ACM Conference on Human Factors in Computing Systems (CHI), Boston, MA (April 2009)
Hipui Funkyplayer, http://www.hipui.com/funkyplayer/
Vasquez-Alvarez, Y., Brewster, S.: Audio Minimization: Applying 3D Audio Techniques to Multi-Stream Audio Interfaces. In: Poster Session International Workshop on Haptic and Audio Design (HAID), Dresden, Germany (September 2009)
Parente, P.: Audio Enriched Links: Web Page Previews for Blind Users. In: International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), Atlanta, GA, pp. 2–8 (October 2004)
Yu, W., Kuber, R., Murphy, E., Strain, P., McAllister, G.: A Novel Multimodal Interface for Improving Visually Impaired People’s Web Accessibility. Virtual Reality 9(2), 133–148 (2006)
Bigham, J., Prince, C., Ladner, R.: WebAnywhere: A Screen Reader On-the-Go. In: ACM International Cross-disciplinary Conference on Web Accessibility (W4A), Beijing, China, pp. 73–82 (April 2008)
Moray, N.: Attention in Dichotic Listening: Affective Cues and the Influence of Instructions. The Quarterly Journal of Experimental Psychology 11, 56–60 (1959)
Wu, V.K.Y.: 3D Audio RSS/Music Player. Apple App. Store, http://itunes.apple.com/us/app/3d-audio-rss-music-player/id363753578?mt=8
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Wu, V.K.Y., Campbell, R.H. (2012). 3D Audio Interface for Rich Mobile Web Experiences. In: Gris, M., Yang, G. (eds) Mobile Computing, Applications, and Services. MobiCASE 2010. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 76. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29336-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-29336-8_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29335-1
Online ISBN: 978-3-642-29336-8
eBook Packages: Computer ScienceComputer Science (R0)