Kohki Ikeuchi
ABSTRACT
Everyday, we receive large amounts of information through our various senses. Since the majority of information is perceived through eye sight, other senses are often left unutilized. As a result, in order to utilize disengaged senses in our daily interactions, especially auditory, we propose a method to extract and transform real-world's visual information to auditory information. Our method is based on converting a real-world's objects' location and distance attributes to sound attributes, which are later be combined to form music. To verify our approach, we developed a prototype that we called Music Sonar, with which we carried out a preliminary user study followed by a questionnaire. The objective of Music Sonar is to reduce the cognitive overload due to visual information by converting visual feedback to ambient auditory feedback, allowing us to use our visual attention for more essential tasks. The user study results confirmed general validity of our approach, despite some shortcomings. Participants also provided a number of usability and interactivity related insights regarding the music based feedback. Finally, we provided our future direction of this research project.
- Gael Dubus, Roberto Bresin. 2013. A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities. PLoS ONE, Vol. 8, No. 12, e82491. doi:10.1371/journal.pone.0082491.Google Scholar
Cross Ref
- William W. Gaver, Randall B. Smith, and Tim O'Shea. 1991. Effective sounds in complex systems: the ARKOLA simulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '91). Google ScholarDigital Library
- William W. Gaver. 1993. Synthesizing auditory icons. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). Google ScholarDigital Library
- Thomas Herman. 2008. Taxonomy and definitions for sonification and auditory display, In Proceedings of the 14th International Conference on Auditory Display.Google Scholar
- Robert H. Lorenz, Alex Berndt, Rainer Groh. 2013. Designing auditory pointers. In Proceedings of the 8th Audio Mostly Conference. Google ScholarDigital Library
- Matthew Marx and Chris Schmandt. 1996. MailCall: message presentation and navigation in a nonvisual environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '96). Google ScholarDigital Library
- Tadashi Okoshi, Jin Nakazawa, Hideyuki Tokuda. (2014) Attelia: Sensing User's Attention Status on Smart Phones. In the Adjunct Proceedings of ubicomp '14. Google ScholarDigital Library
- Yolanda Vazquez-Alvarez and Stephen A. Brewster. 2011. Eyes-free multitasking: the effect of cognitive load on mobile spatial audio interfaces, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). Google ScholarDigital Library
- Jeff Wilson, Bruce N. Walker, Jeffrey Lindsay, Craig Cambias, Frank Dellaert. 2007. SWAN: System for Wearable Audio Navigation. In Proceeding 11th IEEE International Symposium on Wearable Computers. Google ScholarDigital Library
- Singo Yamano, Takamitsu Hamajo, Shunsuke Takahashi, Keita Higuchi. 2011. Single-Modal Mobile Navigation Using Directionally Annotated Music. In Proceedings of the 19th Workshop on Interactive Systems and Software.Google Scholar
Index Terms
- Providing ambient information as comfortable sound for reducing cognitive overload
Recommendations
Filtering visual information for reducing visual cognitive load
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable ComputersWith the increasing presence and role that computers play in our daily lives, the quantity of visual information received from digital devices is expanding. The mobility and portability requirements of our modern lifestyles further overload our visual ...
A sound design for acoustic feedback in elite sports
CMMR/ICAD'09: Proceedings of the 6th international conference on Auditory DisplaySound (acoustic information) is the naturally evocative, audible result of kinetic events. Humans interact with the world by the everyday experience of listening to perceive and interpret the environment. Elite athletes, especially, rely on sport ...
Cognitive overload and its countermeasures from the angle of information processing
IITA'09: Proceedings of the 3rd international conference on Intelligent information technology applicationThe problems of cognitive overload have greatly influenced students' learning in multimedia and web-based environment. The main technological factors of cognitive overload are analyzed as following: hypertext structure of information and multi-task, ...
Comments