ABSTRACT
Aim of this research is to investigate the influence of system feedback in different modalities like nonverbal auditory information as well as speech, tactile and graphical feedback on perceived quality. As a first step experiments are conducted for different kinds of unimodal feedback to establish a suitable experimental paradigm. Based on these experiments certain feedback messages are selected and implemented in a multimodal mobile prototype to study the influence of those feedback messages on the interaction and the perceived quality. The developed approach will serve as a generic experimental set-up to collect user ratings and interaction data. These measures can than be used to evaluate the quality and usability of multimodal systems in mobile contexts and for quality prediction.
- Oviatt, S., Coulston, R. and Lunsford, R. 2004. When do we interact multimodally?: cognitive load and multimodal communication patterns. In Proceedings of the 6th international conference on Multimodal interfaces, State College, PA, USA ACM, 129--136. Google ScholarDigital Library
- Wickens, C.D. and Mccarley, J.S. 2008. Applied attention theory. Taylor & Francis.Google Scholar
- Naumann, A.B., Wechsung, I. and Möller, S. 2008. Factors Influencing Modality Choice in Multimodal Applications In Proceedings of the Perception in Multimodal Dialogue Systems Springer Berlin / Heidelberg, 37 -- 43. Google ScholarDigital Library
- Naumann, A.B. and Wechsung, I. 2008. Developing Usability Methods for Multimodal Systems: The Use of Subjective and Objective Measures. In International Workshop on Meaningful Measures: Valid Useful User Experience Measurement (VUUM), Toulouse, France, 8 -- 12.Google Scholar
- Sundaram, S., Schleicher, R. and Seebode, J. 2010. Clustering Audio Clips by Context-Free Description and Affective Ratings.Google Scholar
Index Terms
- Influence of feedback on the quality of multimodal systems
Recommendations
Multimodal feedback: establishing a performance baseline for improved access by individuals with visual impairments
Assets '02: Proceedings of the fifth international ACM conference on Assistive technologiesMultimodal interfaces have the potential to enhance a user's overall performance, especially when one perceptual channel, such as vision, is compromised. This research investigated how unimodal, bimodal, and trimodal feedback affected the performance of ...
Prediction of Various Backchannel Utterances Based on Multimodal Information
IVA '23: Proceedings of the 23rd ACM International Conference on Intelligent Virtual AgentsThe listener's backchannels are an important part of dialogues. With appropriate backchannels, people are able to smoothly promote dialogues. Thus, backchannels are considered to be important in dialogues between not only humans but also humans and ...
Toward achieving universal usability for older adults through multimodal feedback
CUU '03: Proceedings of the 2003 conference on Universal usabilityThis experiment examines the effect of combinations of feedback (auditory, haptic, and/or visual) on the performance of older adults completing a drag-and-drop computer task. Participants completed a series of drag-and-drop tasks under each of seven ...
Comments