Julie Rico Williamson
ABSTRACT
The use of performance as the focus of interaction provides the opportunity for exploratory and individual experiences but can also put users in an uncomfortable position. This paper presents an initial user study of a mobile remote awareness application in which users can control their own fish in a virtual fish tank using multimodal input from an external sensing device, where the input styles are created and performed by participants in an open ended sensing model. The study was designed in order to better understand the issues of performance when audience members are both casual passersby and familiar others watching remotely. Additionally, this study investigated the creation of performances and the effects of props when used in different social settings. The study involved pairs of participants interacting with the system in both public and private locations over repeated sessions. The results of this study show how users created and interpreted performances as well as how their consideration of passersby influenced their experiences.
Supplemental Material
- Goffman, Erving. The Presentation of Self in Every-day Life. Penguin Books, London (1990)Google Scholar
- Jacucci, G., et al., Bodily Explorations in Space: Social Experience of a Multimodal Art Installation, Proc. INTERACT 2009, Springer, pp. 62--75. Google ScholarDigital Library
- Law, E. L., Roto, V., Hassenzahl, M., Vermeeren, A. P., and Kort, J. 2009. Understanding, scoping and de-fining user experience: a survey approach. In Proc. CHI 2009, ACM Press, pp 719--728. Google ScholarDigital Library
- Montero, C. S., Alexander, J., Marshall, M. T., and Subramanian, S. 2010. Would you do that?: under-standing social acceptance of gestural interfaces. In Proc. of Mobile HCI 2010, ACM, New York, NY, 275--278. Google ScholarDigital Library
- Reeves, S., Benford, S., O'Malley, C., and Fraser, M. Designing the spectator experience. In Proc. CHI 2005, ACM Press, pp 741--750. Google ScholarDigital Library
- Rico, J., and Brewster, S.A. Gesture and Voice Pro-totyping for Early Evaluations of Social Acceptability in Multimodal Interfaces. To appear in Proceedings of IC-MI 2010 (Beijing, China). ACM Press. Google ScholarDigital Library
- Rico, J. and Brewster, S.A. Usable Gestures for Mo-bile Interfaces: Evaluating Social Acceptability. In Proc ACM CHI 2010, ACM Press, pp 887--896. Google ScholarDigital Library
- Ronkainen, S., Häkkilä, J., Kaleva, S., Colley, A., and Linjama, J. Tap input as an embedded interaction method for mobile devices. In Proc. TEI 2007, ACM Press, pp 263--270. Google ScholarDigital Library
- Sheridan, J.G. and Bryan-Kinns, N. Designing for Performative Tangible Interaction. International Journal of Arts and Technology. 1(3/4), pp 288--308Google Scholar
Index Terms
- Send me bubbles: multimodal performance and social acceptability
Recommendations
Gesture and voice prototyping for early evaluations of social acceptability in multimodal interfaces
ICMI-MLMI '10: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal InteractionInteraction techniques that require users to adopt new behaviors mean that designers must take into account social acceptability and user experience otherwise the techniques may be rejected by users as they are too embarrassing to do in public. This ...
Mobile multimodal interaction for older and younger users: exploring differences and similarities
MUM '17: Proceedings of the 16th International Conference on Mobile and Ubiquitous MultimediaSince they can integrate a wide range of interactive modalities, multimodal interfaces are considered to improve accessibility for a variety of users, including older adults. However, only few works have actually explored how older adults approach ...
Effects of Multimodal Feedback on the Usability of Mobile Diet Diary for Older Adults
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and ServicesGlobally, overweight is an increasing problem and this especially the case for older adults, facing physical challenges and who need to maintain a healthy diet. eHealth services, such as a digital diet diary could support them. Consequently, we designed ...
Comments