Daniel Porta
ABSTRACT
We present a new multimodal interaction sequence for a mobile multimodal Business-to-Business interaction system. A mobile client application on the iPhone supports users in accessing an online service marketplace and allows business experts to intuitively search and browse for services using natural language speech and gestures while on the go. For this purpose, we utilize an ontology-based multimodal dialogue platform as well as an integrated trainable gesture recognizer.
- Neßelrath, R. and Alexanderson, J.: A 3D Gesture Recognition System for Multimodal Dialog Systems. In Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue, Pasadena, USA, (2009)Google Scholar
- Schehl, J., Pfalzgraf, A., Pfleger, N., and Steigner, J.: The babbleTunes system: talk to your ipod!. In Proceedings of IMCI '08. ACM, New York, NY, (2008). Google ScholarDigital Library
- Sonntag. D., Engel; R., Herzog, G., Pfalzgraf, A., Pfleger, N., Romanelli, M., Reithinger, N.: SmartWeb Handheld - Multimodal Interaction with Ontological Knowledge Bases and Semantic Web Services. In: LNAI Special Volume on Human Computing, 4451, Springer, pp. 272--295, (2007). Google ScholarDigital Library
- Wu, H., Grégoire, J., Mrass, E., Fung, C., and Haslani, F.: MoTaskit: a personal task-centric tool for service accesses from mobile phones. In: Proceedings of MobMid, (2008). Google ScholarDigital Library
Index Terms
- New business to business interaction: shake your iPhone and speak to it
Recommendations
Multimodal interaction: A suitable strategy for including older users?
The major promise of multimodal user interfaces for older users is that they have the choice to select the input modality (or combination of modalities) that best fits their needs and capabilities. Two studies investigated if multimodal interfaces with ...
Changes in verbal and nonverbal conversational behavior in long-term interaction
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interactionWe present an empirical investigation of conversational behavior in dyadic interaction spanning multiple conversations, in the context of a developing interpersonal relationship between a health counselor and her clients. Using a longitudinal video ...
Designing Android Marshmallow volume controls: a user experience case study
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctWhen a user presses physical hardware volume keys on a smartphone, volume controls appears on the screen. Traditionally, these volume controls are represented by a single slider. Android's Lollipop release introduced new functionality into the volume ...
Comments