skip to main content
10.1145/3152832.3156615acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
poster

Mobile multimodal interaction for older and younger users: exploring differences and similarities

Published: 26 November 2017 Publication History

Abstract

Since they can integrate a wide range of interactive modalities, multimodal interfaces are considered to improve accessibility for a variety of users, including older adults. However, only few works have actually explored how older adults approach multimodal interaction outside specific contexts and have done so mainly in comparison to much younger users. This study explores how older (65+ years old), middle-aged (55-65 years old) and younger adults (25-35 years old) use mobile multimodal interaction in an everyday activity (i.e. taking photos with a tablet) by using midair gestures and voice commands, and investigates the differences and similarities between the considered age groups. Preliminary findings from a video-analysis show that all groups easily combine the proposed modalities when interacting with a tablet device. Furthermore, compared to younger adults, older and middle-aged adults show similarities in the way they perform gesture and voice commands.

References

[1]
Fraser Anderson and Walter F. Bischof. 2013. Learning and Performance with Gesture Guides. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1109--1118.
[2]
Cati Boulanger, Saeideh Bakhshi, Joseph "Jofish" Kaye, and David A. Shamma. 2016. The Design, Perception, and Practice of Tablet Photography. Proceedings of the 2016 ACM Conference on Designing Interactive Systems, ACM, 84--95.
[3]
Micael Carreira, Karine Lan Hing Ting, Petra Csobanka, and Daniel Goncalves. 2016. Evaluation of in-air hand gestures interaction for older people. Universal Access in the Information Society: 1--20.
[4]
Jing Chen and Robert W. Proctor. 2013. Response-effect compatibility defines the natural scrolling direction. Human Factors 55, 6: 1112--1129.
[5]
Kathrin M. Gerling, Kristen K. Dergousoff, and Regan L. Mandryk. 2013. Is Movement Better?: Comparing Sedentary and Motion-based Game Controls for Older Adults. Proceedings of Graphics Interface 2013, Canadian Information Processing Society, 133--140.
[6]
Julia Himmelsbach, Markus Garschall, Sebastian Egger, Susanne Steffek, and Manfred Tscheligi. 2015. Enabling Accessibility Through Multimodality?: Interaction Modality Choices of Older Adults. Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia, ACM, 195--199.
[7]
Jörn Hurtienne, Christian Stößel, Christine Sturm, et al. 2010. Physical gestures for abstract concepts: Inclusive design with primary metaphors. Interacting with Computers 22, 6: 475--484.
[8]
Masatomo Kobayashi, Atsushi Hiyama, Takahiro Miura, Chieko Asakawa, Michitaka Hirose, and Tohru Ifukube. 2011. Elderly User Evaluation of Mobile Touchscreen Interactions. Human-Computer Interaction - INTERACT 2011, Springer, Berlin, Heidelberg, 83--99.
[9]
Anja B. Naumann, Ina Wechsung, and Jörn Hurtienne. 2010. Multimodal Interaction: A Suitable Strategy for Including Older Users? Interact. Comput. 22, 6: 465--474.
[10]
Zeljko Obrenovic, Julio Abascal, and Dusan Starcevic. 2007. Universal Accessibility As a Multimodal Design Issue. Commun. ACM 50, 5: 83--88.
[11]
S. Oviatt. 2003. User-centered modeling and evaluation of multimodal interfaces. Proceedings of the IEEE 91, 9: 1457--1468.
[12]
Julie Rico and Stephen Brewster. 2010. Gesture and Voice Prototyping for Early Evaluations of Social Acceptability in Multimodal Interfaces. International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ACM, 16:1--16:9.
[13]
Daniel Salber and Joëlle Coutaz. 1993. Applying the Wizard of Oz technique to the study of multimodal systems. In L.J. Bass, J. Gornostaev, and C. Unger, eds., Human-Computer Interaction. Springer Berlin Heidelberg, 219--230.
[14]
Gianluca Schiavo, Michela Ferron, Ornella Mich, and Nadia Mana. 2016. Wizard of Oz Studies with Older Adults: A Methodological Note. Proceedings of the COOP 2016 - Symposium on challenges and experiences in designing for an ageing society, 93--100.
[15]
Christian Stößel and Lucienne Blessing. 2010. Mobile Device Interaction Gestures for Older Users. Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, ACM, 793--796.
[16]
Matthew Turk. 2014. Multimodal interaction: A review. Pattern Recognition Letters 36: 189--195.
[17]
U.S. Census Bureau. Mid-year Population by Five Year Age Groups and Sex - Europe..
[18]
Linda Wulf, Markus Garschall, Julia Himmelsbach, and Manfred Tscheligi. 2014. Hands Free - Care Free: Elderly People Taking Advantage of Speech-only Interaction. Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, ACM, 203--206.
[19]
Mary Zajicek and Wesley Morrissey. 2003. Multimodality and interactional differences in older adults. Universal Access in the Information Society 2, 2: 125--133.

Cited By

View all
  • (2024)EasyAsk: An In-App Contextual Tutorial Search Assistant for Older Adults with Voice and Touch InputsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785168:3(1-27)Online publication date: 9-Sep-2024
  • (2022)Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older PeopleResearch Anthology on Supporting Healthy Aging in a Digital Society10.4018/978-1-6684-5295-0.ch028(496-519)Online publication date: 4-Feb-2022
  • (2020)Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older PeopleInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.202001010212:1(22-41)Online publication date: 1-Jan-2020
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MUM '17: Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia
November 2017
567 pages
ISBN:9781450353786
DOI:10.1145/3152832
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 November 2017

Check for updates

Author Tags

  1. mid-air gesture-based interaction
  2. multimodal interaction
  3. older adults
  4. speech-based interaction

Qualifiers

  • Poster

Conference

MUM 2017

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)2
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)EasyAsk: An In-App Contextual Tutorial Search Assistant for Older Adults with Voice and Touch InputsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785168:3(1-27)Online publication date: 9-Sep-2024
  • (2022)Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older PeopleResearch Anthology on Supporting Healthy Aging in a Digital Society10.4018/978-1-6684-5295-0.ch028(496-519)Online publication date: 4-Feb-2022
  • (2020)Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older PeopleInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.202001010212:1(22-41)Online publication date: 1-Jan-2020
  • (2020)Trade-offs in the design of multimodal interaction for older adultsBehaviour & Information Technology10.1080/0144929X.2020.185176841:5(1035-1051)Online publication date: 3-Dec-2020
  • (2019)Designing Mid-Air Gesture Interaction with Mobile Devices for Older AdultsPerspectives on Human-Computer Interaction Research with Older People10.1007/978-3-030-06076-3_6(81-100)Online publication date: 21-Feb-2019
  • (2018)"Siri Talks at You"Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3234695.3236344(249-258)Online publication date: 8-Oct-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media