research-article

Examining the need for visual feedback during gesture interaction on mobile touchscreen devices for kids

Authors:

Berthel TateAuthors Info & Claims

IDC '13: Proceedings of the 12th International Conference on Interaction Design and Children

Pages 157 - 164

https://doi.org/10.1145/2485760.2485775

Published: 24 June 2013 Publication History

Abstract

Surface gesture interaction styles used on modern mobile touchscreen devices are often dependent on the platform and application. Some applications show a visual trace of gesture input as it is made by the user, whereas others do not. Little work has been done examining the usability of visual feedback for surface gestures, especially for children. In this paper, we present results from an empirical study conducted with children, teens, and adults to explore characteristics of gesture interaction with and without visual feedback. We find that the gestures generated with and without visual feedback by users of different ages diverge significantly in ways that make them difficult to interpret. In addition, users prefer to see visual feedback. Based on these findings, we present several design recommendations for new surface gesture interfaces for children, teens, and adults on mobile touchscreen devices. In general, we recommend providing visual feedback, especially for children, wherever possible.

References

[1]

Akamatsu, M., MacKenzie, I. S., and Hasbroucq, T. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics 38, 4 (1995), 816--827.

[2]

Anthony, L., Brown, Q., Nias, J., Tate, B., and Mohan, S. Interaction and Recognition Challenges in Interpreting Children's Touch and Gesture Input on Mobile Devices. Proc. ITS 2012, ACM Press (2012), 225--234.

Digital Library

[3]

Anthony, L., Vatavu, R.-D., and Wobbrock, J. O. Understanding the Consistency of Users' Pen and Finger Stroke Gesture Articulation. Proc. GI 2013, Canadian Information Processing Society (2013), to appear.

[4]

Anthony, L. and Wobbrock, J. O. $N-protractor: a fast and accurate multistroke recognizer. Proc. GI 2012, Canadian Information Processing Society (2012), 117--120.

Digital Library

[5]

Beery, K., Buktenica, N., and Beery, N. A. The Beery-Buktenica Developmental Test of Visual-Motor Integration, 5th Edition. Modern Curriculum Press, New Jersey, 2004.

[6]

Brown, Q. and Anthony, L. Toward Comparing the Touchscreen Interaction Patterns of Kids and Adults. ACM SIGCHI EIST Workshop 2012, (2012), 4pp.

[7]

Brown, Q., Hatley, L., Bonsignore, E. M., and Druin, A. Mobile Natives: Unlocking the Potential of Educational Technology. ACM SIGCHI 2nd Workshop on UI Technologies and Their Impact on Educational Pedagogy 2011, (2011), 4pp.

[8]

De Bruyn, D. and Davis, A. Visual feedback is not essential for children to make the perpendicular bias. Perception ECVP Abstract Supplement 37, (2008), 149.

[9]

Clawson, J., Lyons, K., Starner, T., and Clarkson, E. The Impacts of Limited Visual Feedback on Mobile Text Entry for the Twiddler and Mini-QWERTY Keyboards. Proc. ISWC 2005, IEEE (2005), 170--177.

Digital Library

[10]

Dean, A. and Voss, D. Design and Analysis of Experiments. Springer-Verlag, New York, NY, USA, 1999.

[11]

Donker, A. and Reitsma, P. Aiming and clicking in young children's use of the computer mouse. Computers in Human Behavior 23, 6 (2007), 2863--2874.

Digital Library

[12]

Frisch, M., Heydekorn, J., and Dachselt, R. Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. Proc. ITS 2009, ACM Press (2009), 149--156.

Digital Library

[13]

Gustafson, S. Imaginary interfaces: touchscreen-like interaction without the screen. Ext. Abstracts CHI 2012, ACM Press (2012), 927--930.

Digital Library

[14]

Harris, A., Rick, J., Bonnett, V., Yuill, N., Fleck, R., Marshall, P., and Rogers, Y. Around the Table: Are multiple-touch surfaces better than single-touch for children's collaborative interactions? Proc. CSCL 2009, ISLS (2009), 335--344.

Digital Library

[15]

Hinrichs, U. and Carpendale, S. Gestures in the wild. Proc. CHI 2011, ACM Press (2011), 3023--3032.

Digital Library

[16]

Hourcade, J. P., Bederson, B. B., Druin, A., and Guimbretière, F. Differences in pointing task performance between preschool children and adults using mice. ACM Transactions on Computer-Human Interaction 11, 4 (2004), 357--386.

Digital Library

[17]

Inkpen, K. M. Drag-and-drop versus point-and-click mouse interaction styles for children. ACM ToCHI 8, 1 (2001), 1--33.

Digital Library

[18]

Joiner, R., Messer, D., Light, P., and Littleton, K. It is best to point for young children: a comparison of children's pointing and dragging. Computers in Human Behavior 14, 3 (1998), 513--529.

[19]

Jones, T. An Empirical Study of Children's Use of Computer Pointing Devices. Journal of Educational Computing Research 7, 1 (1991), 61--76.

[20]

Kammer, D., Wojdziak, J., Keck, M., Groh, R., and Taranko, S. Towards a formalization of multi-touch gestures. Proc. DIS 2010, ACM Press (2010), 49--58.

Digital Library

[21]

Kane, S. K., Wobbrock, J. O., and Ladner, R. E. Usable gestures for blind people: understanding preference and performance. Proc. CHI 2011, ACM Press (2011), 413--422.

Digital Library

[22]

Kratz, S. and Ballagas, R. Unravelling seams: improvoing mobile gesture recognition with visual feedback techniques. Proc. CHI 2009, ACM Press (2009), 937--940.

Digital Library

[23]

Li, Y. Gesture search: a tool for fast mobile data access. Proc. UIST 2010, ACM Press (2010), 87--96.

Digital Library

[24]

Lin, E., Cassidy, A., Hook, D., and Baliga, A. Hand tracking using spatial gesture modeling and visual feedback for a virtual DJ system. Proc. ICMI 2002, IEEE (2002), 197--202.

Digital Library

[25]

Morris, M. R., Wobbrock, J. O., and Wilson, A. D. Understanding users' preferences for surface gestures. Proc. GI 2010, Canadian Information Processing Society (2010), 261--268.

Digital Library

[26]

Piaget, J. Piaget's Theory. In P. Mussen, ed., Handbook of Child Psychology. Wiley & Sons, New York, NY, USA, 1983.

[27]

Read, J. C., MacFarlane, S., and Casey, C. Pens behaving badly-usability of pens and graphics tablets for text entry with children. Adj. Proc. UIST 2002, ACM Press (2002), 21--22.

[28]

Rick, J., Harris, A., Marshall, P., Fleck, R., Yuill, N., and Rogers, Y. Children designing together on a multi-touch tabletop: An analysis of spatial orientation and user interactions. Proc. IDC 2009, ACM Press (2009), 106--114.

Digital Library

[29]

Rösblad, B. Reaching and eye-hand coordination. In A. Henderson and C. Pehoski, eds., Hand Function in the Child: Foundations for Remediation. Mosby Elsevier, St. Louis, MO, USA, 2006.

[30]

Ryall, K., Morris, M. R., Everitt, K., Forlines, C., and Shen, C. Experiences with and observations of direct-touch tabletops. Proc. Tabletop 2006, IEEE (2006), 8pp.

Digital Library

[31]

Shuler, C. Pockets of Potential: Using Mobile Technologies to Promote Children's Learning. Joan Ganz Cooney Center at Sesame Workshop, New York, NY, 2009.

[32]

Smyth, M. M. Visual control of movement patterns and the grammar of action. Acta psychologica 70, 3 (1989), 253--265.

[33]

Tu, H., Ren, X., and Zhai, S. A comparative evaluation of finger and pen stroke gestures. Proc. CHI 2012, ACM Press (2012), 1287--1296.

Digital Library

[34]

Vinter, A. and Meulenbroek, R. The role of manual dominance and visual feedback in circular drawing movements. Journal of Human Movement Studies 25, (1993), 11--37.

[35]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. Proc. CHI 2009, ACM Press (2009), 1083--1092.

Digital Library

[36]

Zhai, S., Kristensson, P. O., Appert, C., Anderson, T. H., and Cao, X. Foundational Issues in Touch-Surface Stroke Gesture Design --- An Integrative Review. Foundations and Trends in Human--Computer Interaction 5, 2 (2012), 97--205.

Digital Library

[37]

Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., and Baudisch, P. Earpod: eyes-free menu selection using touch input and reactive audio feedback. Proc. CHI 2007, ACM Press (2007), 1395--1404.

Digital Library

Cited By

Rekik YGuettaf AJamalzadeh MGrisoni L(2024)Comparing Eyes-free Gestures to Gestures Produced in the Presence or Absence of Visual Feedback on Mobile DeviceProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656651(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656651
Jamalzadeh MRekik YGrisoni L(2023)The Effect of Attention Saturating Task on Eyes-Free Gesture Production on Mobile DevicesCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626535(27-31)Online publication date: 5-Nov-2023
https://dl.acm.org/doi/10.1145/3626485.3626535
Melniczuk AVrapi E(2023)Exploring Feedback Modality Designs to Improve Young Children's Collaborative ActionsProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614140(271-281)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614140
Show More Cited By

Index Terms

Examining the need for visual feedback during gesture interaction on mobile touchscreen devices for kids
1. Human-centered computing

Recommendations

Interaction and recognition challenges in interpreting children's touch and gesture input on mobile devices
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

As mobile devices like the iPad and iPhone become increasingly commonplace, touchscreen interactions are quickly overtaking other interaction methods in terms of frequency and experience for many users. However, most of these devices have been designed ...
Using gamification to motivate children to complete empirical studies in lab environments
IDC '13: Proceedings of the 12th International Conference on Interaction Design and Children

In this paper, we describe the challenges we encountered and solutions we developed while collecting mobile touch and gesture interaction data in laboratory conditions from children ages 5 to 7 years old. We identify several challenges of conducting ...
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

The proliferation of smartphones and tablets has increased children’s access to and usage of touchscreen devices. Prior work on smartphones has shown that children’s touch interactions differ from adults’. However, larger screen devices like tablets and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IDC '13: Proceedings of the 12th International Conference on Interaction Design and Children

June 2013

687 pages

ISBN:9781450319188

DOI:10.1145/2485760

Co-chair:
Juan Pablo Hourcade
University of Iowa
,
Conference Chairs:
Nitin Sawhney
The New School
,
Emily Reardon
Sesame Workshop

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

The New School: The New School
ACM: Association for Computing Machinery
Sesame Workshop: Sesame Workshop

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

IDC '13

Sponsor:

The New School
ACM
Sesame Workshop

IDC '13: Interaction Design and Children 2013

June 24 - 27, 2013

New York, New York, USA

Acceptance Rates

Overall Acceptance Rate 172 of 578 submissions, 30%

Upcoming Conference

IDC '25

Sponsor:
sigchi

Interaction Design and Children

June 23 - 26, 2025

Reykjavik , Iceland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
828
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rekik YGuettaf AJamalzadeh MGrisoni L(2024)Comparing Eyes-free Gestures to Gestures Produced in the Presence or Absence of Visual Feedback on Mobile DeviceProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656651(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656651
Jamalzadeh MRekik YGrisoni L(2023)The Effect of Attention Saturating Task on Eyes-Free Gesture Production on Mobile DevicesCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626535(27-31)Online publication date: 5-Nov-2023
https://dl.acm.org/doi/10.1145/3626485.3626535
Melniczuk AVrapi E(2023)Exploring Feedback Modality Designs to Improve Young Children's Collaborative ActionsProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614140(271-281)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614140
Tengku Wook TMat Noor SSahari Ashaari NMohamed HHussain NZakariya R(2023)Evaluation of the effectiveness of preschool English learning applications based on touch and voice multimodal interaction techniqueUniversal Access in the Information Society10.1007/s10209-023-01075-xOnline publication date: 19-Dec-2023
https://doi.org/10.1007/s10209-023-01075-x
Jamalzadeh MRekik YGrisoni LVatavu RVolpe GDancu A(2023)Effects of Moving Speed and Phone Location on Eyes-Free Gesture Input with Mobile DevicesHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_30(469-478)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_30
Kosmas PPhilippou APsomos P(2022)Towards the Development of a Game for Computational ThinkingDesigning, Constructing, and Programming Robots for Learning10.4018/978-1-7998-7443-0.ch007(136-158)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-7443-0.ch007
Kosmas PPhilippou APsomos P(2022)Towards the Development of a Game for Computational ThinkingResearch Anthology on Game Design, Development, Usage, and Social Impact10.4018/978-1-6684-7589-8.ch025(507-529)Online publication date: 7-Oct-2022
https://doi.org/10.4018/978-1-6684-7589-8.ch025
Shaw ARuiz JAnthony L(2021)A Survey on Applying Automated Recognition of Touchscreen Stroke Gestures to Children’s InputInteracting with Computers10.1093/iwc/iwab00932:5-6(524-547)Online publication date: 21-Apr-2021
https://doi.org/10.1093/iwc/iwab009
Anthony LFails J(2019)Quantitative Methods for Child-Computer InteractionProceedings of the 18th ACM International Conference on Interaction Design and Children10.1145/3311927.3325166(710-713)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3311927.3325166
Anthony L(2019)Physical dimensions of children's touchscreen interactionsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2019.02.005128:C(1-16)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1016/j.ijhcs.2019.02.005
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten