skip to main content
10.1145/3334480.3382840acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Adaptation of the System Usability Scale for User Testing with Children

Published: 25 April 2020 Publication History

Abstract

In this paper, we describe a pilot study in which we adapted and tested the System Usability Scales (SUS) for children between ages of 7-11. We began the study with interviews with four elementary school teachers in which we asked their help with modifying the SUS usability statements for children. We then tested those questionnaire statements with 30 children after they completed puzzles in mobile apps; we assessed the statements' understandability, dimensionality, construct validity and reliability. Our adapted SUS statements were mostly understandable. A Principal Component Analysis resulted in a four-Component model; two of those components were established as reliable. However, we were only able to support construct validity for four questionnaire statements (and none of the four Components). This pilot study contributes to the knowledgebase of user testing with children.

References

[1]
Ester Baauw and Panos Markopoulous. 2004. A comparison of think-aloud and post-task interview for usability testing with children. In Proceedings of the 2004 conference on Interaction design and children: building a community (IDC '04). ACM, New York, NY, USA, 115--116.
[2]
Raluca Budiu and Jakob Nielsen. 2010. Children (Ages 3--12 Years) on the Web (3rd Edition). Fremont, CA, USA.
[3]
Alison Druin. 2002. The role of children in the design of new technology. Behavioir & Information Technology, 21(1): p. 1--25
[4]
Jerry Alan Fails, Mona Leight Guha and Allison Druin. 2014. Methods and techniques for involving children in the design of new technology for children Foundations and Trends in HumanComputer Interaction. Now Publishers Inc.
[5]
Andrew Large, Valerie Nesset, Jamshid eheshti and Leanne Bowler. 2007. Bonded Design: A Methodology for Designing with Children, in Advances in Universal Web Design and Evaluation, Sri Kurniawan, Ed. Idea Group Publishing, Hershey, PA, USA.
[6]
Joseph F Hair, William C. Black, Barry J. Babin and Ralph E. Anderson. 2014. Multivariate Data Analysis, 7th ed. Pearson Education Limited, UK.
[7]
Thomas W. Malone. 1982. Heuristics for designing enjoyable user interfaces: Lessons from computer games. In Proceedings of the 1982 Conference on Human Factors in Computing Systems (CHI '82). ACM, New York, NY, USA, 63--68.
[8]
Jakob Nielson The Nielson 2016 Mobile Kids Report. Available at https://www.nielsen.com/ Last accessed November 28, 2018.
[9]
Nikita Soni, Aishat Aloba, Kristen S. Morga, Pamela J. Wisniewski, and Lisa Anthony. 2019. A Framework of Touchscreen Interaction Design Recommendations for Children (TIDRC): Characterizing the Gap between Research Evidence and Design Practice. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (IDC '19). ACM, New York, NY, USA, 419--431.
[10]
Jeff Sauro. 2011. A Practical Guide to the System Usability Scale. Measuring Usability LLC, Denver, CO, USA
[11]
Janet C. Read. 2012. Evaluating artefacts with children: Age and technology effects in the reporting of expected and experienced fun. In Proceedings of the 14th ACM International conference on Multimodal Interaction (ICMI '12). ACM, New York, NY, USA 241 -248.
[12]
WebFX Readability Test Tool. Available at: https://www.webfx.com/tools/read-able/. Last accessed October 6, 2019.

Cited By

View all
  • (2025)Exploring Large Language Models for Personalized Recipe Generation and Weight-Loss ManagementACM Transactions on Computing for Healthcare10.1145/3712709Online publication date: 17-Jan-2025
  • (2024)Evaluating the Feasibility and Acceptability of Surgery Prep, a Virtual Reality Perioperative Walkthrough Designed to Help Pediatric Patients Psychologically Prepare for SurgeryThe Journal of Child Life: Psychosocial Theory and Practice10.55591/001c.1267825:2Online publication date: 3-Dec-2024
  • (2024)An Extended Reality Platform for Cultural Gaming: Enabling Interactive Narratives in Spatial ContextsJournal on Computing and Cultural Heritage 10.1145/370248417:4(1-18)Online publication date: 10-Dec-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems
April 2020
4474 pages
ISBN:9781450368193
DOI:10.1145/3334480
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2020

Check for updates

Author Tags

  1. mobile
  2. system usability scale
  3. testing with children

Qualifiers

  • Abstract

Funding Sources

  • DePaul University

Conference

CHI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)353
  • Downloads (Last 6 weeks)46
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Exploring Large Language Models for Personalized Recipe Generation and Weight-Loss ManagementACM Transactions on Computing for Healthcare10.1145/3712709Online publication date: 17-Jan-2025
  • (2024)Evaluating the Feasibility and Acceptability of Surgery Prep, a Virtual Reality Perioperative Walkthrough Designed to Help Pediatric Patients Psychologically Prepare for SurgeryThe Journal of Child Life: Psychosocial Theory and Practice10.55591/001c.1267825:2Online publication date: 3-Dec-2024
  • (2024)An Extended Reality Platform for Cultural Gaming: Enabling Interactive Narratives in Spatial ContextsJournal on Computing and Cultural Heritage 10.1145/370248417:4(1-18)Online publication date: 10-Dec-2024
  • (2024)Gamified Tangible IoT for Education: Exploring Usability in SmartGameProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656713(1-3)Online publication date: 3-Jun-2024
  • (2024)SUStory: Usability Evaluation of Conversational Interfaces for Children with a Narrative on a Game BoardProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665565(1-6)Online publication date: 8-Jul-2024
  • (2024)Reflections on Data Collection during Toy Prototype Development in a Design Studio CourseProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659422(940-944)Online publication date: 17-Jun-2024
  • (2024)From Adolescents' Eyes: Assessing an Indicator-Based Intervention to Combat Misinformation on TikTokProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642264(1-20)Online publication date: 11-May-2024
  • (2024)User experience testing and co-designing a digital game for broadening participation in computing with and for elementary school childrenInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2024.10069942:COnline publication date: 1-Dec-2024
  • (2024)A serious game for raising air pollution perception in childrenJournal of Computers in Education10.1007/s40692-023-00305-8Online publication date: 30-Apr-2024
  • (2024)Development and Evaluation of a Gamified Application for Environmental Education: coralQuestSmart Mobile Communication & Artificial Intelligence10.1007/978-3-031-54327-2_38(374-383)Online publication date: 27-Feb-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media