skip to main content
10.1145/3313831.3376154acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

TalkingBoogie: Collaborative Mobile AAC System for Non-verbal Children with Developmental Disabilities and Their Caregivers

Published: 23 April 2020 Publication History

Abstract

Augmentative and alternative communication (AAC) technologies are widely used to help non-verbal children enable communication. For AAC-aided communication to be successful, caregivers should support children with consistent intervention strategies in various settings. As such, caregivers need to continuously observe and discuss children's AAC usage to create a shared understanding of these strategies. However, caregivers often find it challenging to effectively collaborate with one another due to a lack of family involvement and the unstructured process of collaboration. To address these issues, we present TalkingBoogie, which consists of two mobile apps: TalkingBoogie-AAC for caregiver-child communication, and TalkingBoogie-coach supporting caregiver collaboration. Working together, these applications provide contextualized layouts for symbol arrangement, scaffold the process of sharing and discussing observations, and induce caregivers' balanced participation. A two-week deployment study with four groups (N=11) found that TalkingBoogie helped increase mutual understanding of strategies and encourage balanced participation between caregivers with reduced cognitive loads.

References

[1]
Erna Alant, Annette Champion, and Erin Colone Peabody. 2013. Exploring Interagency Collaboration in AAC Intervention. Communication Disorders Quarterly 34, 3 (2013), 172--183.
[2]
Meryl Alper. 2017. Giving Voice: Mobile Communication, Disability, and Inequality. MIT Press.
[3]
UW Augcomm. 2004. Rate Enhancement. (2004). http://depts.washington.edu/augcomm/02_features/04d_ rateenhance.htm
[4]
Rita L. Bailey, Julie B. Stoner, Howard P. Parette, and Maureen E. Angell. 2006. AAC Team Perceptions: Augmentative and Alternative Communication Device Use. Education and Training in Developmental Disabilities 41, 2 (2006), 139--154. http://www.jstor.org/stable/23880176
[5]
Andrew R. Beigel. 2000. Assistive Technology Assessment: More Than the Device. Intervention in School and Clinic 35, 4 (2000), 237--243.
[6]
David Beukelman, Jackie McGinnis, and Deanna Morrow. 1991. Vocabulary selection in augmentative and alternative communication. Augmentative and Alternative Communication 7, 3 (1991), 171--185.
[7]
David Beukelman and Pat Mirenda. 2013. Augmentative and Alternative Communication: Supporting Children and Adults with Complex Communication Needs. Paul H. Brookes Pub.
[8]
Cathy Binger and Janice Light. 2008. The Morphology and Syntax of Individuals who use AAC: Research Review and Implications for Effective Practice. Augmentative and Alternative Communication 24, 2 (2008), 123--138.
[9]
Rolf Black, Annalu Waller, Nava Tintarev, Ehud Reiter, and Joseph Reddington. 2011. A Mobile Phone Based Personal Narrative System. In The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '11). Association for Computing Machinery, New York, NY, USA, 171--178.
[10]
Nancy C. Brady, Susan Bruce, Amy Goldman, Karen Erickson, Beth Mineo, Bill T. Ogletree, Diane Paul, Mary Ann Romski, Rose Sevcik, Ellin Siegel, Judith Schoonover, Marti Snell, Lorraine Sylvester, and Krista Wilkinson. 2016. Communication Services and Supports for Individuals With Severe Disabilities: Guidance for Assessment and Intervention. American Journal on Intellectual and Developmental Disabilities 121, 2 (2016), 121--138.
[11]
Aimee Dietz, Wendy Quach, Shelley K. Lund, and Miechelle McKelvey. 2012. AAC Assessment and Clinical-Decision Making: The Impact of Experience. Augmentative and Alternative Communication 28, 3 (2012), 148--159.
[12]
Marilyn Espe-Sherwindt. 2008. Family-centred practice: collaboration, competency and evidence. Support for Learning 23, 3 (2008), 136--143.
[13]
Alexander Fiannaca, Ann Paradiso, Mira Shah, and Meredith Ringel Morris. 2017. AACrobat: Using Mobile Devices to Lower Communication Barriers and Provide Autonomy with Gaze-Based AAC. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). Association for Computing Machinery, New York, NY, USA, 683--695.
[14]
Lise Fox, Glen Dunlap, and Lisa Cushing. 2002. Early Intervention, Positive Behavior Support, and Transition to School. Journal of Emotional and Behavioral Disorders 10, 3 (2002), 149--157.
[15]
Melanie Fried-Oken, Lynn Fox, Marie T. Rau, Jill Tullman, Glory Baker, Mary Hindal, Nancy Wile, and Jau-Shin Lou. 2006. Purposes of AAC device use for persons with ALS as reported by caregivers. Augmentative and Alternative Communication 22, 3 (2006), 209--221.
[16]
J. K. Gona, C. R. Newton, S. Hartley, and K. Bunning. 2014. A home-based intervention using augmentative and alternative communication (AAC) techniques in rural Kenya: what are the caregivers' experiences? Child: Care, Health and Development 40, 1 (2014), 29--41.
[17]
Seray B. Ibrahim, Asimina Vasalou, and Michael Clarke. 2018. Design Opportunities for AAC and Children with Severe Speech and Physical Impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 227, 13 pages.
[18]
Kyung Hea Jeon, Seok Jeong Yeon, Young Tae Kim, Seokwoo Song, and John Kim. 2014. Robot-Based Augmentative and Alternative Communication for Nonverbal Children with Communication Disorders. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). Association for Computing Machinery, New York, NY, USA, 853--859.
[19]
Julie A. Kientz, Rosa I. Arriaga, Marshini Chetty, Gillian R. Hayes, Jahmeilah Richardson, Shwetak N. Patel, and Gregory D. Abowd. 2007. Grow and Know: Understanding Record-Keeping Needs for Tracking the Development of Young Children. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 1351--1360.
[20]
Cliff Kushler. 1998. AAC: Using a Reduced Keyboard. (1998).
[21]
Janice Light. 1989. Toward a definition of communicative competence for individuals using augmentative and alternative communication systems. Augmentative and Alternative Communication 5, 2 (1989), 137--144.
[22]
Janice Light, David Beukelman, and Joe Reichle. 2003. Communicative Competence for Individuals who Use AAC: From Research to Effective Practice. Brookes Publishing Company.
[23]
Janice Light and Kathryn Drager. 2007. AAC technologies for young children with complex communication needs: State of the science and future research directions. Augmentative and Alternative Communication 23, 3 (2007), 204--216.
[24]
Janice Light and David McNaughton. 2012a. The Changing Face of Augmentative and Alternative Communication: Past, Present, and Future Challenges. Augmentative and Alternative Communication 28, 4 (2012), 197--204.
[25]
Janice Light and David McNaughton. 2012b. Supporting the Communication, Language, and Literacy Development of Children with Complex Communication Needs: State of the Science and Future Research Priorities. Assistive Technology 24, 1 (2012), 34--44.
[26]
Janice Light and David Mcnaughton. 2015. Designing AAC Research and Intervention to Improve Outcomes for Individuals with Complex Communication Needs. Augmentative and Alternative Communication 31, 2 (2015), 85--96.
[27]
Catherine Lord, Susan Risi, and Andrew Pickles. 2004. Trajectory of Language Development in Autistic Spectrum Disorders. Lawrence Erlbaum Associates Publishers, 7--29.
[28]
Alan Newell, Stefan Langer, and Marianne Hickey. 1998. The role of natural language processing in alternative and augmentative communication. Natural Language Engineering 4, 1 (1998), 1--16.
[29]
OECD. 2015. How's Life? 2015 Measuring Well-being: Measuring Well-being. OECD Publishing.
[30]
Howard P. Parette, Mary Blake Huer, and Mary Jane Brotherson. 2001. Related Service Personnel Perceptions of Team AAC Decision-Making Across Cultures. Education and Training in Mental Retardation and Developmental Disabilities 36, 1 (2001), 69--82. http://www.jstor.org/stable/24481615
[31]
Eun Hye Park, Young Tae Kim, Ki Hyung Hong, Seok Jeong Yeon, Kyung Yang Kim, and Jang Hyun Lim. 2016. Development of Korean Ewha-AAC symbols: Validity of vocabulary and graphic symbols. AAC Research & Practice 4, 2 (2016), 19--40.
[32]
Jisoo Park. 2017. Research of Interaction for Construction of Co-presence Experience in Smart Mobile Device based AAC. Master's thesis. Yonsei University, Seoul, Republic of Korea.
[33]
Ralf Schlosser and Parimala Raghavendra. 2004. Evidence-Based Practice in Augmentative and Alternative Communication. Augmentative and Alternative Communication 20, 1 (2004), 1--21.
[34]
Seokwoo Song, Juho Kim, Bumsoo Kang, Wonjeong Park, and John Kim. 2018. BebeCODE: Collaborative Child Development Tracking System. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 540, 12 pages.
[35]
Gloria Soto, Eve Müller, Pam Hunt, and Lori Goetz. 2001. Professional Skills for Serving Students Who Use AAC in General Education Classrooms. Language, Speech, and Hearing Services in Schools 32, 1 (2001), 51--56.
[36]
Amy Starble, Tiffany Hutchins, Mary Alice Favro, Patricia Prelock, and Brooke Bitner. 2005. Family-Centered Intervention and Satisfaction With AAC Device Training. Communication Disorders Quarterly 27, 1 (2005), 47--54.
[37]
Julia B. Stoner, Maureen E. Angell, and Rita L. Bailey. 2010. Implementing Augmentative and Alternative Communication in Inclusive Educational Settings: A Case Study. Augmentative and Alternative Communication 26, 2 (2010), 122--135.
[38]
Keith Trnka, John McCaw, Debra Yarrington, Kathleen F. McCoy, and Christopher Pennington. 2008. Word Prediction and Communication Rate in AAC. In Proceedings of the IASTED International Conference on Telehealth/Assistive Technologies (Telehealth/AT '08). ACTA Press, USA, 19--24.
[39]
Gyula Vörös, Peter Rabi, Balázs Pintér, András Sárkány, Daniel Sonntag, and A. Lorincz. 2014. Recommending Missing Symbols of Augmentative and Alternative Communication by Means of Explicit Semantic Analysis. https://www.aaai.org/ocs/index.php/FSS/ FSS14/paper/view/9137
[40]
Karl Wiegand and Rupal Patel. 2014. DigitCHAT: Enabling AAC Input at Conversational Speed. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14). Association for Computing Machinery, New York, NY, USA, 343--344.

Cited By

View all
  • (2024)Assessment Methods for Problematic Eating Behaviors in Children and Adolescents With Autism Spectrum DisorderJournal of the Korean Academy of Child and Adolescent Psychiatry10.5765/jkacap.23006535:1(57-65)Online publication date: 1-Jan-2024
  • (2024)Research-Education Partnerships: A Co-Design Classroom for College Students with Intellectual and Developmental DisabilitiesProceedings of the ACM on Human-Computer Interaction10.1145/36870508:CSCW2(1-26)Online publication date: 8-Nov-2024
  • (2024)A Literature Analysis on the Development of a Filipino-Based Augmentative and Alternative Communication Mobile ApplicationProceedings of the 2024 10th International Conference on Computing and Artificial Intelligence10.1145/3669754.3669789(233-241)Online publication date: 26-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
April 2020
10688 pages
ISBN:9781450367080
DOI:10.1145/3313831
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Check for updates

Badges

  • Honorable Mention

Author Tags

  1. aac
  2. accessibility
  3. assistive technology
  4. caregiver collaboration
  5. developmental disability

Qualifiers

  • Research-article

Funding Sources

  • Faculty of Liberal Education, Seoul National University
  • National Research Foundation, Republic of Korea

Conference

CHI '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)197
  • Downloads (Last 6 weeks)28
Reflects downloads up to 10 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Assessment Methods for Problematic Eating Behaviors in Children and Adolescents With Autism Spectrum DisorderJournal of the Korean Academy of Child and Adolescent Psychiatry10.5765/jkacap.23006535:1(57-65)Online publication date: 1-Jan-2024
  • (2024)Research-Education Partnerships: A Co-Design Classroom for College Students with Intellectual and Developmental DisabilitiesProceedings of the ACM on Human-Computer Interaction10.1145/36870508:CSCW2(1-26)Online publication date: 8-Nov-2024
  • (2024)A Literature Analysis on the Development of a Filipino-Based Augmentative and Alternative Communication Mobile ApplicationProceedings of the 2024 10th International Conference on Computing and Artificial Intelligence10.1145/3669754.3669789(233-241)Online publication date: 26-Apr-2024
  • (2024)Designing Interactive Technology to Support Children with AutismExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3638192(1-5)Online publication date: 11-May-2024
  • (2024)Open Sesame? Open Salami! Personalizing Vocabulary Assessment-Intervention for Children via Pervasive Profiling and Bespoke Storybook GenerationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642580(1-32)Online publication date: 11-May-2024
  • (2024)Patient Perspectives on AI-Driven Predictions of Schizophrenia Relapses: Understanding Concerns and Opportunities for Self-Care and TreatmentProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642369(1-20)Online publication date: 11-May-2024
  • (2024)Shared Responsibility in Collaborative Tracking for Children with Type 1 Diabetes and their ParentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642344(1-20)Online publication date: 11-May-2024
  • (2024)Networks of care in digital domestic labour economiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642200(1-16)Online publication date: 11-May-2024
  • (2024)Co-Designing QuickPic: Automated Topic-Specific Communication Boards from Photographs for AAC-Based Language InstructionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642080(1-16)Online publication date: 11-May-2024
  • (2024)A Systematic Review of Ability-diverse Collaboration through Ability-based Lens in HCIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641930(1-21)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media