research-article

TalkLIME: mobile system intervention to improve parent-child interaction for children with language delay

Authors:

Dongsun YimAuthors Info & Claims

UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Pages 304 - 315

https://doi.org/10.1145/2971648.2971650

Published: 12 September 2016 Publication History

Abstract

Parent-training is commonly used to support intervention of children with language delay. Unfortunately, parents find it difficult to apply the training to their child in everyday life and often give up on their parent-child interaction. In this work, we propose and evaluate TalkLIME -- a mobile system that provides real-time feedback to improve the parent-child interaction and reinforce parent-training intervention. We first conduct a survey to understand parents' feedback preference for the mobile system and determine that a non-invasive feedback using the mobile phones screen is preferable. TalkLIME was developed to provide real-time feedback through the mobile phone screen while also providing motivation to the parents to consistently continue parent-child interaction through both short-term and long-term goals. A six-weeks user study was conducted with eight parents and their children with language delay. Our results show that the experimental group who used TalkLIME showed a significant improvement in the child's initiation ratio, an important metric in the language development of children.

Supplementary Material

ZIP File (p304-song.zip)

Supplemental material.

Download
25.05 MB

References

[1]

Kaiser A.P., Hancock T.B., and J.P. Nietfeld. 2000. The effects of parent-implemented enhanced milieu teaching on the social communication of children who have autism. Journal of Early Education and Development(Special Issue) 4, 2 (2000), 423--446.

[2]

Ingersoll B. and Dvortcsak A. 2006. Including parent training in the early childhood special education curriculum for children with autism spectrum disorders. Journal of Positive Behavior Interventions 8, 2 (2006), 79--87.

[3]

Goldfield B.A. and Reznick J.S. 1990. Early lexical acquisition: Rate, content, and the vocabulary spurt. Journal of child language 17, 1 (1990), 171--183.

[4]

Cunningham C.E. and Siegel L.S. et al. 1985. The behavioral and linguistic interactions of specifically language-delayed and normal boys with their mothers. Child Development 56 (1985), 1389--1403.

[5]

Alpert C.L. and Kaiser A.P. 1992. Training parents as milieu language teachers. Journal of Early intervention 16, 1 (1992), 31--52.

[6]

Xu D., Yapanel U., and Gray S. 2009. Reliability of the LENA Language Environment Analysis system in young childrens natural home environment. LENA Foundation (2009).

[7]

Lilian de Greef, Mayank Goel, Min Joon Seo, Eric C. Larson, James W. Stout, James A. Taylor, and Shwetak N. Patel. 2014. Bilicam: Using Mobile Phones to Monitor Newborn Jaundice. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). 331--342.

Digital Library

[8]

Reynolds Douglas A., Quatieri F., Thomas F, and Robert B. Dunn. 2000. Speaker Verification Using Adapted Gaussian Mixture Models. Digital Signal Processing 10 (2000), 19--41.

Digital Library

[9]

Reynolds Douglas A., Quatieri F., Thomas F, and Robert B. Dunn. 2013. An Open-source State-of-the-art Toolbox for Broadcast News Diarization. M., Rouvier and G., Dupuy and P., Gay and E., Khoury and T., Merlin and S. Meignier (2013), 25--29.

[10]

Benot G. B. Fauve, Driss Matrouf, Nicolas Scheffer, Jean franois Bonastre, Senior Member, and John S. D. Mason. 2007. State-of-theArt Performance in Text-Independent Speaker Verification through Open-Source Software. IEEE Transactions on Audio, Speech and Language Processing (2007).

Digital Library

[11]

Gerald Friedland and Oriol Vinyals. 2008. Live Speaker Identification in Conversations. In Proceedings of the 16th ACM International Conference on Multimedia (MM '08). 1017--1018.

Digital Library

[12]

Lee H.J. and Kim Y.T. 2001. Turn-Taking Characterist ics of Children with Specific Language Impairment and Normal Children. Communication Sciences and Disorders 6, 2 (2001), 293--312.

[13]

Mohammed E. Hoque, Joseph K. Lane, Rana El Kaliouby, Matthew S. Goodwin, and Rosalind W. Picard. 2009. Exploring speech therapy games with children on the autism spectrum. International Speech Communication Association, 1455--1458.

[14]

Inseok Hwang, Chungkuk Yoo, Chanyou Hwang, Dongsun Yim, Youngki Lee, Chulhong Min, John Kim, and Junehwa Song. 2014. TalkBetter: Family-driven Mobile Intervention Care for Children with Language Delay. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, 1283--1296.

Digital Library

[15]

Tsybina I. and Eriks-Brophy A. 2007. Issues in research on children with early language delay. Contemporary Issues in Communication Science and Disorders 34 (2007), 118--133.

[16]

Law J. and Garrett Z. 2003. Speech and language therapy interventions for children with primary speech and language delay or disorder. Campbell Collaboration (2003).

[17]

Pepper J. and McDade E., Weitzman. 2004. It takes two to talk: A practical guide for parents of children with language delays. The Hanen Centre.

[18]

Kyung Hea Jeon, Seok Jeong Yeon, Young Tae Kim, Seokwoo Song, and John Kim. 2014. Robot-based Augmentative and Alternative Communication for Nonverbal Children with Communication Disorders (UbiComp '14). 853--859.

Digital Library

[19]

Minsam Ko, Seungwoo Choi, Subin Yang, Joonwon Lee, and Uichin Lee. 2015. FamiLync: Facilitating Participatory Parental Mediation of Adolescents' Smartphone Use. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). 867--878.

Digital Library

[20]

Leonard L. 1998. Children with specific language impairment. Cambridge: MIT Press.

[21]

Rescorla L. 2005. Age 13 language and reading outcomes in late-talking toddlers. Journal of Speech, Language, and Hearing Research 48, 2 (2005), 459--472.

[22]

LENA. http://www.lenafoundation.org.

[23]

Leslie S. Liu, Sen H. Hirano, Monica Tentori, Karen G. Cheng, Sheba George, Sun Young Park, and Gillian R. Hayes. 2011. Improving Communication and Social Support for Caregivers of High-risk Infants Through Mobile Technologies. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW '11). 475--484.

Digital Library

[24]

Dunn L.M. 1997. PPVT-III: Peabody picture vocabulary test. Circle Pines, MN: American Guidance Service. (1997).

[25]

Moseley M.J. 1990. Mother-child interaction with preschool language-delayed children: Structuring conversations. Journal of communication disorders 23, 3 (1990).

[26]

Soyoung Pae and Kumjoo Kwak. 2011. Korean MacArthur-Bates communicative development inventories (K M-B CDI). Seoul: Mind Press.

[27]

Laura Pina, Kael Rowan, Asta Roseway, Paul Johns, Gillian R. Hayes, and Mary Czerwinski. 2014. In Situ Cues for ADHD Parenting Strategies Using Mobile Technology. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth '14). 17--24.

Digital Library

[28]

Paul R. and Shiffer M.E. 1991. Communicative initiations in normal and late-talking toddlers. Applied Psycholinguistics 12, 4 (1991), 419--431.

[29]

Douglas A. Reynolds. 1995. Speaker identification and verification using Gaussian mixture speaker models. Speech Communication 17 (1995), 91--108.

Digital Library

[30]

Seyed Omid Sadjadi, Malcolm Slaney, and Larry Heck. 2013. MSR Identity Toolbox v1.0: A MATLAB Toolbox for Speaker Recognition Research. Technical Report MSR-TR-2013-133.

[31]

Petr Slovák, Kael Rowan, Christopher Frauenberger, Ran Gilad-Bachrach, Mia Doces, Brian Smith, Rachel Kamb, and Geraldine Fitzpatrick. 2016. Scaffolding the Scaffolding: Supporting Children's Social-emotional Learning at Home. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). 1751--1765.

Digital Library

[32]

Tobias Sonne, Jörg Müller, Paul Marshall, Carsten Obel, and Kaj Grønbæk. 2016. Changing Family Practices with Assistive Technology: MOBERO Improves Morning and Bedtime Routines for Children with ADHD. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). 152--164.

Digital Library

[33]

Svetha Venkatesh, Dinh Phung, Thi Duong, Stewart Greenhill, and Brett Adams. 2013. TOBY: Early Intervention in Autism Through Technology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). 3187--3196.

Digital Library

[34]

WEBRTC. http://www.webrtc.org/.

[35]

Kim Y.T. 2000. Content and Reliability Analyses of the Preschool Receptive-Expressive Language Scale (PRES). Communication Sciences and Disorders 5, 1 (2000), 1--25.

[36]

Kim Y.T. and Lee H.J. 2013. Conversational Turn-taking of Toddlers with Language Delay. Special Education 12, 3 (2013).

[37]

Yumin Zeng and Yi Zhang. 2007. Robust Children and Adults Speech Classification. In Fuzzy Systems and Knowledge Discovery, 2007. FSKD 2007. Fourth International Conference on, Vol. 4. 721--725.

Digital Library

Cited By

Theofanopoulou NAntle ASlovak P(2024)"They Don't Come With a Handbook": Exploring Design Opportunities for Supporting Parent-Child Interaction around Emotions in the Family ContextProceedings of the ACM on Human-Computer Interaction10.1145/36374098:CSCW1(1-33)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637409
Petsolari MIbrahim SSlovak P(2024)Socio-technical Imaginaries: Envisioning and Understanding AI Parenting Supports through Design FictionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642619(1-27)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642619
Lee JYoon SLee KJeong ECho JPark WYim DHwang I(2024)Open Sesame? Open Salami! Personalizing Vocabulary Assessment-Intervention for Children via Pervasive Profiling and Bespoke Storybook GenerationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642580(1-32)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642580
Show More Cited By

Index Terms

TalkLIME: mobile system intervention to improve parent-child interaction for children with language delay

Recommendations

TalkBetter: family-driven mobile intervention care for children with language delay
CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

Language delay is a developmental problem of children who do not acquire language as expected for their chronological ages. Without timely intervention, language delay can act as a lifelong risk factor. Speech-language pathologists highlight that ...
Designing Real Time Assistive Technologies: A Study of Children with ADHD
OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

Children with mental disorders like Attention Deficit Hyperactivity Disorder (ADHD) often experience challenges in school as they struggle to maintain their attention. Based on empirical studies conducted in school contexts and together with teachers ...
Not so funny after all! Humor, parents, peers, and their link with cyberbullying experiences
Abstract
Cyberbullying represents repeated and intentional aggression through digital devices and implies multiple roles: cyberbullying perpetrators, cyber-victims, active witnesses (cyber-defending), and cyber-passive bystanders. The present study aimed ...
Highlights
- Aggressive humor positively predicted cyberbullying perpetration and negatively predicted cyber-defending.
- Self-defeating humor positively predicted all the four forms of cyberbullying.
- Affiliative humor positively predicted cyber-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 2016

1288 pages

ISBN:9781450344616

DOI:10.1145/2971648

General Chairs:
Paul Lukowicz
DFKI and University of Kaiserslautern
,
Antonio Krüger
DFKI and Saarland University
,
Program Chairs:
Andreas Bulling
Max Planck Institute for Informatics
,
Youn-Kyung Lim
KAIST
,
Shwetak N. Patel
University of Washington

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

IT R&D program of msip/keit
Ministry of Science ICT and Future Planning

Conference

UbiComp '16

Sponsor:

UbiComp '16: The 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 12 - 16, 2016

Germany, Heidelberg

Acceptance Rates

UbiComp '16 Paper Acceptance Rate 101 of 389 submissions, 26%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
690
Total Downloads

Downloads (Last 12 months)88
Downloads (Last 6 weeks)11

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Theofanopoulou NAntle ASlovak P(2024)"They Don't Come With a Handbook": Exploring Design Opportunities for Supporting Parent-Child Interaction around Emotions in the Family ContextProceedings of the ACM on Human-Computer Interaction10.1145/36374098:CSCW1(1-33)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637409
Petsolari MIbrahim SSlovak P(2024)Socio-technical Imaginaries: Envisioning and Understanding AI Parenting Supports through Design FictionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642619(1-27)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642619
Lee JYoon SLee KJeong ECho JPark WYim DHwang I(2024)Open Sesame? Open Salami! Personalizing Vocabulary Assessment-Intervention for Children via Pervasive Profiling and Bespoke Storybook GenerationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642580(1-32)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642580
Yu JQi XYang S(2024)Parent-Child Joint Media Engagement Within HCI: A Scoping Analysis of the Research LandscapeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642307(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642307
DiFabio DMoodie SO’Hagan RPardal SGlista D(2023)Barriers and facilitators to paediatric caregivers’ participation in virtual speech, language, and hearing services: A scoping reviewDIGITAL HEALTH10.1177/205520762312166849Online publication date: 29-Nov-2023
https://doi.org/10.1177/20552076231216684
Lee JHwang I(2023)Hyper-personalizing Common Norms through Principled Bespoke GenerationAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3610761(215-219)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594739.3610761
Nikbakhtbideh BDuffett-Leger LLetourneau NOxford MTryphonopoulos PMoshirpour M(2023)An Ensemble Model for the Analysis of Parent-Child Interactions from Text and Audio2023 International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA58977.2023.00322(2133-2140)Online publication date: 15-Dec-2023
https://doi.org/10.1109/ICMLA58977.2023.00322
Nikbakhtbideh BDuffett-Leger LMoshirpour M(2023)Behavior Analysis of Parent-Child Interactions from Text2023 International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA58977.2023.00176(1175-1180)Online publication date: 15-Dec-2023
https://doi.org/10.1109/ICMLA58977.2023.00176
Morales-Rojas DMurcia Gutiérrez DMateus Moreno AMoreno Pastas L(2022)Estimulación del lenguaje infantil mediada por aplicaciones digitales dirigidas a padresAreté10.33881/1657-2513.art.2220522:2(41-50)Online publication date: 31-Dec-2022
https://doi.org/10.33881/1657-2513.art.22205
Kuo PSoma CAxford KHirsch TImel ZVan Epps J(2022)Do as I say, not as I do: Therapist Evaluation of a Practice and Supervision AidProceedings of the ACM on Human-Computer Interaction10.1145/35551856:CSCW2(1-23)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555185
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten