ABSTRACT
Social skills training is a well-established method to decrease human anxiety and discomfort in social interaction, and acquire social skills. In this paper, we attempt to automate the process of social skills training by developing a dialogue system named "automated social skills trainer," which provides social skills training through human-computer interaction. The system includes a virtual avatar that recognizes user speech and language information and gives feedback to users to improve their social skills. Its design is based on conventional social skills training performed by human participants, including defining target skills, modeling, role-play, feedback, reinforcement, and homework. An experimental evaluation measuring the relationship between social skill and speech and language features shows that these features have a relationship with autistic traits. Additional experiments measuring the effect of performing social skills training with the proposed application show that most participants improve their skill by using the system for 50 minutes.
- American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC, (2013).Google ScholarCross Ref
- Baron-Cohen, S., Richler, J., Bisarya, D., Gurunathan, N., Wheelwright, S. The systemizing quotient: an investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philosophical Trans. the Royal Society of London Series B: Biological Sciences 358, 361--374 (2003).Google ScholarCross Ref
- Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., Clubley, E. The Autism-Spectrum Quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J. Autism and Developmental Disorders 31, 5--17 (2001).Google ScholarCross Ref
- Bauminger, N. The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes. J. Autism and Developmental Disorders 32, 283--298 (2002).Google ScholarCross Ref
- Bishop, J. The Internet for educating individuals with social impairments. J. of Computer Assisted Learning 19, 546--556 (2003).Google ScholarCross Ref
- Bone, D., Black, P., Lee, C., Williams, E., Levitt, P., Lee, S., Narayanan, S. Spontaneous-Speech Acoustic-Prosodic Features of Children with Autism and the Interacting Psychologist. Proc. Interspeech, (2002).Google Scholar
- Bonneh, Y., Levanon, Y., Dean Pardo, O., Lossos, L., Adini, Y. Abnormal speech spectrum and increased pitch variability in young autistic children. Frontiers in Human Neuroscience 4, (2011).Google Scholar
- Davis, M., Dautenhahn, K., Nehaniv, C., Powell, S. Towards an Interactive System Facilitating Therapeutic Narrative Elicitation. Proc. 3rd Conf. on NILE, (2004).Google Scholar
- Essau, C. A., Olaya, B., Sasagawa, S., Pithia, J., Bray, D., Ollendick, T. H. Integrating video-feedback and cognitive preparation, social skills training and behavioural activation in a cognitive behavioural therapy in the treatment of childhood anxiety. J. Affect Disorders 167, 261--267 (2014).Google ScholarCross Ref
- Hanson, M. H. Glottal characteristics of female speakers. Harvard University, Ph. D. dissertation, (1995). Google ScholarDigital Library
- Heeman, P. A., Lunsford, R., Selfridge, E., Black, L., Van Santen, J. Autism and interactional aspects of dialogue. Proc. 11th SIGDIAL, 249--252 (2010). Google ScholarDigital Library
- Kanner, L. Autistic disturbances of affective contact. Nervous Child 2, 217--250 (1943).Google Scholar
- Kiss, G., Van Santen, H. Estimating Speaker-Specific Intonation Patterns Using the Linear Alignment Model. Proc. Interspeech, 354--358 (2013).Google Scholar
- Kiss, G., Van Santen, H., Prud'hommeaux, T., Black, M. Quantitative Analysis of Pitch in Speech of Children with Neurodevelopmental Disorders. Proc. Interspeech, (2012).Google Scholar
- Hoque, E., Courgeon, M., Mutlu, B., Martin, C., Picard, W. MACH: my automated conversation coach. Proc. 15th Conf. on UbiComp, 697--706 (2013). Google ScholarDigital Library
- McCann, J., Sue, P. Prosody in autism spectrum disorders: a critical review. International J Language & Communication Disorders 38, 325--350 (2003).Google ScholarCross Ref
- Moore, D., Mcgrath, P., Thorpe, J. Computer-aided learning for people with autism - a framework for research and development. Innovations in Education and Teaching International 37, 218--228 (2000).Google ScholarCross Ref
- Parsons, S., Mitchell, P. The potential of virtual reality in social skills training for people with autistic spectrum disorders. J. Intellectual Disability Research 46, pp. 430--443 (2002).Google ScholarCross Ref
- Pennebaker, W., Martha, F., Roger, B. Linguistic inquiry and word count (LIWC). LIWC {Computer software}, (2005).Google Scholar
- Rietveld, T., Van Hout, R. Statistical techniques for the study of language behaviour. Mouton de Gruyter, (1993).Google ScholarCross Ref
- Rouhizadeh, M., Prud'hommeaux, E., Roark, B., Van Santen, H. Distributional semantic models for the evaluation of disordered language. Proc. NAACL-HLT, 709--714 (2013).Google Scholar
- Tanaka, H., Sakriani, S., Neubig, G., Toda, T., Nakamura, S. Linguistic and Acoustic Features for Automatic Identification of Autism Spectrum Disorders in Children's Narrative. ACL2014 Workshop on Computational Linguistics and Clinical Psychology, 88--96 (2014).Google ScholarCross Ref
- Van Santen, H., Richard, S., Alison, H. Quantifying repetitive speech in autism spectrum disorders and language impairment. Autism Research 6, 372--383 (2013).Google ScholarCross Ref
- Wakabayashi, A. Baron-Cohen, S., Wheelwright, S., Tojo, Y. The Autism-Spectrum Quotient (AQ) in Japan: a cross-cultural comparison. J. Autism and Developmental Disorders 36, 263--270 (2006).Google ScholarCross Ref
- Wallace, C. J., Nelson, C. J., Liberman, R. P., Aitchison, R. A., Lukoff, D., Elder, J. P., Ferris, C. A review and critique of social skills training with schizophrenic patients. Schizophr Bull 6, 42--63 (1980).Google ScholarCross Ref
Index Terms
- Automated Social Skills Trainer
Recommendations
Teaching Social Communication Skills Through Human-Agent Interaction
Regular Articles, Special Issue on Highlights of IUI 2015 (Part 2 of 2) and Special Issue on Highlights of ICMI 2014 (Part 1 of 2)There are a large number of computer-based systems that aim to train and improve social skills. However, most of these do not resemble the training regimens used by human instructors. In this article, we propose a computer-based training system that ...
The Development and Evaluation of English Dialogue Companion System
ICALT '08: Proceedings of the 2008 Eighth IEEE International Conference on Advanced Learning TechnologiesIn this paper, we propose the English Dialogue Companion (EDC) system to help elementary school students learn second language, as English. Learners can practice conversation with the EDC system in English. In order to motivate the learners, we design ...
Acquisition of troubleshooting skills in a computer simulation: Worked example vs. conventional problem solving instructional strategies
In a computer-based simulation of a chemical processing plant, the differential effects of three instructional strategies for learning how to troubleshoot the plant's malfunctions were investigated. In an experiment concerning learners' transfer ...
Comments