research-article

Automated Social Skills Trainer

Authors:

Sakriani Sakti,

Hidemi Iwasaka,

Satoshi NakamuraAuthors Info & Claims

IUI '15: Proceedings of the 20th International Conference on Intelligent User Interfaces

Pages 17 - 27

https://doi.org/10.1145/2678025.2701368

Published: 18 March 2015 Publication History

Abstract

Social skills training is a well-established method to decrease human anxiety and discomfort in social interaction, and acquire social skills. In this paper, we attempt to automate the process of social skills training by developing a dialogue system named "automated social skills trainer," which provides social skills training through human-computer interaction. The system includes a virtual avatar that recognizes user speech and language information and gives feedback to users to improve their social skills. Its design is based on conventional social skills training performed by human participants, including defining target skills, modeling, role-play, feedback, reinforcement, and homework. An experimental evaluation measuring the relationship between social skill and speech and language features shows that these features have a relationship with autistic traits. Additional experiments measuring the effect of performing social skills training with the proposed application show that most participants improve their skill by using the system for 50 minutes.

References

[1]

American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC, (2013).

[2]

Baron-Cohen, S., Richler, J., Bisarya, D., Gurunathan, N., Wheelwright, S. The systemizing quotient: an investigation of adults with Asperger syndrome or high-functioning autism, and normal sex differences. Philosophical Trans. the Royal Society of London Series B: Biological Sciences 358, 361--374 (2003).

[3]

Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., Clubley, E. The Autism-Spectrum Quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J. Autism and Developmental Disorders 31, 5--17 (2001).

[4]

Bauminger, N. The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes. J. Autism and Developmental Disorders 32, 283--298 (2002).

[5]

Bishop, J. The Internet for educating individuals with social impairments. J. of Computer Assisted Learning 19, 546--556 (2003).

[6]

Bone, D., Black, P., Lee, C., Williams, E., Levitt, P., Lee, S., Narayanan, S. Spontaneous-Speech Acoustic-Prosodic Features of Children with Autism and the Interacting Psychologist. Proc. Interspeech, (2002).

[7]

Bonneh, Y., Levanon, Y., Dean Pardo, O., Lossos, L., Adini, Y. Abnormal speech spectrum and increased pitch variability in young autistic children. Frontiers in Human Neuroscience 4, (2011).

[8]

Davis, M., Dautenhahn, K., Nehaniv, C., Powell, S. Towards an Interactive System Facilitating Therapeutic Narrative Elicitation. Proc. 3rd Conf. on NILE, (2004).

[9]

Essau, C. A., Olaya, B., Sasagawa, S., Pithia, J., Bray, D., Ollendick, T. H. Integrating video-feedback and cognitive preparation, social skills training and behavioural activation in a cognitive behavioural therapy in the treatment of childhood anxiety. J. Affect Disorders 167, 261--267 (2014).

[10]

Hanson, M. H. Glottal characteristics of female speakers. Harvard University, Ph. D. dissertation, (1995).

Digital Library

[11]

Heeman, P. A., Lunsford, R., Selfridge, E., Black, L., Van Santen, J. Autism and interactional aspects of dialogue. Proc. 11th SIGDIAL, 249--252 (2010).

Digital Library

[12]

Kanner, L. Autistic disturbances of affective contact. Nervous Child 2, 217--250 (1943).

[13]

Kiss, G., Van Santen, H. Estimating Speaker-Specific Intonation Patterns Using the Linear Alignment Model. Proc. Interspeech, 354--358 (2013).

[14]

Kiss, G., Van Santen, H., Prud'hommeaux, T., Black, M. Quantitative Analysis of Pitch in Speech of Children with Neurodevelopmental Disorders. Proc. Interspeech, (2012).

[15]

Hoque, E., Courgeon, M., Mutlu, B., Martin, C., Picard, W. MACH: my automated conversation coach. Proc. 15th Conf. on UbiComp, 697--706 (2013).

Digital Library

[16]

McCann, J., Sue, P. Prosody in autism spectrum disorders: a critical review. International J Language & Communication Disorders 38, 325--350 (2003).

[17]

Moore, D., Mcgrath, P., Thorpe, J. Computer-aided learning for people with autism - a framework for research and development. Innovations in Education and Teaching International 37, 218--228 (2000).

[18]

Parsons, S., Mitchell, P. The potential of virtual reality in social skills training for people with autistic spectrum disorders. J. Intellectual Disability Research 46, pp. 430--443 (2002).

[19]

Pennebaker, W., Martha, F., Roger, B. Linguistic inquiry and word count (LIWC). LIWC {Computer software}, (2005).

[20]

Rietveld, T., Van Hout, R. Statistical techniques for the study of language behaviour. Mouton de Gruyter, (1993).

[21]

Rouhizadeh, M., Prud'hommeaux, E., Roark, B., Van Santen, H. Distributional semantic models for the evaluation of disordered language. Proc. NAACL-HLT, 709--714 (2013).

[22]

Tanaka, H., Sakriani, S., Neubig, G., Toda, T., Nakamura, S. Linguistic and Acoustic Features for Automatic Identification of Autism Spectrum Disorders in Children's Narrative. ACL2014 Workshop on Computational Linguistics and Clinical Psychology, 88--96 (2014).

[23]

Van Santen, H., Richard, S., Alison, H. Quantifying repetitive speech in autism spectrum disorders and language impairment. Autism Research 6, 372--383 (2013).

[24]

Wakabayashi, A. Baron-Cohen, S., Wheelwright, S., Tojo, Y. The Autism-Spectrum Quotient (AQ) in Japan: a cross-cultural comparison. J. Autism and Developmental Disorders 36, 263--270 (2006).

[25]

Wallace, C. J., Nelson, C. J., Liberman, R. P., Aitchison, R. A., Lukoff, D., Elder, J. P., Ferris, C. A review and critique of social skills training with schizophrenic patients. Schizophr Bull 6, 42--63 (1980).

Cited By

Hosseini SQuan JDeng XMiyake YNozawa T(2024)Avatar-Based Feedback in Job Interview Training Impacts Action Identities and AnxietyIEEE Transactions on Affective Computing10.1109/TAFFC.2024.336383515:3(1608-1620)Online publication date: Jul-2024
https://doi.org/10.1109/TAFFC.2024.3363835
Rao PRenier LBoldi MMast MJayagopi DCherubini M(2024)On the potential of supporting autonomy in online video interview training platformsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103326191:COnline publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103326
Koda TTakeuchi NHotta M(2023)Analysis of the Effects of Assertive Feedback from a Job Interview Training AgentProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623933(384-386)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623933
Show More Cited By

Index Terms

Automated Social Skills Trainer
1. Applied computing
  1. Education
    1. Computer-assisted instruction
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Teaching Social Communication Skills Through Human-Agent Interaction
Regular Articles, Special Issue on Highlights of IUI 2015 (Part 2 of 2) and Special Issue on Highlights of ICMI 2014 (Part 1 of 2)

There are a large number of computer-based systems that aim to train and improve social skills. However, most of these do not resemble the training regimens used by human instructors. In this article, we propose a computer-based training system that ...
The Development and Evaluation of English Dialogue Companion System
ICALT '08: Proceedings of the 2008 Eighth IEEE International Conference on Advanced Learning Technologies

In this paper, we propose the English Dialogue Companion (EDC) system to help elementary school students learn second language, as English. Learners can practice conversation with the EDC system in English. In order to motivate the learners, we design ...
Acquisition of troubleshooting skills in a computer simulation: Worked example vs. conventional problem solving instructional strategies

In a computer-based simulation of a chemical processing plant, the differential effects of three instructional strategies for learning how to troubleshoot the plant's malfunctions were investigated. In an experiment concerning learners' transfer ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '15: Proceedings of the 20th International Conference on Intelligent User Interfaces

March 2015

480 pages

ISBN:9781450333061

DOI:10.1145/2678025

General Chairs:
Oliver Brdiczka
Vectra Networks, Inc.
,
Polo Chau
Georgia Tech
,
Program Chairs:
Giuseppe Carenini
University of British Columbia
,
Shimei Pan
University of Maryland
,
Per Ola Kristensson
University of Cambridge

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Foundation for Nara Institute of Science and Technology
JSPS KAKEN

Conference

IUI'15

Sponsor:

IUI'15: IUI'15 20th International Conference on Intelligent User Interfaces

March 29 - April 1, 2015

Georgia, Atlanta, USA

Acceptance Rates

IUI '15 Paper Acceptance Rate 47 of 205 submissions, 23%;

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
672
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hosseini SQuan JDeng XMiyake YNozawa T(2024)Avatar-Based Feedback in Job Interview Training Impacts Action Identities and AnxietyIEEE Transactions on Affective Computing10.1109/TAFFC.2024.336383515:3(1608-1620)Online publication date: Jul-2024
https://doi.org/10.1109/TAFFC.2024.3363835
Rao PRenier LBoldi MMast MJayagopi DCherubini M(2024)On the potential of supporting autonomy in online video interview training platformsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103326191:COnline publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103326
Koda TTakeuchi NHotta M(2023)Analysis of the Effects of Assertive Feedback from a Job Interview Training AgentProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623933(384-386)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623933
Tun SOkada SHuang HLeong C(2023)Multimodal Transfer Learning for Oral Presentation AssessmentIEEE Access10.1109/ACCESS.2023.329583211(84013-84026)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3295832
Torrado JBakke CGabarron E(2023)Chatbots and Children with Special Educational Needs InteractionUniversal Access in Human-Computer Interaction10.1007/978-3-031-35897-5_32(443-452)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35897-5_32
Ohba TMawalim CKatada SKuroki HOkada S(2022)Multimodal Analysis for Communication Skill and Self-Efficacy Level Estimation in Job Interview ScenarioProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568461(110-120)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568461
Zheng QTang YLiu YLiu WHuang Y(2022)UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital LibraryProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501855(1-24)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501855
Zhang QHuang YChernyshov GLi JPai YKunze K(2022)GazeSync: Eye Movement Transfer Using an Optical Eye Tracker and Monochrome Liquid Crystal DisplaysCompanion Proceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490100.3516469(54-57)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490100.3516469
Ishii YKurokawa SKitamura MWatanabe T(2022)Development of a Web-Based Interview Support System Using Characters Nodding with Various MovementsHCI International 2022 - Late Breaking Papers. Multimodality in Advanced Interaction Environments10.1007/978-3-031-17618-0_7(76-87)Online publication date: 2-Oct-2022
https://doi.org/10.1007/978-3-031-17618-0_7
Abd-Alrazaq AAlajlani MAli NDenecke KBewick BHouseh M(2021)Perceptions and Opinions of Patients About Mental Health Chatbots: Scoping ReviewJournal of Medical Internet Research10.2196/1782823:1(e17828)Online publication date: 13-Jan-2021
https://doi.org/10.2196/17828
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten