short-paper

Social Affective Multimodal Interaction for Health

Authors:

Satoshi Nakamura,

Jean-Claude Martin,

Catherine PelachaudAuthors Info & Claims

ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

Pages 893 - 894

https://doi.org/10.1145/3382507.3420059

Published: 22 October 2020 Publication History

Abstract

This workshop discusses how interactive, multimodal technology such as virtual agents can be used in social skills training for measuring and training social-affective interactions. Sensing technology now enables analyzing user's behaviors and physiological signals. Various signal processing and machine learning methods can be used for such prediction tasks. Such social signal processing and tools can be applied to measure and reduce social stress in everyday situations, including public speaking at schools and workplaces.

References

[1]

American Psychiatric Association. 2013. Diagnostic and statistical manual of mental disorders: DSM-5 5th ed. ed.). Autor, Washington, DC .

[2]

A.S. Bellack, K.T. Mueser, S. Gingerich, and J. Agresta. 2013. Social Skills Training for Schizophrenia, Second Edition: A Step-by-Step Guide .Guilford Publications.

[3]

Merijn Bruijnes, Jeroen Linssen, and Dirk Heylen. 2019. Special issue editorial: Virtual Agents for Social Skills Training. Journal on Multimodal User Interfaces, Vol. 13, 1 (01 Mar 2019), 1--2. https://doi.org/10.1007/s12193-018-00291--7

[4]

S. Burke, Tammy L. Bresnahan, T. Li, K. Epnere, A. Rizzo, Mary Partin, Robert M Ahlness, and M. Trimmer. 2018. Using Virtual Interactive Training Agents (ViTA) with Adults with Autism and Other Developmental Disabilities. Journal of Autism and Developmental Disorders, Vol. 48 (2018), 905--912.

[5]

J. Daniels, J. N. Schwartz, C. Voss, N. Haber, A. Fazel, A. Kline, P. Washington, C. Feinstein, T. Winograd, and D. P. Wall. 2018. Exploratory study examining the at-home feasibility of a wearable tool for social-affective learning in children with autism. NPJ Digit Med, Vol. 1 (2018), 32.

[6]

K. K. Fitzpatrick, A. Darcy, and M. Vierhile. 2017. Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial. JMIR Ment Health, Vol. 4, 2 (Jun 2017), e19.

[7]

Ouriel Grynszpan, Julie Bouteiller, Séverine Grynszpan, Florence Le Barillier, Jean-Claude Martin, and Jacqueline Nadel. 2019. Altered sense of gaze leading in autism. Research in Autism Spectrum Disorders, Vol. 67 (2019), 101441. https://doi.org/10.1016/j.rasd.2019.101441

[8]

Rahul Gupta, Nishant Nath, Taruna Agrawal, Panayiotis Georgiou, David C. Atkins, and Shrikanth S. Narayanan. 2016. Laughter Valence Prediction in Motivational Interviewing Based on Lexical and Acoustic Cues. In Interspeech 2016. 505--509. https://doi.org/10.21437/Interspeech.2016--184

[9]

L. Hemamou, G. Felhi, J. Martin, and C. Clavel. 2019. Slices of Attention in Asynchronous Video Job Interviews. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). 1--7. https://doi.org/10.1109/ACII.2019.8925439

[10]

L'eo Hemamou, Ghazi Felhi, Vincent Vandenbussche, Jean-Claude Martin, and Chloé Clavel. 2019. HireNet: A Hierarchical Attention Model for the Automatic Analysis of Asynchronous Video Job Interviews. In AAAI .

[11]

Mohammed (Ehsan) Hoque, Matthieu Courgeon, Jean-Claude Martin, Bilge Mutlu, and Rosalind W. Picard. 2013. MACH: My Automated Conversation Coach. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Zurich, Switzerland) (UbiComp '13). Association for Computing Machinery, New York, NY, USA, 697--706. https://doi.org/10.1145/2493432.2493502

[12]

H. Maki, H. Tanaka, S. Sakti, and S. Nakamura. 2018. Graph Regularized Tensor Factorization for Single-Trial EEG Analysis. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 846--850.

[13]

Isabella Poggi, Catherine Pelachaud, F. Rosis, Valeria Carofiglio, and Berardina Carolis. 2005. Greta. A Believable Embodied Conversational Agent. 3--25. https://doi.org/10.1007/1--4020--3051--7_1

[14]

H. Tanaka, H. Negoro, H. Iwasaka, and S. Nakamura. 2017. Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders. PLoS ONE, Vol. 12, 8 (2017), e0182151.

[15]

M. Iftekhar Tanveer, Emy Lin, and Mohammed (Ehsan) Hoque. 2015. Rhema: A Real-Time In-Situ Intelligent Interface to Help People with Public Speaking. In Proceedings of the 20th International Conference on Intelligent User Interfaces (Atlanta, Georgia, USA) (IUI '15). Association for Computing Machinery, New York, NY, USA, 286--295. https://doi.org/10.1145/2678025.2701386

Digital Library

Cited By

Tanaka HNakamura SMartin JPelachaud C(2023)4th Workshop on Social Affective Multimodal Interaction for Health (SAMIH)Proceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616878(816-817)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3616878
Tanaka HNakamura SShidara KMartin JPelachaud C(2022)3rd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)Proceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3564030(805-806)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3564030
Tanaka HNakamura SMartin JPelachaud C(2021)2nd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)Proceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3480975(853-854)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3480975

Index Terms

Social Affective Multimodal Interaction for Health
1. Applied computing
  1. Life and medical sciences
    1. Health care information systems

Recommendations

4th Workshop on Social Affective Multimodal Interaction for Health (SAMIH)
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

This workshop discusses how interactive, multimodal technology, such as virtual agents, can measure and train social-affective interactions. Sensing technology now enables analyzing users’ behaviors and physiological signals. Various signal processing ...
3rd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)
ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction

This workshop discusses how interactive, multimodal technology such as virtual agents can be used in social skills training for measuring and training social-affective interactions. Sensing technology now enables analyzing user’s behaviors and ...
2nd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)
ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

This workshop discusses how interactive, multimodal technology such as virtual agents can be used in social skills training for measuring and training social-affective interactions. Sensing technology now enables analyzing user’s behaviors and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

October 2020

920 pages

ISBN:9781450375818

DOI:10.1145/3382507

General Chairs:
Khiet Truong
University of Twente, the Netherlands
,
Dirk Heylen
University of Twente, the Netherlands
,
Mary Czerwinski
Microsoft Research, USA
,
Program Chairs:
Nadia Berthouze
University College London, United Kingdom
,
Mohamed Chetouani
Sorbonne University, France
,
Mikio Nakano
C4A Research Institute, Japan

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

JST CREST

Conference

ICMI '20

Sponsor:

SIGCHI

ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 25 - 29, 2020

Virtual Event, Netherlands

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
137
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tanaka HNakamura SMartin JPelachaud C(2023)4th Workshop on Social Affective Multimodal Interaction for Health (SAMIH)Proceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616878(816-817)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3616878
Tanaka HNakamura SShidara KMartin JPelachaud C(2022)3rd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)Proceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3564030(805-806)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3564030
Tanaka HNakamura SMartin JPelachaud C(2021)2nd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)Proceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3480975(853-854)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3480975

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten