skip to main content
10.1145/3536221.3564030acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
abstract
Public Access

3rd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)

Published: 07 November 2022 Publication History

Abstract

This workshop discusses how interactive, multimodal technology such as virtual agents can be used in social skills training for measuring and training social-affective interactions. Sensing technology now enables analyzing user’s behaviors and physiological signals. Various signal processing and machine learning methods can be used for such prediction tasks. Such social signal processing and tools can be applied to measure and reduce social stress in everyday situations, including public speaking at schools and workplaces.

References

[1]
American Psychiatric Association. 2013. Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed. ed.). Autor, Washington, DC.
[2]
S. Burke, Tammy L. Bresnahan, T. Li, K. Epnere, A. Rizzo, Mary Partin, Robert M Ahlness, and M. Trimmer. 2018. Using Virtual Interactive Training Agents (ViTA) with Adults with Autism and Other Developmental Disabilities. Journal of Autism and Developmental Disorders 48 (2018), 905–912.
[3]
J. Daniels, J. N. Schwartz, C. Voss, N. Haber, A. Fazel, A. Kline, P. Washington, C. Feinstein, T. Winograd, and D. P. Wall. 2018. Exploratory study examining the at-home feasibility of a wearable tool for social-affective learning in children with autism. NPJ Digit Med 1(2018), 32.
[4]
Valeria Filippou, Nikolas Theodosiou, Mihalis Nicolaou, Elena Constantinou, Panayiotou Georgia, and Marios Theodorou. 2022. A Wavelet-based Approach for Multimodal Prediction of Alexithymia from Physiological Signals. In Companion Publication of the 2022 International Conference on Multimodal Interaction.
[5]
André Groß, Christian Schütze, Britta Wrede, and Birte Richter. 2022. An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems. In Companion Publication of the 2022 International Conference on Multimodal Interaction.
[6]
Ouriel Grynszpan, Julie Bouteiller, Séverine Grynszpan, Florence Le Barillier, Jean-Claude Martin, and Jacqueline Nadel. 2019. Altered sense of gaze leading in autism. Research in Autism Spectrum Disorders 67 (2019), 101441. https://doi.org/10.1016/j.rasd.2019.101441
[7]
L. Hemamou, G. Felhi, J. Martin, and C. Clavel. 2019. Slices of Attention in Asynchronous Video Job Interviews. In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII). 1–7. https://doi.org/10.1109/ACII.2019.8925439
[8]
L’eo Hemamou, Ghazi Felhi, Vincent Vandenbussche, Jean-Claude Martin, and Chloé Clavel. 2019. HireNet: A Hierarchical Attention Model for the Automatic Analysis of Asynchronous Video Job Interviews. In AAAI.
[9]
H. Maki, H. Tanaka, S. Sakti, and S. Nakamura. 2018. Graph Regularized Tensor Factorization for Single-Trial EEG Analysis. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 846–850.
[10]
Isabella Poggi, Catherine Pelachaud, F. Rosis, Valeria Carofiglio, and Berardina Carolis. 2005. Greta. A Believable Embodied Conversational Agent. 3–25. https://doi.org/10.1007/1-4020-3051-7_1
[11]
Vanessa Richter, Michael Neumann, Hardik Kothare, Oliver Roesler, Jackson Liscombe, David Suendermann-Oeft, Sebastian Prokop, Anzalee Khan, Christian Yavorsky, Jean-Pierre Lindenmayer, and Vikram Ramanarayanan. 2022. Towards Multimodal Dialog-Based Speech Facial Biomark- ers of Schizophrenia. In Companion Publication of the 2022 International Conference on Multimodal Interaction.
[12]
Oliver Roesler, Hardik Kothare, William Burke, Michael Neumann, Jackson Liscombe, Andrew Cornish, and Doug Habbersta. 2022. Exploring Facial Metric Normalization For Within- and Between-Subject Comparisons in a Multimodal Health Monitoring Agent. In Companion Publication of the 2022 International Conference on Multimodal Interaction.
[13]
Christian Schütze, André Groß, Britta Wrede, and Birte Richter. 2022. Enabling Non-Technical Domain Experts to Create Robot-Assisted Therapeutic Scenarios via Visual Programming. In Companion Publication of the 2022 International Conference on Multimodal Interaction.
[14]
Hiroki Tanaka, Satoshi Nakamura, Jean-Claude Martin, and Catherine Pelachaud. 2020. Social Affective Multimodal Interaction for Health. In Proceedings of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20). Association for Computing Machinery, New York, NY, USA, 893–894. https://doi.org/10.1145/3382507.3420059
[15]
Hiroki Tanaka, Satoshi Nakamura, Jean-Claude Martin, and Catherine Pelachaud. 2021. 2nd Workshop on Social Affective Multimodal Interaction for Health (SAMIH). In Proceedings of the 2021 International Conference on Multimodal Interaction. 853–854.
[16]
M. Iftekhar Tanveer, Emy Lin, and Mohammed (Ehsan) Hoque. 2015. Rhema: A Real-Time In-Situ Intelligent Interface to Help People with Public Speaking. In Proceedings of the 20th International Conference on Intelligent User Interfaces(Atlanta, Georgia, USA) (IUI ’15). Association for Computing Machinery, New York, NY, USA, 286–295. https://doi.org/10.1145/2678025.2701386

Index Terms

  1. 3rd Workshop on Social Affective Multimodal Interaction for Health (SAMIH)

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction
    November 2022
    830 pages
    ISBN:9781450393904
    DOI:10.1145/3536221
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 November 2022

    Check for updates

    Author Tags

    1. affective computing
    2. cognitive behavioral therapy
    3. motivational interview
    4. physiological signal processing
    5. social robotics
    6. social signal processing
    7. social skills training
    8. virtual agents

    Qualifiers

    • Abstract
    • Research
    • Refereed limited

    Funding Sources

    Conference

    ICMI '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 145
      Total Downloads
    • Downloads (Last 12 months)83
    • Downloads (Last 6 weeks)15
    Reflects downloads up to 03 Mar 2025

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media