Dennis Küster
Felix Putze
David St-Onge
ABSTRACT
Modeling with multimodal data in the wild poses similar challenges in human-computer and human-robot interaction (HCI, HRI). This workshop series thus blends HCI and HRI to jointly address a broad range of current topics in multimodal modeling aimed at designing intelligent systems in the wild. From addressing data scarcity in multimodal user state recognition to emotion prediction from EEG while listening to music, our third workshop in this series aims to further stimulate this important multidisciplinary exchange.
- Patrícia Alves-Oliveira, Dennis Küster, Arvid Kappas, and Ana Paiva. 2016. Psychological science in hri: Striving for a more integrated field of research. In 2016 AAAI Fall Symposium Series.Google Scholar
- Tony Belpaeme. 2020. The Wizard is Dead, Long Live Data: Towards Autonomous Social Behaviour Using Data-Driven Methods. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 411. https://doi.org/10.1145/3395035.3425204Google Scholar
- John T Cacioppo and Louis G Tassinary. 1990. Principles of psychophysiology: Physical, social, and inferential elements.Cambridge University Press.Google Scholar
- Sromona Chatterjee, Kevin Scheck, Dennis Küster, Felix Putze, Harish Moturu, Johannes Schering, Jorge Marx Gómez, and Tanja Schultz. 2020. SmartHelm: Towards Multimodal Detection of Attention in an Outdoor Augmented Reality Biking Scenario. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 426–432. https://doi.org/10.1145/3395035.3425207Google ScholarDigital Library
- Andreas Foltyn and Jessica Deuschel. 2021. Towards Reliable Multimodal Stress Detection under Distribution Shift. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.Google ScholarDigital Library
- Elif Gümüslü, Duygun Erol Barkana, and Hatice Köse. 2020. Emotion Recognition Using EEG and Physiological Data for Robot-Assisted Rehabilitation Systems. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 379–387. https://doi.org/10.1145/3395035.3425199Google Scholar
- Dennis Küster, Felix Putze, Patrícia Alves-Oliveira, Maike Paetzel, and Tanja Schultz. 2020. Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild. In Proceedings of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20). Association for Computing Machinery, New York, NY, USA, 883–885. https://doi.org/10.1145/3382507.3420053Google ScholarDigital Library
- Dennis Küster and Arvid Kappas. 2014. What Could a Body Tell a Social Robot that It Does Not Know?. In Proceedings of the International Conference on Physiological Computing Systems (Lisbon, Portugal). SCITEPRESS - Science and and Technology Publications, 358–367. https://doi.org/10.5220/0004892503580367Google Scholar
- Aurelien Lechappe, Mathieu Chollet, Jérôme Rigaud, and Caroline G.L. Cao. 2020. Assessment of Situation Awareness during Robotic Surgery Using Multimodal Data. In Companion Publication of the 2020 International Conference on Multimodal Interaction(Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 412–416. https://doi.org/10.1145/3395035.3425205Google ScholarDigital Library
- Kana Miyamoto, Hiroki Tanaka, and Satoshi Nakamura. 2021. Meta-Learning for Emotion Prediction from EEG while Listening to Music. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.Google ScholarDigital Library
- Tempestt Neal, Khadija Zanna, and Shaun Canavan. 2021. Clustering of Physiological Signals by Emotional State, Race, and Sex. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.Google Scholar
- Srinivas Parthasarathy and Shiva Sundaram. 2020. Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognition. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 400–404. https://doi.org/10.1145/3395035.3425202Google ScholarDigital Library
- Felix Putze, Merlin Burri, Lisa-Marie Vortmann, and Tanja Schultz. 2020. Model-Based Prediction of Exogeneous and Endogeneous Attention Shifts During an Everyday Activity. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 417–425. https://doi.org/10.1145/3395035.3425206Google ScholarDigital Library
- Felix Putze, Jutta Hild, Akane Sano, Enkelejda Kasneci, Erin Solovey, and Tanja Schultz. 2018. Modeling Cognitive Processes from Multimodal Signals. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (Boulder, CO, USA) (ICMI ’18). Association for Computing Machinery, New York, NY, USA, 663. https://doi.org/10.1145/3242969.3265861Google ScholarDigital Library
- David St-Onge, Marcel Kaufmann, Jacopo Panerati, Benjamin Ramtoula, Yanjun Cao, Emily B.J. Coffey, and Giovanni Beltrame. 2020. Planetary Exploration With Robot Teams: Implementing Higher Autonomy With Swarm Intelligence. IEEE Robotics Automation Magazine 27, 2 (2020), 159–168. https://doi.org/10.1109/MRA.2019.2940413Google ScholarCross Ref
- Nerea Urrestilla and David St-Onge. 2020. Measuring Cognitive Load: Heart-Rate Variability and Pupillometry Assessment. In Companion Publication of the 2020 International Conference on Multimodal Interaction(Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 405–410. https://doi.org/10.1145/3395035.3425203Google Scholar
- Hendric Voss, Heiko Wersing, and Stefan Kopp. 2021. Addressing Data Scarcity in Multimodal User State Recognition by Combining Semi-Supervised and Supervised Learning. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21), October 18–22, 2021, Montreal, Canada. Association for Computing Machinery, New York, NY, USA.Google Scholar
Recommendations
Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild
ICMI '20: Proceedings of the 2020 International Conference on Multimodal InteractionDetecting, modeling, and making sense of multimodal data from human users in the wild still poses numerous challenges. Starting from aspects of data quality and reliability of our measurement instruments, the multidisciplinary endeavor of developing ...
The 5th Workshop on Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild (MSECP-Wild)
ICMI '23: Proceedings of the 25th International Conference on Multimodal InteractionThe ability to automatically infer relevant aspects of human users’ thoughts and feelings is crucial for technologies to intelligently adapt their behaviors in complex interactions. Research on multimodal analysis has demonstrated the potential of ...
Attention and Engagement Aware Multimodal Conversational Systems
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal InteractionDespite their ability to complete certain tasks, dialog systems still suffer from poor adaptation to users' engagement and attention. We observe human behaviors in different conversational settings to understand human communication dynamics and then ...
Comments