Multimodal Emotion Recognition Harnessing the Complementarity of Speech, Language, and Vision
Abstract
References
Index Terms
- Multimodal Emotion Recognition Harnessing the Complementarity of Speech, Language, and Vision
Recommendations
Feature-Enhanced Multimodal Interaction model for emotion recognition in conversation
AbstractMultimodal Emotion Recognition in Conversation (MERC) aims to identify the emotional state of a speaker who expresses their opinions through text, vision, and audio information during conversations. MERC enables intelligent machines to exhibit ...
Highlights- The multimodal feature-enhanced module fully mines the comprehensive multimodal features, which include semantic and emotional features of text, vision, and audio.
- The incremental transformer dialogue module models the dialogue process,...
Multimodal Emotion Recognition with Vision-language Prompting and Modality Dropout
MRAC '24: Proceedings of the 2nd International Workshop on Multimodal and Responsible Affective ComputingIn this paper, we present our solution for the Second Multimodal Emotion Recognition Challenge Track 1(MER2024-SEMI). To enhance the accuracy and generalization performance of emotion recognition, we propose several methods for Multimodal Emotion ...
Token-disentangling Mutual Transformer for multimodal emotion recognition
AbstractMultimodal emotion recognition presents a complex challenge, as it involves the identification of human emotions using various modalities such as video, text, and audio. Existing methods focus mainly on the fusion information from multimodal data,...
Highlights- We propose a novel and robust Token-disentangling Mutual Transformer (TMT) to achieve accurate multimodal emotion recognition.
- We propose a simple and easy-to-implement multimodal emotion Token disentanglement module to disentangle the ...
Comments
Information & Contributors
Information
Published In

Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 273Total Downloads
- Downloads (Last 12 months)273
- Downloads (Last 6 weeks)67
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in