Sowmya Rasipuram
ABSTRACT
Understanding people’s behavior in social interactions is a very interesting problem in Social Computing. In this work, we automatically predict the communication skill of a person in various kinds of social interactions. We consider in particular, 1) Interview-based interactions - asynchronous interviews (web-based interview) Vs. synchronous interviews (regular face-to-face interviews) and 2) Non-interview based interactions - dyad and triad conversations (group discussions). We automatically extract multimodal cues related to verbal and non-verbal behavior content of the interaction. First, in interview-based interactions, we consider previously uninvestigated scenarios of comparing the participant’s behavioral and perceptual changes in the two contexts. Second, we address different manifestations of communication skill in different settings (face-to-face interaction vs. group). Third, the non-interview based interactions also leads to answer research questions such as “the relation between a good communicator and other group variables like dominance or leadership” Finally we look at several attributes (manually annotated) and features/feature groups (automatically extracted) that predicts communication skill well in all settings.
- Hassle-free Efficient Hiring. https://www.talview.com/automated-video.Google Scholar
- Batrinca, L. M. Multimodal personality recognition from audiovisual data. In Diss. University of Trento (2013).Google Scholar
- Biel, J. I., Teijeiro-Mosquera, L., and Gatica-Perez, D. Facetube: predicting personality from facial expressions of emotion in online conversational video. In Proceedings of the 14th ACM int. COnf. on Multimodal interaction, ACM (2012), 53–56. Google ScholarDigital Library
- Celiktutan, O., Sariyanidi, E., and Gunes, H. Let me tell you about your personality!: Real-time personality prediction from nonverbal behavioural cues. In IEEE Int. Conf. and Workshops on Automatic Face and Gesture Recognition (FG), 2015, vol. 1, IEEE (2015), 1–1.Google ScholarCross Ref
- Giannakopoulos, T., and Pikrakis, A. Introduction to Audio Analysis: A MATLAB ® Approach. Academic Press, 2014. Google ScholarDigital Library
- Hoque, M. E., Courgeon, M., Martin, J.-C., Mutlu, B., and Picard, R. W. Mach: My automated conversation coach. In ACM Int. Joint Conf. on Pervasive and ubiquitous computing, ACM (2013), 697–706. Google ScholarDigital Library
- Hung, H., Jayagopi, D. B., Yeo, C., Friedland, G., Ba, S. O., Odobez, J.-M., Ramchandran, K., Mirghafori, N., and Gatica-Perez, D. Using audio and video features to classify the most dominant person in a group meeting. In Proc. ACM Int. Conf. on Multimedia (ACM MM) (Augsburg, Sep. 2007). Google ScholarDigital Library
- Keith, A., André, E., Baur, T., Bernardini, S., Chollet, M., Chryssafidou, E., Damian, I., Ennis, C., Egges, A., Gebhard, P., et al. The TARDIS framework: intelligent virtual agents for social coaching in job interviews. In Advances in Computer Entertainment. Springer, 2013, 476–491.Google Scholar
- Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., and Bartlett, M. The computer expression recognition toolbox (cert). In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, IEEE (2011), 298–305.Google Scholar
- Naim, I., Tanveer, M. I., Gildea, D., and Hoque, M. E. Automated prediction and analysis of job interview performance: The role of what you say and how you say it. Automatic Face and Gesture Recognition (FG) (2015).Google Scholar
- Nguyen, L. S., and Gatica-Perez, D. I would hire you in a minute: Thin slices of nonverbal behavior in job interviews. In ACM Int. Conf. on Multimodal Interaction, ACM (2015), 51–58. Google ScholarDigital Library
- Rosenberg, A., and Hirschberg, J. Acoustic/prosodic and lexical correlates of charismatic speech. 513–516.Google Scholar
- Sanchez-Cortes, D., Aran, O., Mast, M. S., and Gatica-Perez, D. A nonverbal behavior approach to identify emergent leaders in small groups. Multimedia, IEEE Transactions on 14, 3 (2012), 816–832. Google ScholarDigital Library
- Son, N. L. Hirability in the wild: Analysis of online conversational video resumes. vol. 18 (2016).Google Scholar
- Spitzberg, B. H., and Adams, T. W. CSRS, the conversational skills rating scale: an instructional assessment of interpersonal competence. NCA, National Communication Association, 2007.Google Scholar
- Teijeiro-Mosquera, L., Biel, J.-I., Alba-Castro, J. L., and Gatica-Perez, D. What your face vlogs about: Expressions of emotion and big-five traits impressions in youtube.Google Scholar
- Weninger, F., Krajewski, J., Batliner, A., and Schuller, B. The voice of leadership: Models and performances of automatic analysis in online speeches. IEEE Transactions on Affective Computing 3, 4 (2012), 496–508. Google ScholarDigital Library
- Zechner, K., and Bejar, I. I. Towards automatic scoring of non-native spontaneous speech. Conf. on human language technology of the North American chapter of the association of computational linguistics. (2006), 216–223. Google ScholarDigital Library
Index Terms
- Prediction/Assessment of communication skill using multimodal cues in social interactions
Recommendations
Multimodal Analysis for Communication Skill and Self-Efficacy Level Estimation in Job Interview Scenario
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous MultimediaAn interview for a job recruiting process requires applicants to demonstrate their communication skills. Interviewees sometimes become nervous about the interview because interviewees themselves do not know their assessed score. This study investigates ...
Asynchronous video interviews vs. face-to-face interviews for communication skill measurement: a systematic study
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal InteractionCommunication skill is an important social variable in em- ployment interviews. As recent trends point to, increasingly asynchronous or interface-based video interviews are becom- ing popular. Also getting increasing interest is automatic hiring ...
Multimodal analysis of body communication cues in employment interviews
ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interactionHand gestures and body posture are intimately linked to speech as they are used to enrich the vocal content, and are therefore inherently multimodal. As an important part of nonverbal behavior, body communication carries relevant information that can ...
Comments