skip to main content
10.1145/2535948.2535956acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

A dominance estimation mechanism using eye-gaze and turn-taking information

Published: 13 December 2013 Publication History

Abstract

With a goal of contributing to multiparty conversation management, this paper proposes a mechanism for estimating conversational dominance in group interaction. Based on our corpus analysis, we have already established a regression model for dominance estimation using speech and gaze information. In this study, we implement the model as a dominance estimation mechanism, and propose an idea of utilizing the mechanism in moderating multiparty conversations between a conversational robot and three human users. The system decides whom the system should talk to based on the dominance level of each user.

References

[1]
Bales, R., Interaction Process Analysis: A Method for the Study of Small Groups. Vol.: Addison Wesley, 1950.
[2]
Bohus, D. and Horvitz, E. Dialog in the Open World: Platform and Applications. in ICMI-MLMI'09. 2009.
[3]
Bohus, D. and Horvitz, E. Facilitating Multiparty Dialog with Gaze, Gesture, and Speech. in ICMI-MLMI'10. 2010.
[4]
Dovidio, J.F. and Ellyson, S.L., Patterns of visual dominance behavior in humans, in Power, dominance, and nonverbal behavior, S.L. Ellyson and Dovidio, J.F., Editors, New York: Springer-Verlag. p. 129--149. 1985.
[5]
Escalera, S., et al., Automatic Detection of Dominance and Expected Interest. EURASIP Journal on Advances in Signal Processing 2010. 39, 2010.
[6]
Goetsch, G. and McFarland, D., Models of the distribution of acts in small discussion groups. Social Psychology Quarterly. 43: p. 173--183, 1980.
[7]
Huang, H.-H., et al. How multiple concurrent users react to a quiz agent attentive to the dynamics of their game participation. in AAMAS. p. 1281--1288. 2010.
[8]
Hung, H., et al. Investigating Automatic Dominance Estimation in Groups From Visual Attention and Speaking Activity. in the 10th international conference on Multimodal interface (ICMI '08). p. 233--236. 2008.
[9]
Jayagopi, D.B., et al., Modeling Dominance in Group Conversations from Nonverbal Activity Cues. IEEE Trans. on Audio, Speech, and Language Processing, Special Issue on Multimodal Processing for Speech-based Interactions. 17(3): p. 501--513, 2009.
[10]
Knapp, M.L. and Hall, J.A., Nonverbal Communication in Human Interaction. Vol.: Wadsworth, 2010.
[11]
Nagao, K. and Takeuchi, A. Social Interaction: Multimodal Conversation with Social Agents. in Twelfth National Conference on Artificial Intelligence. Menlo Park, CA: AAAI Press p. 22--28. 1994.
[12]
Nakano, Y.I. and Fukuhara, Y. Estimating Conversational Dominance in Multiparty Interaction. in 14th ACM International Conference on Multimodal Interaction (ICMI2012). p. 77--84. 2012.
[13]
Otogi, S., et al. Finding the Timings for a Guide Agent to Intervene User-user Conversation to Provide Information Actively. in the 13th International Conference on Intelligent Virtual Agents (IVA 2013). 2013.
[14]
Rienks, R. and Heylen, D. Dominance Detection in Meetings using easily obtainable features. in 2nd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI 2005). Edinburgh, Scotland. 2005.
[15]
Rienks, R., et al. Detection and application of influence rankings in small group meetings. in ICMI '06 Proceedings of the 8th international conference on Multimodal interfaces (ICMI06). p. 257--264. 2006.
[16]
Sanchez-Cortes, D., et al. Identifying Emergent Leadership in Small Groups using Nonverbal Communicative Cues. in International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI'10). 2010.
[17]
Sidner, C.L., et al., Explorations in engagement for humans and robots. Artificial Intelligence. 166(1--2): p. 140--164, 2005.
[18]
Traum, D., et al. Multi-party, Multi-issue, Multi-strategy Negotiation for Multi-modal Virtual Agents. in the 8th International Conference on Intelligent Virtual Agents (IVA08). 2008.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GazeIn '13: Proceedings of the 6th workshop on Eye gaze in intelligent human machine interaction: gaze in multimodal interaction
December 2013
68 pages
ISBN:9781450325639
DOI:10.1145/2535948
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 December 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. conversational agent
  2. conversational dominance
  3. multiparty interaction
  4. nonverbal information

Qualifiers

  • Research-article

Conference

ICMI '13
Sponsor:

Acceptance Rates

GazeIn '13 Paper Acceptance Rate 11 of 13 submissions, 85%;
Overall Acceptance Rate 19 of 21 submissions, 90%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 155
    Total Downloads
  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media