skip to main content
10.1145/2401836.2401844acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Analysis on learners' gaze patterns and the instructor's reactions in ballroom dance tutoring

Published: 26 October 2012 Publication History

Abstract

The use of virtual conversational agents is awaited in the tutoring of physical skills such as sports or dances. This paper describes about an ongoing project aiming to realize a virtual instructor for ballroom dance. First, a human-human experiment is conducted to collect the interaction corpus between a professional instructor and six learners. The verbal and non-verbal behaviors of the instructor is analyzed and served as the base of a state transition model for ballroom dance tutoring. In order to achieve intuitive and efficient instruction during the multi-modal interaction between the virtual instructor and the learner, the eye gaze patterns of the learner and the reaction from the instructor were analyzed. From the analysis results, it was found that the learner's attitude (confidence and concentration) could be approximated by their gaze patterns, and the instructor's tutoring strategy supported this as well.

References

[1]
J. C. Chan, H. Leung, J. K. Tang, and T. Komura. A virtual reality dance training system using motion capture technology. IEEE Transactions on Learning Technologies, PP(99), 2010.
[2]
P. T. Chua, R. Crivella, B. Daly, N. Hu, R. Schaaf, D. Ventura, T. Camill, J. Hodgins, and R. Pausch. Trainning for physical tasks in virtual environments: Tai chi. In IEEE Virtual Reality (VR 2003), 2003.
[3]
S. Duncan. Some signals and rules for taking speaking turns in conversations. Journal of Personality and Psychology, 23(2):283--292, 1972.
[4]
R. Ishiii and Y. Nakano. Estimating user's conversational engagement based on gaze behaviors. In Proceedings of the 8th International Conference on Intelligent Virtual Agents (IVA'08), pages 200--207, Tokyo, Japan, 2008.
[5]
M. Kipp. Spatiotemporal coding in anvil. In Proceedings of the 6th international conference on Language Resources and Evaluation (LREC-08), 2008.
[6]
A. Nakamura, S. Tabata, T. Ueda, S. Kiyofuji, and Y. Kuno. Dance training system with active vibro-devices and a mobile image display. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2005), 2005.
[7]
Y. I. Nakano, G. Reinstein, T. Stocky, and J. Cassell. Towards a model of face-to-face grounding. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL'03), pages 553--561, 2003.
[8]
J. Rickel and W. L. Johnson. Steve: An animated pedagogical agent for procedural trainning in virtual environments. SIGART Bulletin, 8:16--21, 1998.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Gaze-In '12: Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
October 2012
88 pages
ISBN:9781450315166
DOI:10.1145/2401836
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2012

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Funding Sources

Conference

ICMI '12
Sponsor:
ICMI '12: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
October 26, 2012
California, Santa Monica

Acceptance Rates

Overall Acceptance Rate 19 of 21 submissions, 90%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 93
    Total Downloads
  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media