Skip to main content

DanceTutor: An ITS for Coaching Novice Ballet Dancers Using Pose Recognition of Whole-Body Movements

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12749))

Included in the following conference series:

Abstract

This paper presents the design, development and evaluation of a prototype intelligent dance tutoring system, DanceTutor, for coaching students in low-resource settings. The system evaluates seventeen core body points on a dancer using video footage captured from a mobile phone or web camera using a combination of simple algorithms and 2D pose estimation software. Detailed feedback is provided on the quality and correctness of the dancer’s pose for the first five static dance positions in Ballet, and then for intermediate to advanced exercises with permutations of the five basic Ballet positions. Evaluation of the prototype revealed the highly subjective nature and cultural biases of evaluating the quality of a dancer’s technique. Three experienced dance teachers, trained in different countries, evaluated 165 video recordings of 11 candidate dancers. The system was only able to achieve 47% consensus overall with the feedback and grading results produced by the dance teachers, who each evaluated tension and height differently. There was however a 60% agreement between DanceTutor and one teacher who used the most granular evaluation strategy matching DanceTutor’s baseline and assessment features.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Daniaa, A., Hatziharistosa, D., Koutsoubaa, D., Tyrovolaa, V.: The Use of Technology in Movement and Dance Education: Recent Practices and Future Perspectives, pp. 3–4. Athens, Greece: Elsevier Ltd (2011). https://doi.org/10.1016/j.sbspro.2011.04.299

  2. Trajkova, M., Francesco, C.: Takes tutu to ballet: designing visual and verbal feedback for augmented mirrors. Proc. ACM Interact. Mobile, Wearable Ubiquit. Technol. 2(1), 1–30 (2018). https://doi.org/10.1145/3191770

    Article  Google Scholar 

  3. Cheng, D., Hartmann, B., Chi, P., Wright, P., Kwak, T.: Body-Tracking Camera Control for Demonstration Videos, Paris, France: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, pp. 1–6 (2013). https://doi.org/10.1145/2468356.2468568

  4. Huang, H., Uejo, M., Seki, Y., Lee J., Kawagoe, K.: Realizing real-time feedback on learners’ practice for a virtual ballroom dance instructor, pp. 5–6. Workshop on Real-time Conversations with Virtual Agents (RCVA), IVA 2012, Santa Cruz, USA (2012)

    Google Scholar 

  5. Marquardt, Z., Beira, J., Paiva, I., Em, N., Kox, S.: Super Mirror: a kinect interface for ballet dancers, pp. 1–6. CHI EA 2012 (2012). https://doi.org/10.1145/2212776.2223682

  6. Anderson, F., Grossman, T., Matejka, J., Fitzmaurice, G.: YouMove: enhancing movement training with an augmented reality mirror, pp. 311–319. In: Proceedings of the 26th ACM Symposium on User Interface Software and Technology (2013). https://doi.org/10.1145/2501988.2502045

  7. Shotton, J., Fitzgibbon, A.: Real-time human pose recognition in parts from single depth images, pp. 1–8. In Proceedings of the 24th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, USA, pp. 20–25 (2011). https://doi.org/10.1109/CVPR.2011.5995316

  8. Zhe Cao, G., Hidalgo, S., Wei, S., Sheikh, Y.: OpenPose: realtime multi-person 2D Pose Estimation using part affinity fields, pp. 1–14. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019). https://doi.org/10.1109/TPAMI.2019.2929257

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Maharaj-Pariagsingh, L., Mohammed, P.S. (2021). DanceTutor: An ITS for Coaching Novice Ballet Dancers Using Pose Recognition of Whole-Body Movements. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2021. Lecture Notes in Computer Science(), vol 12749. Springer, Cham. https://doi.org/10.1007/978-3-030-78270-2_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78270-2_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78269-6

  • Online ISBN: 978-3-030-78270-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics