Skip to main content
SpringerLink
Log in

DanVideo: an MPEG-7 authoring and retrieval system for dance videos

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A well-annotated dance media is an essential part of a nation’s identity, transcending cultural and language barriers. Many dance video archives suffer from problems concerning authoring and access, because of the complex spatio-temporal relationships that exist between the dancers in terms of movements of their body parts and the emotions expressed by them in a dance. This paper presents a system named DanVideo for semi-automatic authoring and access to dance archives. DanVideo provides methods of annotation and authoring and retrieval tools for choreographers, dancers, and students. We demonstrate how dance media can be semantically annotated and how this information can be used for the retrieval of the dance video semantics. In particular, DanVideo offers an MPEG-7 based semi-automatic authoring tool that takes dance video annotations generated by dance experts and produces MPEG-7 metadata. DanVideo also has a search engine that takes users’ queries and retrieves dance semantics from metadata arranged using tree-embedding technique and based on spatial, temporal and spatio-temporal features of dancers. The search engine also leverages a domain-specific ontology to process knowledge-based queries. We have assessed the dance-video queries and semantic annotations in terms of precision, recall, and fidelity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig.14
Fig. 15

Similar content being viewed by others

References

  1. Adali S, Candan KS, Chen SS, Erol K, Subramanian VS (1996) The advanced video information system: database structures and query processing. Multimedia Systems 4:172–186

    Article  Google Scholar 

  2. Bimas U, Simon W, Peter R (1992) NUNTIUS: a computer system for the interactive composition and analysis of music and dance. Leonardo 25(1):59–68

    Article  Google Scholar 

  3. Calaban (2002) Homepage: http://www.bham.ac.uk/calaban/frame.htm

  4. Calfert TW, Chapman J (1978) Notation of movement with computer assistance. Proceedings of ACM annual conference, 731–736

  5. Chitra D, Manthe A, Nack F, Rutledge L, Sikora T, Zettl H (2002) Media Semantics: Who needs it and why? Proceedings of ACM Multimedia, 580-583.

  6. Fatemi N, Khaled OA, Corey G (2003) An XQuery adaptation for MPEG-7 documents retrieval. Proceedings of XML Conference and Exposition, 1–9

  7. Forouzan G, Pegge V, Park YC (2004) A multimedia information repository for cross cultural dance studies. Multimed Tools Appl 24:89–103

    Article  Google Scholar 

  8. George P (1990) Computers and dance: a bibliography. Leonardo 23(1):87–90

    Article  Google Scholar 

  9. Gkoritsas AC, Angelides MC (2005) COSMOS-7: A video content modeling framework for MPEG-7. Proceedings of 11th International Multimedia Modelling Conference (MMM’05), 123–130

  10. Graves A, Lalmas M (2002) Video retrieval using an MPEG-7 based inference network. Proceedings of ACM conference SIGIR, 339–346

  11. Hachimura K (2006) Digital archiving of dancing. Review of the National Center for Digitization 8:51–66

    Google Scholar 

  12. Haoran YI, Rajan D, Liang-Tien C (2005) Automatic generation of MPEG-7 complaint XML document for motion trajectory description in sports video. Multimed Tools Appl 26(2):191–206

    Article  Google Scholar 

  13. Hatol J, Kumar V (2005) Semantic representation and interaction of dance objects. Proceedings of LORNET conference, Poster

  14. Hattori M, Takamori T (2002) The description of human movement in computer based on movement score. Proceedings of 41st SICE, 2370–2371

  15. Herbison–Evans D (1988) Dance, video, notation and computers. Leonardo 21(1):45–50

    Article  Google Scholar 

  16. Hutchinson A (1984) Dance Notation: Process of recording movement. ISBN : 0871271419, Editor : Dance Horizon, London, p 226

  17. IBM VideoAnnEx (2002) Homepage: http://www.alphaworks.ibm.com/tech/videoannex.

  18. Ilene F (2000) Documentation Technology for the 21st Century. Proceedings of World Dance Academic Conference, 137–142

  19. Kalajdziski S, Davcev D (2004) Augmented reality system interface for dance analysis and presentation based on MPEG-7. Proceedings of IASTED conference on Visualization, Imaging, and Image Processing, 725–730

  20. LED, LINTER (2006) An X-Windows Editor / Interpreter for Labanotation. http://wwwstaff.it.uts.edu.au/don/pubs/led.html

  21. MacBenesh (2004) Benesh notation editor for Apple Macintosh. http://members.rogers.com/dancewrite/macbenesh/macbenesh.htm

  22. Martinez JM (2003) MPEG-7 Overview. ISO/IEC JTC1/SC29/WG11-N4980

  23. NIST validation service (2003) MPEG-7 Validation site: http://smil.nist.gov/M7Validation.html

  24. Ryn J, Sohn J, Kin M (2002) MPEG-7 metadata authoring tool. Proceedings of ACM Multimedia, 267–270

  25. Samira H, Salima B, Mohand SH, Athena V (2004) Semantic Retrieval of Multimedia data. Proceedings of ACM MultiMedia DataBase,Washington, DC, USA, 36–44

  26. Tran-Thuong T, Roisin C (2003) Multimedia modeling using MPEG-7 for authoring multimedia integration. Proceedings of 5th ACM SIGMM international Workshop on Multimedia information Retrieval (Berkeley, California, November 07 - 07, 2003) MIR’03, 171–178

Download references

Acknowledgements

This research work is partially funded by International Information Science Foundation (IISF)-Tokyo, Japan as part of the visiting researcher support programme and conducted by the first author at National Institute of Informatics (NII)-Tokyo, Japan during June 2009.

Author information

Authors and Affiliations

  1. Department of Computer Science, Bishop Heber College, Tiruchirappalli, India

    Rajkumar Kannan

  2. National Institute of Informatics, Tokyo, Japan

    Frederic Andres

  3. Institute for Information Systems and Computer Media, TU-Graz, Graz, Austria

    Christian Guetl

Authors
  1. Rajkumar Kannan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Frederic Andres
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christian Guetl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rajkumar Kannan.

Additional information

Frederic Andres completed during his participation in the ENA project (www.ena.lu) at CVCE, Luxembourg.

Appendices

Appendix-A MPEG-7 instance of dance videos

figure dfigure dfigure dfigure dfigure d

Appendix-B Dance video queries

2.1 Containment queries

  1. CQ01:

    Show Anitha performing samathristy

  2. CQ02:

    Show the dance steps of left eye performed by Lisa

  3. CQ03:

    Show the dance steps of Anitha

  4. CQ04:

    Show all joyous dance steps of Anitha

  5. CQ05:

    Show all sorrowful dance steps of Anitha

  6. CQ06:

    Show all dance steps of a song, Kanna varuvaaya

  7. CQ07:

    Show all dance steps performed on a beach

  8. CQ08:

    Show all dance steps performed on a stage.

  9. CQ09:

    Show Anitha performing aalogithathristy

  10. CQ10:

    Show Anitha performing thattadavu

  11. CQ11:

    Show Anitha performing logitham

  12. CQ12:

    Show Anitha performing mathimam

  13. CQ13:

    Show Anitha performing dance steps denoting animals

  14. CQ14:

    Show Anitha performing dance steps denoting God

  15. CQ15:

    Show Anitha performing dance steps denoting birds

  16. CQ16:

    Show Anitha performing dance steps denoting flowers

  17. CQ17:

    Show Anitha performing dance steps denoting moon

  18. CQ18:

    Show Anitha performing dance steps denoting war

  19. CQ19:

    Show Anitha and Raghav performing dance steps

  20. CQ20:

    Show Anitha performing logitham and Raghav performing a step of a moon

  21. CQ21:

    Show Anitha performing logitham or Raghav performing a step of a moon

  22. CQ22:

    Show all romantic dance steps

  23. CQ23:

    Show all comic dance steps

  24. CQ24:

    Show all thrilling dance steps

  25. CQ25:

    Show all romantic dance steps of Anitha

2.2 Temporal queries

  1. TQ01:

    Show Anitha performing samathristy during Raghav performing mathimam

  2. TQ02:

    Show all dance steps while Anitha approaches Raghav

  3. TQ03:

    Show all dance steps before Anitha performing aalogithathristy

  4. TQ04:

    Show all dance steps after Anitha performing aalogithathristy

  5. TQ05:

    Show all dance steps after a step denoting a sword

  6. TQ06:

    Show Anitha following dance steps of Raghav

  7. TQ07:

    Show Anitha repeating dance steps of Raghav

  8. TQ08:

    Show all dance steps where right hand meets left hand of Anitha

  9. TQ09:

    Show Anitha rotating eyes during Raghav lifting up shoulders

2.3 Spatial queries

  1. SQ01:

    Show all dance steps where Anitha is to the left of Raghav

  2. SQ02:

    Show all dance steps where Anitha is standing to the left of Raghav

  3. SQ03:

    Show all dance steps where Anitha is to the right of Raghav

  4. SQ04:

    Show all dance steps where Anitha is standing to the right of Raghav

  5. SQ05:

    Show all dance steps where Anitha is to the right of Raghav and Raghav is in front of Peter

  6. SQ06:

    Show all dance steps where Anitha is to the left backward of Raghav

2.4 Spatiotemporal queries

  1. STQ1:

    Show all steps where Anitha approaches Raghav while Peter is to the left of Anitha

  2. STQ2:

    Show all steps where Anitha meets Raghav while Peter is to the left of Anitha, rotating his hip.

  3. STQ3:

    Show all steps where Anitha diverges from Raghav or Peter is to the left of Anitha

  4. STQ4:

    Show all steps where Anitha and Raghav performing samathristy before Peter is to the left of Anitha

2.5 Extended dance video queries

  1. EQ01:

    Show me all solo dance pieces

  2. EQ02:

    Show me all duet dance pieces

  3. EQ03:

    Show me all group dance pieces

  4. EQ04:

    Show me all furious dance pieces

  5. EQ05:

    Show all dance pieces where Anitha is praying

  6. EQ06:

    Show me dance pieces representing a king

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kannan, R., Andres, F. & Guetl, C. DanVideo: an MPEG-7 authoring and retrieval system for dance videos. Multimed Tools Appl 46, 545–572 (2010). https://doi.org/10.1007/s11042-009-0388-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0388-3

Keywords

Search

Navigation