Abstract
Bharatanatyam is the most popular form of Indian Classical Dance. Its Adavus are basic choreographic units of a dance sequence. An Adavu is accompanied by percussion and vocal music and follows a specific rhythmic pattern (Sollukattu). In this paper, we first characterize the audio, video, and sync events of Adavus to succinctly represent the Adavus. Then, we present simple yet effective algorithms to detect audio and video events and measure their synchronization. The audio, video, and sync event detection achieve 94%, 84%, and 72% accuracy, respectively. A comparison of our audio event detection against a well-known method by Ellis shows significant improvement. We also create an annotated repository of Sollukattus and Adavus for research. There are several applications of the characterization and beat detection including music/music video segmentation, synchronization of the postures with the beats, automatic tagging of rhythm metadata, etc. Characterization of events or repository of Bharatanatyam Adavus has not been attempted before.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Depending on the school of Bharatanatyam, the exact set of Adavus and Sollukattus may vary.
- 2.
Data Repository: http://hci.cse.iitkgp.ac.in/.
- 3.
The meter of music is its rhythmic structure.
- 4.
Taal is the Indian system for organizing and playing metrical music.
- 5.
A bar (or measure) is a segment of time corresponding to a specific \(\lambda \) number of beats. Sollukattus also use longer bars (12, 16, 24, or 32).
- 6.
Every Adavu is performed with a specific Sollukattu. In this paper, we use 50 Adavus each performed with one of 23 Sollukattus.
- 7.
A Key Posture is defined in terms of Position of the legs (Sthanakam) and Posture of standing (Mandalam). Some are laterally symmetric ((c)–(h) in Fig. 2), while rest have left- and right-sided variants ((a)–(b)).
- 8.
In Bharatanatyam, these could be various forms of Nritta (rhythmical and repetitive elements) like Chari, Karana, Angahara, or Mandala.
- 9.
Short-Time Fourier Transform.
- 10.
The first beat of the Sollukattu.
- 11.
Natanam Kalakshetra, Kolkata, India.
- 12.
This data set is available at http://hci.cse.iitkgp.ac.in/.
- 13.
We consider only \(\alpha ^{f}\ |\ \alpha ^{h}\).
- 14.
Actually, slow or low motion in the video as cutoff by a threshold.
- 15.
Part of this data set is available at http://hci.cse.iitkgp.ac.in/.
References
Cadavid Concepts: nuiCapture Analyze. http://nuicapture.com/ (2014). Accessed 15 Oct 2016
Davies, M.E.P., Plumbley, M.D.: Context-dependent beat tracking of musical audio. IEEE Trans. Audio Speech Lang. Process. 15(3), 1009–1020 (2007)
Dixon, S.: Evaluation of the audio beat tracking system BeatRoot. J. New Music Res. 36(1), 39–50 (2007)
Ellis, D.P.W.: Beat tracking by dynamic programming. J. New Music Res. 36(1), 51–60 (2007)
Faircloth, R.M.: Combining Audio and Video Tempo Analysis for Dance Detection. Ph.D. thesis, University of Central Florida Orlando, Florida (2008)
Gulati, S., Rao, V., Rao, P.: Meter detection from audio for Indian music. In: Speech, Sound and Music Processing: Embracing Research in India, pp. 34–43. Springer (2012)
Klapuri, A., et al.: Musical meter estimation and music transcription. In: Cambridge Music Processing Colloquium, pp. 40–45. Citeseer (2003)
Klapuri, A.P., Eronen, A.J., Astola, J.T.: Analysis of the meter of acoustic musical signals. IEEE Trans. Audio Speech Lang. Process. 14(1), 342–355 (2006)
Panagiotakis, C., Holzapfel, A., Michel, D., Argyros, A.A.: Beat synchronous dance animation based on visual analysis of human motion and audio analysis of music tempo. In: International Symposium on Visual Computing, pp. 118–127. Springer (2013)
Shiratori, T., Nakazawa, A., Ikeuchi, K.: Detecting dance motion structure through music analysis. In: Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings, pp. 857–862. IEEE (2004)
Shiratori, T., Nakazawa, A., Ikeuchi, K.: Detecting dance motion structure using motion capture and musical information. In: Proceedings of the International Conference on Virtual Systems and Multimedia (VSMM), vol. 3 (2004)
Sridhar, R., Geetha, T.V.: Raga identification of Carnatic music for music information retrieval. Int. J. Recent Trends Eng. 1(1) (2009)
Srinivasamurthy, A., Subramanian, S., Tronel, G., Chordia, P.: A beat tracking approach to complete description of rhythm in Indian classical music. In: Proceedings of the 2nd CompMusic Workshop, pp. 72–78. Citeseer (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Mallick, T., Das, P.P., Majumdar, A.K. (2018). Characterization, Detection, and Synchronization of Audio-Video Events in Bharatanatyam Adavus. In: Chanda, B., Chaudhuri, S., Chaudhury, S. (eds) Heritage Preservation. Springer, Singapore. https://doi.org/10.1007/978-981-10-7221-5_12
Download citation
DOI: https://doi.org/10.1007/978-981-10-7221-5_12
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-7220-8
Online ISBN: 978-981-10-7221-5
eBook Packages: Computer ScienceComputer Science (R0)