Skip to main content
SpringerLink
Log in

A bi-stage approach to North Indian raga distinction

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Music embraces an intricate assembly of auditory elements, carefully organized in diverse configurations to articulate a variety of human emotions, moods, thoughts, feelings, temporal contexts, and situations. One of the primary aspects of any music composition is the raga which governs its melodic framework. Thus, the delineation of ragas assumes an enormous significance as a preliminary step preceding a more deeper and intricate analysis. Each of these ragas is meant to be practiced during a particular time of the day to amplify the emotional content and physical involvement. In this current work, a machine learning-based approach has been proposed to classify the dawn and dusk time (Sandhi Prakash) ragas. Here, mel-frequency cepstral coefficients (MFCC) based feature extraction technique has been applied which was further processed to generate second-level statistical features. This brought down the original feature dimension by means of effective representation of the raw features. Several classification techniques were employed and a new bi-stage raga distinction technique has been proposed. The first stage classifies ragas as dawn/ dusk while the second stage performs deeper classification for these groups separately to identify the exact raga. Experiments were performed with over 57K clips from 11 ragas belonging to the 2 time periods and a performance improvement of \(0.7\%\) was obtained for the dusk ragas using the bi-stage approach over the single shot classification technique. The highest possible accuracy of \(96.47\%\) was obtained for distinguishing the dusk ragas with only 2-second clips in the experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data Availability Statement

The data is available for research purposes on request.

References

  1. Stober S, Nürnberger A (2013) Adaptive music retrieval-a state of the art. Multimed Tools Appl 65(3):467–494

    Article  Google Scholar 

  2. Cheng Z, Shen J, Zhu L, Kankanhalli MS, Nie L (2017) Exploiting music play sequence for music recommendation. IJCAI 17:3654–3660

    Google Scholar 

  3. Shen J, Shepherd J, Cui B, Tan KL (2009) A novel framework for efficient automated singer identification in large music databases. ACM Trans Inf Syst (TOIS) 27(3):1–31

    Article  Google Scholar 

  4. Sm YV, Koolagudi SG (2018) Content-based music information retrieval (CB-MIR) and its applications toward the music industry: a review. ACM Comput Surv 51(3):45

    Google Scholar 

  5. Fu Z, Lu G, Ting KM, Zhang D (2010) A survey of audio-based music classification and annotation. IEEE Trans Multimedia 13(2):303–319

    Article  Google Scholar 

  6. Mor B, Garhwal S, Kumar A (2021) MIMVOGUE: modeling Indian music using a variable order gapped HMM. Multimed Tools Appl 80(10):14853–14866

    Article  Google Scholar 

  7. Raga S (2021) ITC Sangeet Research Academy. https://itcsra.org/SamayRaga.aspx Accessed 25 Nov 2021

  8. Dasgupta P (1988) Rager Kriyatmak Rupayan (Bengali). D. M, Library, Kolkata

    Google Scholar 

  9. Bhatkhande VN (1956) Hindustani Sangeet Paddhati, Kramik Pustak Malika (Hindi translation), Vol 1-5, Sangeet Karyalay, Hathras

  10. Katte T (2013) Multiple techniques for raga identification in Indian classical music. Int J Electr Comput Eng 4(6):82–7

    Google Scholar 

  11. Katte T, Tiple BS (2014) Techniques for Indian classical raga identification-a survey. In: 2014 Annual IEEE India Conference (INDICON) pp 1–6. IEEE

  12. Kirthika P, Chattamvelli R (2012) A review of raga based music classification and music information retrieval (MIR). In: 2012 IEEE International conference on engineering education: innovative practices and future trends (AICERA), pp 1–5

  13. Joshi D, Pareek J, Ambatkar P (2021) Indian classical raga identification using machine learning

  14. Bidkar AA, Deshpande RS, Dandawate YH (2021) A north Indian raga recognition using ensemble classifier. Int J Electr Eng Technol (IJEET) 12(6):251–258

    Google Scholar 

  15. Peri D (2020) Applying natural language processing and deep learning techniques for raga recognition in Indian classical music (Doctoral dissertation, Virginia Tech)

  16. Farishta A, Rathod PP, Barbole S, Belkhede P (2020) Artificial neural network to identify Indian classical music raga’s

  17. Kumar MS, Devi MS (2020) Raga recognition using machine learning. J S Technol Dev 9(9)

  18. Padmasundari G, Murthy HA (2017) Raga identification using locality sensitive hashing. In: 2017 twenty-third national conference on communications, pp 1–6. IEEE

  19. Roy S, Banerjee A, Sanyal S, Ghosh D, Sengupta R (2021) A study on Raga characterization in Indian classical music in the light of MB and BE distribution. In: Journal of physics: conference series, IOP Publishing. Vol. 1896, Issue 1, pp 012007

  20. Acharya S, Devalla V, Amitesh O (2021) Analytical comparison of classification models for raga identification in carnatic classical audio. In: Advances in speech and music technology, Springer, Singapore pp 211–222

  21. Ranjani HG, Paramashivan D, Sreenivas TV (2019) Discovering structural similarities among rāgas in Indian Art Music: a computational approach. Sādhanā 44(5):1–20

    Article  Google Scholar 

  22. Dandawate YH, Kumari P, Bidkar A (2015) Indian instrumental music: raga analysis and classification. In: 2015 1st international conference on next generation computing technologies, IEEE, pp 725–729

  23. Dutta S, PV KS, Murthy HA (2015) Raga verification in carnatic music using longest common segment set. ISMIR 1:605–611

  24. Rao P, Ross JC, Ganguli KK, Pandit V, Ishwar V, Bellur A, Murthy HA (2014) Classification of melodic motifs in raga music with time-series matching. J New Music Res 43(1):115–131

    Article  Google Scholar 

  25. Dighe P, Karnick H, Raj B (2013) Swara histogram based structural analysis and identification of Indian classical ragas. In: ISMIR, pp 35–40

  26. Sridhar R, Geetha TV (2009) Raga identification of carnatic music for music information retrieval. Int J Recent Trends Eng 1(1):571

    Google Scholar 

  27. Lele JA, Abhyankar AS (2019) Towards raga identification of hindustani classical music. In: 2019 IEEE pune section international conference (PuneCon), IEEE, pp 1–4

  28. Anand A (2019) Raga identification using convolutional neural network. In: 2019 second international conference on advanced computational and communication paradigms (ICACCP), IEEE, pp 1–6

  29. Gulati S, Serra J, Ishwar V, Sentürk S, Serra X (2016) Phrase-based rāga recognition using vector space modeling. In: 2016 IEEE international conference on acoustics, speech and signal processing (ICASSP), IEEE, pp 66–70

  30. Bidkar AA, DeshPande RS, Dandawate YH (2018) A novel approach for selection of features for north Indian classical raga recognition of instrumental music. In: 2018 international conference on advances in communication and computing technology (ICACCT), IEEE, pp 499–503

  31. Gulati S, Serra J, Ganguli KK, Senturk S, Serra X (2016) Time-delayed melody surfaces for raga recognition. Proc. of the 17th Int. Society for Music Information Retrieval Conference (ISMIR), New York, USA, pp 751–757

  32. Sharma AK, Lakhtaria KI, Panwar A, Vishwakarma S (2014) An analytical approach based on self organized maps (SOM) in Indian classical music raga clustering. In: 2014 Seventh international conference on contemporary computing (IC3), IEEE, pp 449–453

  33. Belle S, Joshi R, Rao P (2009) Raga identification by using swara intonation. J. ITC Sangeet Research Academy 23(3)

  34. Basu D, Mukherjee H, Sen S, Roy K (2021) Identification of dawn or dusk raga, Springer 2nd international conference on advanced computing and applications, pp 581–589

  35. Sharma A, Salgaonkar A (2023) Raga recognition using neural networks and n-grams of melodies. In: Computer assisted music and dramatics: possibilities and challenges, Singapore, Springer Nature Singapore pp 93–109

  36. Paschalidou S, Miliaresi I (2023) Multimodal deep learning architecture for hindustani raga classification. Sens Transducers 260(2):77–86

    Google Scholar 

  37. Singha A, Rajalakshmi NR, Pandian JA, Saravanan S (2023) Deep learning-based classification of indian classical music based on raga. In: 2023 6th international conference on information systems and computer networks (ISCON), IEEE, pp 1–7

  38. Chhetri AR, Kumar K, Muthyala MP, Shreyas MR, Bangalore RA (2023) Carnatic music identification of melakarta ragas through machine and deep learning using audio signal processing. In: 2023 4th international conference for emerging technology (INCET), IEEE, pp 1–5

  39. Bora K, Barman MP, Patowary AN (2023) Clustering the raagas of sankari sangeet-a computational approach. Empir Stud Arts 41(2):623–637

    Article  Google Scholar 

  40. Joshi D, Pareek J, Ambatkar P (2023) Comparative study of Mfcc and Mel spectrogram for raga classification using CNN. Indian J Sci Technol 16(11):816–822

    Article  Google Scholar 

  41. Alim SA, Rashid NKA (2018) Some commonly used speech feature extraction algorithms. Nat Artif Intell Algorithm Appl

  42. Müller M (2015) Fundamentals of music processing: audio, analysis, algorithms, applications. Springer

    Book  Google Scholar 

  43. Davis S, Mermelstein P (1980) Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. IEEE Transn acoustics, speech, and signal processing 28(4):357–366

    Article  Google Scholar 

  44. Mel Frequency Cepstral Coefficient (MFCC) tutorial (2021) Practical cryptography; http://practicalcryptography.com/miscellaneous/machine-learning/guide-mel-frequency-cepstral-coefficients-mfccs/. Accessed on 25 Nov 2021

  45. Abirami S, Chitra P (2020) Energy-efficient edge based real-time healthcare support system. In: Advances in computers, Elsevier, Vol 117, Issue 1, pp 339–368

  46. Dutt S, Chandramouli S, Das A (2019) Machine Learning, pp 199–200. Pearson

  47. Sharifahmadian A (2015) Numerical models for submerged breakwaters: coastal hydrodynamics and morphodynamics. Butterworth-Heinemann

  48. Faris H, Aljarah I, Mirjalili S (2017) Evolving radial basis function networks using moth-flame optimizer. In: Handbook of neural computation, Academic Press, pp 537–550

  49. Malek S, Hui C, Aziida N, Cheen S, Toh S, Milow P (2019) Ecosystem monitoring through predictive modeling

  50. Platt J (1998) Sequential minimal optimization: a fast algorithm for training support vector machines

  51. Liu S, McGree J, Ge Z, Xie Y (2016) Computational and statistical methods for analysing big data with applications. Academic Press, pp 7–28. ch-2

  52. (2021) Naive Bayes, scikit learn. https://scikit-learn.org/stable/modules/naive_bayes.html, Accessed on 25 Nov 2021

  53. Misra S, Li H, He J (2020) Noninvasive fracture characterization based on the classification of sonic wave travel times. In: Machine learning for subsurface characterization, Gulf professional publishing, pp 243–287

  54. (2021) Logistic regression, Machine Learning Mastery. https://machinelearningmastery.com/logistic-regression-for-machine-learning/ Accessed on 25 Nov 2021

Download references

Author information

Authors and Affiliations

  1. Department of Information Technology, Future Institute of Engineering and Management, Kolkata, India

    Debjyoti Basu

  2. TISA Lab, Department of Computer Science, West Bengal State University, Kolkata, India

    Himadri Mukherjee & Kaushik Roy

  3. Department of Arts and Humanities, Music Program, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates

    Matteo Marciano

  4. Department of Computer Science and Engineering (AI-ML), Techno Main Salt Lake, Kolkata, India

    Shibaprasad Sen

  5. Department of Electronics and Communication Engineering, Jaypee Institute of Information Technology, Noida (UP), India

    Sajai Vir Singh

  6. Department of Computer Science and Engineering, Aliah University, Kolkata, India

    Sk Md Obaidullah

Authors
  1. Debjyoti Basu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Himadri Mukherjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matteo Marciano
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shibaprasad Sen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sajai Vir Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sk Md Obaidullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kaushik Roy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kaushik Roy.

Ethics declarations

Conflict of Interest

The authors declare that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Basu, D., Mukherjee, H., Marciano, M. et al. A bi-stage approach to North Indian raga distinction. Multimed Tools Appl 83, 45163–45183 (2024). https://doi.org/10.1007/s11042-023-17322-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-17322-5

Keywords

Search

Navigation