Skip to main content

Automated Detection System for Portuguese Musical Instruments

  • Conference paper
  • First Online:
Progress in Artificial Intelligence (EPIA 2024)

Abstract

Preserving folk tradition is one of the most critical aspects of promoting the preservation of cultural heritage and is a symbol of pride and identification of societies. Numerous research projects have been developed in recent years focussing on preserving and disseminating cultural traditions. Many of them focused on the preservation of traditional music. This research uses artificial intelligence-based techniques to help preserve and categorise traditional Portuguese music. This work proposes a method for automating the tagging process in image or video content to enhance archival workflows, and improve access and exploration of traditional music archives. More specifically, the study focuses on generating a model for detecting traditional Portuguese musical instruments in images. This model is trained with a dataset of our own elabouration and using state-of-the-art detection algorithms. This task is not easy given the problems among the different traditional Portuguese instruments reflected in the article. Nevertheless, the results obtained in the research are outstanding in terms of the good performance obtained and establish a good starting point for the construction of future tools to help preserve Portuguese traditional music.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. 2021:Audio Key Detection - MIREX Wiki. https://www.music-ir.org/mirex/wiki/2021:Audio_Key_Detection

  2. A Música Portuguesa a Gostar dela Própria. https://amusicaportuguesaagostardelapropria.org/

  3. CVAT. https://www.cvat.ai/

  4. FCVID: Fudan-Columbia Video Dataset. https://fvl.fudan.edu.cn/dataset/fcvid/list.htm

  5. Instrument Recognition | Papers With Code. https://paperswithcode.com/task/instrument-recognition

  6. MusicXML 4.0. https://w3c.github.io/musicxml/

  7. What is MEI?. https://music-encoding.org/about/

  8. Abu-El-Haija, S., et al.: YouTube-8M: a large-scale video classification benchmark (2016). https://arxiv.org/abs/1609.08675v1

  9. Bhattarai, B., Lee, J.: A comprehensive review on music transcription. Appl. Sci. 13(21), 11882 (2023). https://doi.org/10.3390/app132111882, https://www.mdpi.com/2076-3417/13/21/11882

  10. Blaszke, M., Kostek, B.: musical instrument identification using deep learning approach. Sensors 22(8), 3033 (2022). https://doi.org/10.3390/S22083033, https://www.mdpi.com/1424-8220/22/8/3033/htm

  11. Gong, X., Zhu, Y., Zhu, H., Wei, H.: ChMusic: a traditional Chinese music dataset for evaluation of instrument recognition. https://github.com/HaoranWeiUTD/ChMusic

  12. von Hornbostel, E.M., Sachs, C.: Classification of musical instruments: translated from the original german by Anthony Baines and Klaus P. Wachsmann. Galpin Soc. J. 14, 3 (1961). https://doi.org/10.2307/842168

  13. Jiang, Y.G., Wu, Z., Wang, J., Xue, X., Chang, S.F.: Exploiting feature and class relationships in video categorization with regularized deep neural networks. IEEE Trans. Pattern Anal. Mach. Intell. 40(2), 352–364 (2018). https://doi.org/10.1109/TPAMI.2017.2670560

  14. Li, P., Qian, J., Wang, T.: Automatic instrument recognition in polyphonic music using convolutional neural networks (2015)

    Google Scholar 

  15. Lin, T.Y., et al.: Microsoft COCO: common objects in context. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8693 LNCS(PART 5), 740–755 (2014). https://doi.org/10.1007/978-3-319-10602-1_48/COVER, https://link.springer.com/chapter/10.1007/978-3-319-10602-1_48

  16. Murciego, A.L., Jiménez-Bravo, D.M., Mendes, A.S., Batista, V.F.L., Moreno-García, M.N.: Auto-tagging system based on song’s latent representations for inferring contextual user information. In: 2022 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), pp. 230–235. IEEE (2022). https://doi.org/10.1109/WI-IAT55865.2022.00040, https://ieeexplore.ieee.org/document/10102092/

  17. de Oliveira, E.V.: Instrumentos musicais populares portugueses. Fundação Calouste Gulbenkian (1966)

    Google Scholar 

  18. Slizovskaia, O., Gomez, E., Haro, G.: Musical instrument recognition in user-generated videos using a multimodal convolutional neural network architecture. ICMR 2017 - Proceedings of the 2017 ACM International Conference on Multimedia Retrieval, pp. 226–232 (2017). https://doi.org/10.1145/3078971.3079002, https://dl.acm.org/doi/10.1145/3078971.3079002

  19. Slizovskaia, O., Gómez Gutiérrez, E., Haro Ortega, G.: Automatic musical instrument recognition in audiovisual recordings by combining image and audio classification strategies (2016). http://repositori.upf.edu/handle/10230/32522

  20. Solanki, A., Pandey, S.: Music instrument recognition using deep convolutional neural networks. Int. J. Inf. Technol. (Singapore) 14(3), 1659–1668 (2022). https://doi.org/10.1007/S41870-019-00285-Y

  21. Tzanetakis, G., Cook, P.: Musical genre classification of audio signals. IEEE Trans. Speech Audio Process. 10(5), 293–302 (2002). https://doi.org/10.1109/TSA.2002.800560, https://ieeexplore.ieee.org/document/1021072/

  22. Wang, C.Y., Yeh, I.H., Liao, H.Y.M.: YOLOv9: learning what you want to learn using programmable gradient information (2024). https://arxiv.org/abs/2402.13616v2

Download references

Acknowledgments

We would like to express our gratitude for the assistance received by Tiago Pereira and Cristina Enes Garcia from MPAGDP in carrying out the case study of this research. Research partially funded by the project “EA-DIGIFOLK: AN EUROPEAN AND IBERO-AMERICAN APPROACH FOR THE DIGITAL COLLECTION, ANALYSIS AND DISSEMINATION OF FOLK MUSIC” (101086338) under the programme Marie Skłodowska-Curie Actions Staff Exchanges (HORIZON-MSCA-2021-SE-01-01). The Spanish Ministry of Universities has supported Héctor Sánchez San Blas’ research through an FPU pre-doctoral contract under grant FPU20/03014.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luís Augusto Silva .

Editor information

Editors and Affiliations

Ethics declarations

Disclosure of Interests

The authors have no competing interests to declare that are relevant to the content of this article.

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Silva, L.A., Sánchez San Blas, H., Sales Mendes, A., Lozano Murciego, Á., Jiménez-Bravo, D.M. (2025). Automated Detection System for Portuguese Musical Instruments. In: Santos, M.F., Machado, J., Novais, P., Cortez, P., Moreira, P.M. (eds) Progress in Artificial Intelligence. EPIA 2024. Lecture Notes in Computer Science(), vol 14967. Springer, Cham. https://doi.org/10.1007/978-3-031-73497-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-73497-7_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-73496-0

  • Online ISBN: 978-3-031-73497-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics