ABSTRACT
Sound designers and musicians often need to retrieve sound materials based on their similarity to aesthetic hearing experiences from sound databases such as Freesound. This study proposes an aesthetic experience-oriented evaluation framework for a field-recording sound retrieval system, using the sound clips extracted from Freesound. Furthermore, we discuss the features of the framework by analyzing the performance of the similarity search system for field-recording sound material using acoustic feature signatures that are based on the multiscale fractal dimension.
- V. Akkermans, F. Font, J. Funollet, B. de Jong, G. Roma, S. Togias, and X. Serra, “FREESOUND 2.0: An Improved Platformfor Sharing Audio Clips,” 12th Int. Soc. Music Inf. Retr. Conf., (2011).Google Scholar
- Music Technology Group of Universitat Pompeu Fabra, “The Freesound Project.,” https://www.freesound.org/Google Scholar
- Distributed Creation Inc., "Splice - Royalty-Free Sounds & Rent-to-Own Plugins," Retrieved Feb 4, 2021 from https://splice.com/Google Scholar
- S. Chachada and C. C. J. Kuo, “Environmental sound recognition: A survey,” APSIPA Trans. Signal Inf. Process., vol. 3, (2014).Google ScholarCross Ref
- D. Stowell, D. Giannoulis, E. Benetos, M. Lagrange, and M. D. Plumbley, “Detection and Classification of Acoustic Scenes and Events,” IEEE Trans. Multimed., vol. 17, no. 10, pp. 1733–1746, (2015).Google ScholarDigital Library
- S. Chu, S. Narayanan, and C.-C. Kuo, “Environmental Sound Recognition With Time-Frequency Audio Features,” IEEE Trans. Audio. Speech. Lang. Processing, vol. 17, no. 6, pp. 1142–1158, (2009).Google ScholarDigital Library
- M. Solomos, “A Phenomenological Experience of Sound: Notes on Francisco López,” Contemp. Music Rev., vol. 38, no. 1–2, pp. 94–106, 2019.Google ScholarCross Ref
- M. Sunouchi, and Y. Tanaka, “Similarity Search of Freesound Environmental Sound Based on Their Enhanced Multiscale Fractal Dimension,” Sound Music Comput. Conf. 2013, SMC 2013, pp. 715–721, (2013).Google Scholar
- M. Sunouchi, and M. Yoshioka. "Diversity-Robust Acoustic Feature Signatures Based on Multiscale Fractal Dimension for Similarity Search of Environmental Sounds." arXiv preprint arXiv:2102.02964 (2021).Google Scholar
- "Sound Dataset extracted from Freesound," Online available. https://labs.43d.jp/fs3000_dataset/fs3000_dataset.tar.bz2 (17GB)Google Scholar
- M. Porter, “An algorithm for suffix stripping,” Progr. Electron. Libr. Inf. Syst., vol. 14, no. 3, pp. 130–137, (1980).Google ScholarCross Ref
- P. Maragos and A. Potamianos, “Fractal dimensions of speech sounds: computation and application to automatic speech recognition.” J. Acoust. Soc. Am., vol. 105, no. 3, pp. 1925–1932, (1999).Google ScholarCross Ref
- A. Zlatintsi and P. Maragos, “Multiscale Fractal Analysis of Musical Instrument Signals With Application to Recognition,” IEEE Trans. Audio. Speech. Lang. Processing, vol. 21, no. 4, pp. 737–748, (2013).Google ScholarDigital Library
- SPTK working group, “Speech Signal Processing Toolkit (SPTK),” http://sp-tk.sourceforge.net/, (Retrieved 2021-2-4).Google Scholar
- Y. Wang, L. Wang, Y. Li, D. He, T.-Y. Liu, and W. Chen, “A Theoretical Analysis of NDCG Type Ranking Measures,” Proc. 26th Annu. Conf. Learn. Theory, pp. 1–30, 2013.Google Scholar
Index Terms
- Proposal of the Aesthetic Experience-Oriented Evaluation Framework for Field-recording Sound Retrieval System: Experiments using Acoustic Feature Signatures Based on Multiscale Fractal Dimension
Recommendations
Concept framework for audio information retrieval: ARF
AbstractThe majority of researches on content-based retrieval focused on visual media. However audio is also an important medium and information carrier from the viewpoint of human auditory perception, so it is needed to retrieve for audio collection. ...
The impact of sound control room acoustics on the perceived acoustics of a diffuse field recording
Live recordings of music and speech in concert halls have acoustical properties, such as reverberation, definition, clarity and spaciousness. Sound engineers play back these recordings through loudspeakers in sound control rooms for audio CD or film. ...
Intelligent sound field tuning system for home theater systems
In this paper, we propose an intelligent sound field tuning system for home theater systems that includes room acoustic compensation and additive artificial sound field processing. Room acoustic compensation is performed based on the information about ...
Comments