Abstract
Monaural musical sound separation attempts to isolate one or more instrument sources from a mono-channel polyphonic mixture. The primary challenge is to accurately separate pitched musical sounds where their partials overlap with each other. In the general case, each source has one or more non-overlapping partials. However, there exists the case that no non-overlapping partial is available for at least one source, leading to a more complex problem. In order to address this problem, we propose a novel method named Modified Common Amplitude Modulation (Modified-CAM), which aims to separate monaural perfect harmonic musical sound (except the unison), especially for the perfect octave interval. The proposed system can accurately recover both the amplitudes and the phases of the perfect octave, which can be considered as the typical but the hardest condition. We evaluate the proposed system on the University of Iowa musical instrument sample database, and the experiment results show the system’s superiority.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Virtanen, T.: Sound source separation in monaural music signals. Ph.D. dissertation, TUT (2006)
Li, Y.: Monaural musical sound separation. M.S. dissertation, OSU (2008)
Viste, H., Evangelista, G.: A method for separation of overlapping partials based on similarity of temporal envelopes in multichannel mixtures. IEEE TASLP 14, 1051–1061 (2006)
Mellinger, D.K.: Event formation and separation in musical sound. Ph.D. dissertation, Stanford (1991)
Virtanen, T.: Monaural sound source separation by nonnegative matrix factorization with temporal continuity and sparseness criteria. IEEE TASLP 15, 1066–1074 (2007)
Abdallah, S.A., Plumbley, M.D.: Unsupervised analysis of polyphonic music by sparse coding. IEEE TNN 17, 1066–1074 (2007)
Casey, M.A., Westner, W.: Separation of mixed audio sources by independent subspace analasis. In: Proceedings of ICMC, pp. 154–161 (2000)
Klapuri, A.: Multiple fundamental frequency estimation based on harmonicity and spectral smoothness. IEEE TSAP 11, 804–816 (2003)
Virtanen, T., Klapuri, A.: Separation of harmonic sounds using multipitch analysis and iterative parameter estimation. In: IEEE WASPAA, pp. 83–86 (2001)
Every, M.R., Szymanski, J.E.: Separation of synchronous pitched notes by spectral filtering of harmonics. IEEE TASLP 14, 1845–1856 (2006)
Bay, M., Beauchamp, J.W.: Harmonic source separation using prestored spectra. In: Rosca, J., Erdogmus, D., Príncipe, J.C., Haykin, S. (eds.) ICA 2006. LNCS, vol. 3889, pp. 561–568. Springer, Heidelberg (2006). https://doi.org/10.1007/11679363_70
Bregman, A.S.: Auditory Scene Analysis. MIT Press, Cambridge (1990). 10
Li, Y., Woodruff, J.: Monaural musical sound separation based on pitch and common amplitude modulation. IEEE TASLP 17, 1361–1371 (2009)
Han, J., Pardo, B.: Reconstructing completely overlapped notes from musical mixtures. In: ICASSP, pp. 249–252 (2011)
Ercan, M.B.: Musical instrument source separation in unison and monaural mixtures. M.S. dissertation, Bilkent (2014)
Rasch, R.A.: Description of regular twelve-tone musical tunings. JASA 73, 1023–1035 (1983)
The University of IOWA Musical Instrument Sample Database. http://theremin.music.uiowa.edu/
Acknowledgment
This research was supported in part by the 973 Program (Project No. 2014CB347600), the NSFC (Grant No. 61672304 and 61672285), and the NSF of Jiangsu Province (Grant BK 20140058, BK20170033 and BK20170856).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Gong, Y., Shu, X., Tang, J. (2018). Recovering Overlapping Partials for Monaural Perfect Harmonic Musical Sound Separation Using Modified Common Amplitude Modulation. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10735. Springer, Cham. https://doi.org/10.1007/978-3-319-77380-3_87
Download citation
DOI: https://doi.org/10.1007/978-3-319-77380-3_87
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-77379-7
Online ISBN: 978-3-319-77380-3
eBook Packages: Computer ScienceComputer Science (R0)