Abstract
Blind extraction or separation statistically independent source signals from linear mixtures have been well studied in the last two decades by searching for local extrema of certain objective functions, such as nonGaussianity (NG) measure. Blind source extraction (BSE) algorithm from underdetermined linear mixtures of the statistically dependent source signals is derived using nonparametric NG measure in this paper. After showing that maximization of the NG measure can also separate or extract the statistically weak dependent source signals, the nonparametric NG measure is defined by statistical distances between different source signals distributions based on the cumulative density function (CDF) instead of traditional probability density function (PDF), which can be estimated by the quantiles and order statistics using the \( L^{2} \) norm efficiently. The nonparametric NG measure can be optimized by a deflation procedure to extract or separate the dependent source signals. Simulation results for synthesis and real world data show that the proposed nonparametric extraction algorithm can extract the dependent signals and yield ideal performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Comon, P., Jutten, C.: Handbook of Blind Source Separation: Independent Component Analysis and Applications. Elsevier, Oxford (2010)
Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. Wiley, New York (2003)
Hyvarinen, A.: Independent component analysis: recent advances. Philos. Trans. R. Soc. A 371, 20110534 (2013)
Cardoso, J.: Blind signal separation: statistical principles. Proc. IEEE 86(10), 2009–2025 (1998)
Särelä, J., Valpola, H.: Denoising source separation. J. Mach. Learn. Res. 6, 233–272 (2005)
Leong, W., Mandic, D.: Noisy component extraction (NoiCE). IEEE Trans. Circuits Syst. I. 57(3), 664–671 (2010)
Deville, Y., Hosseini, S.: Recurrent networks for separating extractable-target nonlinear mixtures. Part I: Non-blind Configurations. Signal Process. 89(4), 378–393 (2009)
Bell, A.J., Sejnowski, T.J.: An information-maximisation approach to blind separation and blind deconvolution. Neural Comput. 7(6), 1129–1159 (1995)
Amari, S., Cichocki, A., Yang, H.: A new learning algorithm for blind signal separation. In: Advances in Neural Information Processing Systems, pp. 757−763. MIT Press, Cambridge (1996)
Bloemendal, B., Laar, J., Sommen, P.: A single stage approach to blind source extraction based on second order statistics. Signal Process. 93(2), 432–444 (2013)
Cardoso, J.F.: Multidimensional independent component analysis. In: ICASSP 1998, Seattle, WA, USA, pp. 1941–1944. IEEE (1998)
Lahat, D., Cardoso, J.F., Messer, H.: Second-order multidimensional ica: performance analysis. IEEE Trans. Signal Process. 60(9), 4598–4610 (2012)
Gutch, H.W., Theis, F.J.: Uniqueness of linear factorizations into independent subspaces. J. Multivar. Anal. 112, 48–62 (2012)
Kawanabe, M., Muller, K.R.: Estimating functions for blind separation when sources have variance dependencies. J. Mach. Learn. Res. 6, 453–482 (2005)
Hyvarinen, A., Hoyer, P.O., Inki, M.: Topographic independent component analysis. Neural Comput. 13(7), 1527–1558 (2001)
Bach, F.R., Jordan, M.I.: Kernel independent component analysis. J. Mach. Learn. Res. 3, 1–48 (2002)
Zhang, K., Chan, L.W.: An adaptive method for subband decomposition ICA. Neural Comput. 18(1), 191–223 (2006)
Wang, F.S., Li, H., Li, R.: Novel nongaussianity measure based bss algorithm for dependent signals. In: Dong, G., Lin, X., Wang, W., Yang, Y., Yu, J.X. (eds.) APWeb/WAIM 2007. LNCS, vol. 4505, pp. 837–844. Springer, Heidelberg (2007)
Caiafa, C.: On the conditions for valid objective functions in blind separation of independent and dependent sources. EURASIP J. Adv. Signal Process. 2012, 255 (2012)
Aghabozorgi, M.R., Doost-Hoseini, A.M.: Blind separation of jointly stationary correlated sources. Signal Process. 84(2), 317–325 (2004)
Abrard, F., Deville, Y.: A time-frequency blind signal separation method applicable to underdetermined mixtures of dependent sources. Signal Process. 85(7), 1389–1403 (2005)
Kopriva, I., Jeric, I., Brkljacic, L.: Nonlinear mixture-wise expansion approach to underdetermined blind separation of nonnegative dependent sources. J. Chemom. 27(1), 189–197 (2013)
Cruces, S.: Bounded component analysis of linear mixtures: a criterion for minimum convex perimeter. IEEE Trans. Signal Process. 58(4), 2141–2154 (2010)
Erdogan, A.T.: A class of bounded component analysis algorithms for the separation of both independent and dependent sources. IEEE Trans. Signal Process. 61(22), 5730–5743 (2013)
Li, Y., Amari, S.I., Cichocki, A.: Underdetermined blind source separation based on sparse representation. IEEE Trans. Signal Process. 54(2), 423–437 (2006)
Almeida, A., Luciani, X., Stegeman, A., Comon, P.: CONFAC decomposition approach to blind identification of underdetermined mixtures based on generating function derivatives. IEEE Trans. Signal Process. 60(11), 5698–5713 (2012)
Cardoso, J.F.: Dependence, correlation and gaussianity in independent component analysis. J. Mach. Learn. Res. 4, 1177–1203 (2003)
Cichocki, A., Thawonmas, R.: On-line algorithm for blind signal extraction of arbitrarily distributed, but temporally correlated sources using second order statistics. Neural Process. Lett. 12(1), 91–98 (2000)
Barros, A.K., Cichocki, A.: Extraction of specific signals with temporal structure. Neural Comput. 13(9), 1995–2003 (2001)
Anderson, M., Adali, T., Li, X.L.: Joint blind source separation with multivariate gaussian model: algorithms and performance analysis. IEEE Trans. Signal Process. 60(4), 1672–1683 (2012)
Zibulevsky, M., Zeevi, Y.Y.: Extraction of a source from multichannel data using sparse decomposition. Neurocomputing 49(1–4), 163–173 (2002)
Zhang, Z.L.: Morphologically constrained ICA for extracting weak temporally correlated signals. Neurocomputing 71, 1669–1679 (2008)
Caiafa, C.F., Proto, A.N.: Separation of statistically dependent sources using an l2 distance non-gaussianity measure. Signal Process. 86(11), 3404–3420 (2006)
Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Networks 10(3), 626–634 (1999)
Friedman, J.H.: Exploratory projection pursuit. J. Am. Stat. Assoc. 82(397), 249–266 (1987)
Blanco, Y., Zazo, S.: New gaussianity measures based on order statistics: application to ica. Neurocomputing. 51, 303–320 (2003)
Psychology Department of University of Stirling. http://pics.psych.stir.ac.uk/
Vincent, E., Araki, S., Theis, F.J., Nolte, G., Bofill, P., et al.: The signal separation evaluation campaign (2007-2010): achievements and remaining challenges. Sig. Process. 92, 1928–1936 (2012)
Cichocki, A., Amari, S., Siwek, K.: ICALAB toolboxes. http://www.bsp.brain.riken.jp/ICALAB
Acknowledgments
This research is financially supported by the National Natural Science Foundation of China (No. 61401401, 61172086, 61402421, U1204607), the China Postdoctoral Science Foundation (No. 2014M561998) and the young teachers special Research Foundation Project of Zhengzhou University (No. 1411318029).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, F., Li, R., Wang, Z., Gao, X. (2015). Blind Nonparametric Determined and Underdetermined Signal Extraction Algorithm for Dependent Source Mixtures. In: Huang, DS., Bevilacqua, V., Premaratne, P. (eds) Intelligent Computing Theories and Methodologies. ICIC 2015. Lecture Notes in Computer Science(), vol 9225. Springer, Cham. https://doi.org/10.1007/978-3-319-22180-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-22180-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22179-3
Online ISBN: 978-3-319-22180-9
eBook Packages: Computer ScienceComputer Science (R0)