Skip to main content

Blind Nonparametric Determined and Underdetermined Signal Extraction Algorithm for Dependent Source Mixtures

  • Conference paper
  • First Online:
Intelligent Computing Theories and Methodologies (ICIC 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9225))

Included in the following conference series:

  • 1756 Accesses

Abstract

Blind extraction or separation statistically independent source signals from linear mixtures have been well studied in the last two decades by searching for local extrema of certain objective functions, such as nonGaussianity (NG) measure. Blind source extraction (BSE) algorithm from underdetermined linear mixtures of the statistically dependent source signals is derived using nonparametric NG measure in this paper. After showing that maximization of the NG measure can also separate or extract the statistically weak dependent source signals, the nonparametric NG measure is defined by statistical distances between different source signals distributions based on the cumulative density function (CDF) instead of traditional probability density function (PDF), which can be estimated by the quantiles and order statistics using the \( L^{2} \) norm efficiently. The nonparametric NG measure can be optimized by a deflation procedure to extract or separate the dependent source signals. Simulation results for synthesis and real world data show that the proposed nonparametric extraction algorithm can extract the dependent signals and yield ideal performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Comon, P., Jutten, C.: Handbook of Blind Source Separation: Independent Component Analysis and Applications. Elsevier, Oxford (2010)

    Google Scholar 

  2. Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. Wiley, New York (2003)

    Google Scholar 

  3. Hyvarinen, A.: Independent component analysis: recent advances. Philos. Trans. R. Soc. A 371, 20110534 (2013)

    Article  MathSciNet  Google Scholar 

  4. Cardoso, J.: Blind signal separation: statistical principles. Proc. IEEE 86(10), 2009–2025 (1998)

    Article  Google Scholar 

  5. Särelä, J., Valpola, H.: Denoising source separation. J. Mach. Learn. Res. 6, 233–272 (2005)

    MathSciNet  Google Scholar 

  6. Leong, W., Mandic, D.: Noisy component extraction (NoiCE). IEEE Trans. Circuits Syst. I. 57(3), 664–671 (2010)

    Article  MathSciNet  Google Scholar 

  7. Deville, Y., Hosseini, S.: Recurrent networks for separating extractable-target nonlinear mixtures. Part I: Non-blind Configurations. Signal Process. 89(4), 378–393 (2009)

    Google Scholar 

  8. Bell, A.J., Sejnowski, T.J.: An information-maximisation approach to blind separation and blind deconvolution. Neural Comput. 7(6), 1129–1159 (1995)

    Article  Google Scholar 

  9. Amari, S., Cichocki, A., Yang, H.: A new learning algorithm for blind signal separation. In: Advances in Neural Information Processing Systems, pp. 757−763. MIT Press, Cambridge (1996)

    Google Scholar 

  10. Bloemendal, B., Laar, J., Sommen, P.: A single stage approach to blind source extraction based on second order statistics. Signal Process. 93(2), 432–444 (2013)

    Article  Google Scholar 

  11. Cardoso, J.F.: Multidimensional independent component analysis. In: ICASSP 1998, Seattle, WA, USA, pp. 1941–1944. IEEE (1998)

    Google Scholar 

  12. Lahat, D., Cardoso, J.F., Messer, H.: Second-order multidimensional ica: performance analysis. IEEE Trans. Signal Process. 60(9), 4598–4610 (2012)

    Article  MathSciNet  Google Scholar 

  13. Gutch, H.W., Theis, F.J.: Uniqueness of linear factorizations into independent subspaces. J. Multivar. Anal. 112, 48–62 (2012)

    Article  MathSciNet  Google Scholar 

  14. Kawanabe, M., Muller, K.R.: Estimating functions for blind separation when sources have variance dependencies. J. Mach. Learn. Res. 6, 453–482 (2005)

    MathSciNet  Google Scholar 

  15. Hyvarinen, A., Hoyer, P.O., Inki, M.: Topographic independent component analysis. Neural Comput. 13(7), 1527–1558 (2001)

    Article  Google Scholar 

  16. Bach, F.R., Jordan, M.I.: Kernel independent component analysis. J. Mach. Learn. Res. 3, 1–48 (2002)

    MathSciNet  Google Scholar 

  17. Zhang, K., Chan, L.W.: An adaptive method for subband decomposition ICA. Neural Comput. 18(1), 191–223 (2006)

    Article  MathSciNet  Google Scholar 

  18. Wang, F.S., Li, H., Li, R.: Novel nongaussianity measure based bss algorithm for dependent signals. In: Dong, G., Lin, X., Wang, W., Yang, Y., Yu, J.X. (eds.) APWeb/WAIM 2007. LNCS, vol. 4505, pp. 837–844. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  19. Caiafa, C.: On the conditions for valid objective functions in blind separation of independent and dependent sources. EURASIP J. Adv. Signal Process. 2012, 255 (2012)

    Article  Google Scholar 

  20. Aghabozorgi, M.R., Doost-Hoseini, A.M.: Blind separation of jointly stationary correlated sources. Signal Process. 84(2), 317–325 (2004)

    Article  Google Scholar 

  21. Abrard, F., Deville, Y.: A time-frequency blind signal separation method applicable to underdetermined mixtures of dependent sources. Signal Process. 85(7), 1389–1403 (2005)

    Article  Google Scholar 

  22. Kopriva, I., Jeric, I., Brkljacic, L.: Nonlinear mixture-wise expansion approach to underdetermined blind separation of nonnegative dependent sources. J. Chemom. 27(1), 189–197 (2013)

    Article  Google Scholar 

  23. Cruces, S.: Bounded component analysis of linear mixtures: a criterion for minimum convex perimeter. IEEE Trans. Signal Process. 58(4), 2141–2154 (2010)

    Article  MathSciNet  Google Scholar 

  24. Erdogan, A.T.: A class of bounded component analysis algorithms for the separation of both independent and dependent sources. IEEE Trans. Signal Process. 61(22), 5730–5743 (2013)

    Article  MathSciNet  Google Scholar 

  25. Li, Y., Amari, S.I., Cichocki, A.: Underdetermined blind source separation based on sparse representation. IEEE Trans. Signal Process. 54(2), 423–437 (2006)

    Article  Google Scholar 

  26. Almeida, A., Luciani, X., Stegeman, A., Comon, P.: CONFAC decomposition approach to blind identification of underdetermined mixtures based on generating function derivatives. IEEE Trans. Signal Process. 60(11), 5698–5713 (2012)

    Article  MathSciNet  Google Scholar 

  27. Cardoso, J.F.: Dependence, correlation and gaussianity in independent component analysis. J. Mach. Learn. Res. 4, 1177–1203 (2003)

    MathSciNet  Google Scholar 

  28. Cichocki, A., Thawonmas, R.: On-line algorithm for blind signal extraction of arbitrarily distributed, but temporally correlated sources using second order statistics. Neural Process. Lett. 12(1), 91–98 (2000)

    Article  Google Scholar 

  29. Barros, A.K., Cichocki, A.: Extraction of specific signals with temporal structure. Neural Comput. 13(9), 1995–2003 (2001)

    Article  Google Scholar 

  30. Anderson, M., Adali, T., Li, X.L.: Joint blind source separation with multivariate gaussian model: algorithms and performance analysis. IEEE Trans. Signal Process. 60(4), 1672–1683 (2012)

    Article  MathSciNet  Google Scholar 

  31. Zibulevsky, M., Zeevi, Y.Y.: Extraction of a source from multichannel data using sparse decomposition. Neurocomputing 49(1–4), 163–173 (2002)

    Article  Google Scholar 

  32. Zhang, Z.L.: Morphologically constrained ICA for extracting weak temporally correlated signals. Neurocomputing 71, 1669–1679 (2008)

    Article  Google Scholar 

  33. Caiafa, C.F., Proto, A.N.: Separation of statistically dependent sources using an l2 distance non-gaussianity measure. Signal Process. 86(11), 3404–3420 (2006)

    Article  Google Scholar 

  34. Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Networks 10(3), 626–634 (1999)

    Article  Google Scholar 

  35. Friedman, J.H.: Exploratory projection pursuit. J. Am. Stat. Assoc. 82(397), 249–266 (1987)

    Article  Google Scholar 

  36. Blanco, Y., Zazo, S.: New gaussianity measures based on order statistics: application to ica. Neurocomputing. 51, 303–320 (2003)

    Article  Google Scholar 

  37. Psychology Department of University of Stirling. http://pics.psych.stir.ac.uk/

  38. Vincent, E., Araki, S., Theis, F.J., Nolte, G., Bofill, P., et al.: The signal separation evaluation campaign (2007-2010): achievements and remaining challenges. Sig. Process. 92, 1928–1936 (2012)

    Article  Google Scholar 

  39. Cichocki, A., Amari, S., Siwek, K.: ICALAB toolboxes. http://www.bsp.brain.riken.jp/ICALAB

Download references

Acknowledgments

This research is financially supported by the National Natural Science Foundation of China (No. 61401401, 61172086, 61402421, U1204607), the China Postdoctoral Science Foundation (No. 2014M561998) and the young teachers special Research Foundation Project of Zhengzhou University (No. 1411318029).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fasong Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Wang, F., Li, R., Wang, Z., Gao, X. (2015). Blind Nonparametric Determined and Underdetermined Signal Extraction Algorithm for Dependent Source Mixtures. In: Huang, DS., Bevilacqua, V., Premaratne, P. (eds) Intelligent Computing Theories and Methodologies. ICIC 2015. Lecture Notes in Computer Science(), vol 9225. Springer, Cham. https://doi.org/10.1007/978-3-319-22180-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-22180-9_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-22179-3

  • Online ISBN: 978-3-319-22180-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics