Skip to main content
Log in

Linear State Space Feedforward and Feedback Structures for Blind Source Recovery in Dynamic Environments

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Blind Source Recovery (BSR) denotes recovery of original sources or signals from environments, which may include convolution, temporal variation, and even non-linearity—without necessarily performing explicit environment identification. This paper presents two separate multiple-input multiple-output (MIMO) structures for dynamic linear Blind Source Recovery (BSR) of multiple stochastically independent source signals. We propose linear state space models for both the mixing environment and the demixing (or the recovering) adaptive network. The demixing network may assume either the feedforward or the feedback state space configuration. Separate algorithms have been derived for the adaptive estimation of the feedforward and the feedback demixing/recovering network’s parameters. These algorithms are based on the multivariable optimization theory and utilize the Riemannian contra-variant gradient (or the natural gradient) search under the constraints of a state space representation. Auxiliary conditions for the convergence of these algorithms have also been derived and discussed. Illustrative simulation examples have been included to demonstrate the successful adaptation results for both proposed demixing network structures in the case of an infinite impulse response (IIR)-type mixing environment for example source statistical distributions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • S. Amari (1985) Differential Geometrical Methods in Statistics. Lecture Notes in Statistics 28 Springer-Verlag New York

    Google Scholar 

  • S. Amari T.-P. Chen A. Cichocki (1997) ArticleTitleStability analysis of adaptive blind source separation Neural Networks. 10 IssueID8 1345–1351 Occurrence Handle10.1016/S0893-6080(97)00039-7

    Article  Google Scholar 

  • Amari S. Natural Gradient Works Efficiently in Learning; Neural Computation 10, pp. 251–276, MIT Press, (1998).

  • Amari, S., Douglas, S., Cichocki, A. and Yang, H.: Multichannel blind deconvolution and equalization using the natural gradient, In: Proc. of IEEE Wkshp on Signal Processing: Adv. in Wireless Comm., pp. 101–104, Paris, France, (1997).

  • A. Belouchrani A. Cichocki (2000) ArticleTitleA robust whitening procedure in blind source separation context Electronic Letters 36 IssueID24 2050–2053 Occurrence Handle10.1049/el:20001436

    Article  Google Scholar 

  • J.F. Cardoso (2000) ArticleTitleOn the stability of source separation algorithms Journal of VLSI Signal Processing Systems. 26 IssueID1/2 7–14 Occurrence Handle0965.68130 Occurrence Handle2002b:83077

    MATH  MathSciNet  Google Scholar 

  • Cichocki, A. and Zhang, L.: Adaptive multichannel blind deconvolution using state-space models, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics (HOS ′99), pp. 296–299, Ceasarea, Israel, June 1999.

  • Cichocki, A., Zhang, L. and Rutkowski, T.: Blind separation and filtering using state space models, In: Proceedings of the 1999 IEEE International Symposium on Circuits and Systems (ISCAS′99), Vol. V, May 30–June 2, pp. 78–81, Orlando, Florida, USA, (1999).

  • A. Cichocki S. Amari (2002) Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications John Wiley & Sons Chichester UK

    Google Scholar 

  • S. Cruces L. Castedo (1999) ArticleTitleStability analysis of adaptive algorithms for blind source separation of convolutive mixtures Signal Processing. 78 IssueID3 265–275 Occurrence Handle10.1016/S0165-1684(99)00067-5

    Article  Google Scholar 

  • Cruces, S., Cichocki, A. and Amari, S.: Criteria for the simultaneous blind extraction of arbitrary groups of sources; In 3rd International conference. on ICA and BSS, pp. 740–745, San Diego, CA, 2001.

  • Gharbi, A. B. A. and Salam, F. M.: Blind separtion of independent sources in linear dynamical media; 1993 International Symposium on Nonlinear Theory and its Applications, NOLTA′93, Honolulu Hawaii, 1993.

  • Kendall, M. and Stuart, A.: The Advanced Theory of Statistics, Vol. I, Charles Griffin & Co. Ltd., 1977.

  • V. Koivunen M. Enescu E. Oja (2001) ArticleTitleAdaptive algorithm for blind separation from noisy time-varying mixtures Neural Computation 13 IssueID10 2339–2357 Occurrence Handle10.1162/089976601750541822

    Article  Google Scholar 

  • T.W. Lee M. Girolami A.J. Bell T. Sejnowski (2000) ArticleTitleA unifying information-theoretic framework for independent component analysis International Journal of Computers and Mathematic with Applications. 31 IssueID11 1–21 Occurrence Handle1766376

    MathSciNet  Google Scholar 

  • W.S. Levine (Eds) (c1996) The Control Handbook CRC Press Boca Raton, Florida

    Google Scholar 

  • Rugh, W.: Linear System Theory, 2nd Edition, Prentice Hall, 1996.

  • Salam, F. M.: An adaptive blind separation of independent signals, Proc. of Int’l Symp. on Circuits and Systems, ISCAS-93, Vol. 1, pp. 431–1434, Chicago, IL, May 1993.

  • Salam, F. M. and Erten, G.: Blind signal separation and recovery in dynamic environments, Proceedings of 3rd IEEE Workshop on Nonlinear Signal and Image Processing 1997, Mackinac Island, MI - September 8–10, 1997.

  • Salam, F. M. and Erten, G.: Exact entropy series representation for blind source separation, Proceedings of 1999 IEEE Conference on Systems, Man, and Cybernetics, SMC ′99, Vol. 1, pp. 553–558, 1999.

  • Salam, F. M., Erten, G. and Waheed, K.: Blind source recovery: algorithms for static and dynamic environments, Proceedings . of the INNS-IEEE International Joint Conference on Neural Networks, IJCNN-2001, Vol. 2, July 14–19, pp. 902–907, 2001.

  • Salam, F. M. and Waheed, K.: State space feedforward and feedback structures for blind source recovery, In: 3rd International Conference. on ICA and BSS, pp. 248–253 San Diego, CA, December 9–12, 2001.

  • Schobben, D., Torkkola, K. and Smaragdis, P.: Evaluation of signal separation methods, In: Proceedings of 1st International. Workshop on ICA and BSS, pp. 261–266, Aussois, France, January 11–15, 1999.

  • Waheed, K. and Salam, F. M.: Blind source recovery: some implementation and performance issues, Proceeding of the 44th IEEE Midwest Symposium on Circuits and Systems, Vol. 2, pp. 694–697, Dayton, Ohio, August 14–17, 2001.

  • Waheed, K. and Salam, F. M.: State space blind source recovery for mixtures of multiple source distributions, In: Proceedings of Intl Symposium on Circuits and Systems ISCAS-2002, Vol. I, pp. 197–200, Phoenix, Az, May 26–29, 2002.

  • Waheed, K. and Salem, F. M.: Blind Source Recovery: A Framework in the State Space; Journal of Machine Learning Research, Special Issue on Independent Component Analysis, Cambridge, MA, USA, The MIT Press, Dec-4, pp. 1411–1446, 2003.

  • Waheed, K. and Salam, F. M.: Cascaded structures for blind source recovery, In: 45th IEEE International Midwest Symposium on Circuits and Systems, Vol. 3, pp. 656–659, Tulsa, Oklahoma August 4–7, 2002.

  • Waheed, K. and Salam, F. M.: A data-derived quadratic independence measure for adaptive blind source recovery in practical applications, In 45th IEEE International Midwest Symposium on Circuits and Systems, Vol. 3, pp. 473–476. Tulsa, Oklahoma August 4–7, 2002.

  • Waheed, K. and Salam, F. M.: Blind source recovery using an adaptive generalized gaussian score function, In: Proceedings of 45th IEEE International Midwest Symposium on Circuits and Systems, Vol. 2, pp. 418–421, Tulsa, Oklahoma 2002.

  • Waheed, K. and Salem F. M.: New hyperbolic source density models for blind source recovery score functions, In: Proceedings 2003 International Symposium on Circuits & Systems, Vol. 3, pp. 32–35, Bangkok, Thailand, May 25–28, 2003.

  • H.H. Yang S. Amari (1998) ArticleTitleComplexity issues in natural gradient descent method for training multi-layer perceptrons Neural Computation 10 IssueID8 2137–2157 Occurrence Handle10.1162/089976698300017007

    Article  Google Scholar 

  • Yeung, Raymond W.: A First Course in Information Theory, Kluwer Academic/Plenum Publishers, March 2002.

  • L. Zhang A. Cichocki (2000) ArticleTitleBlind deconvolution of dynamical systems: a state space approach Journal of Signal Processing 4 IssueID2 111–130

    Google Scholar 

  • Zhang, L., Cichocki A. and Amari S.: Kalman filter and state-space approach to multichannel blind deconvolution, In: Proceeding of IEEE Int’l workshop on Neural Networks for Signal Processing NNSP-2000, pp. 425–434, Sydney, Australia, 2000.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fathi M. Salem.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Waheed, K., Salem, F.M. Linear State Space Feedforward and Feedback Structures for Blind Source Recovery in Dynamic Environments. Neural Process Lett 22, 325–344 (2005). https://doi.org/10.1007/s11063-005-1000-0

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-005-1000-0

Keywords

Navigation