Skip to main content

A Robust ICA-Based Adaptive Filter Algorithm for System Identification Using Stochastic Information Gradient

  • Conference paper
Neural Information Processing (ICONIP 2007)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4985))

Included in the following conference series:

  • 1565 Accesses

Abstract

This paper proposes a new adaptive filter algorithm for system identification by using an independent component analysis (ICA) technique, which separates the signal from noisy observation under the assumption that the signal and noise are independent. We first introduce an augmented state-space expression of the observed signal, representing the problem in terms of ICA. By using a nonparametric Parzen window density estimator and the stochastic information gradient, we derive an adaptive algorithm to separate the noise from the signal. The computational complexity of the proposed algorithm is compared with that of the standard NLMS algorithm. The local convergence is analyzed. Due to the additive noise is also on-line estimated during the iteration, the proposed algorithm shows excellent robustness. It can directly be applied to an acoustic echo canceller without any double-talk detector. Some simulation results are carried out to show the superiority of our ICA method to the conventional NLMS algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Haykin, S.: Adaptive Filter Theory, 4th edn. Prentice-Hall, Englewood Cliffs (2002)

    Google Scholar 

  2. Widrow, B., Stearns, S.D.: Adaptive Signal Processing. Prentice-Hall, Englewood Cliffs (1985)

    MATH  Google Scholar 

  3. Huber, P.J.: Robust Statistics. Wiley, New York (1981)

    MATH  Google Scholar 

  4. Hyvarinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley, New York (2001)

    Google Scholar 

  5. Magadán, M., Niemistö, R., Ruotsalainen, U., Möttönen, J.: ICA for acoustic echo control. In: Proc. EUSIPCO, vol. I, pp. 503–506 (2002)

    Google Scholar 

  6. Nitta, M., Sugimoto, K., Satoh, A.: Blind system identification of autoregressive model using independent component analysis. Transactions of SICE 41(5), 444–451 (2005) (in Japanese)

    Google Scholar 

  7. Yang, J.M., Sakai, H.: A new adaptive filter algorithm for system identification using independent component analysis. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2007), Honolulu, Hawaii, U.S.A., April 2007, vol. 3, pp. 1341–1344 (2007)

    Google Scholar 

  8. Parzen, E.: On estimation of a probability density function and mode. In: Time Series Analysis Papers, Holden-Day, Inc., CA (1967)

    Google Scholar 

  9. Erdogmus, D., Principe, J.C., Hild II, K.E.: On-line entropy manipulation: stochastic information gradient. IEEE Signal Processing Letters 10(8), 242–245 (2003)

    Article  Google Scholar 

  10. Pricipe, J., Xu, D., Fisher, J.: Information theoretic learning. In: Haykin, S. (ed.) Unsupervised Adaptive Filtering, pp. 265–319. Wiley, New York (2000)

    Google Scholar 

  11. Solo, V., Kong, X.: Adaptive Signal Processing Algorithms: Stability and Performance. Prentice-Hall, Englewood Cliffs (1995)

    Google Scholar 

  12. Chao, J., Tsujii, S.: A stable and distortion-free echo and howling canceller. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 1988), pp. 1620–1623 (1988)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Masumi Ishikawa Kenji Doya Hiroyuki Miyamoto Takeshi Yamakawa

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yang, JM., Sakai, H. (2008). A Robust ICA-Based Adaptive Filter Algorithm for System Identification Using Stochastic Information Gradient. In: Ishikawa, M., Doya, K., Miyamoto, H., Yamakawa, T. (eds) Neural Information Processing. ICONIP 2007. Lecture Notes in Computer Science, vol 4985. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69162-4_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-69162-4_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-69159-4

  • Online ISBN: 978-3-540-69162-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics