Elsevier

Neurocomputing

Volume 72, Issues 10–12, June 2009, Pages 2556-2562
Neurocomputing

Blind source extraction based on generalized autocorrelations and complexity pursuit

https://doi.org/10.1016/j.neucom.2008.10.013Get rights and content

Abstract

Blind source extraction (BSE) is a special class of blind source separation (BSS) method. Due to its low computation load and fast processing speed, BSE has become one of the promising methods in signal processing and analysis. This paper addresses BSE problem when a desired source signal has temporal structures. Based on the generalized autocorrelations of the desired signal and the non-Gaussianity of its innovations, we develop an objective function. Maximizing this objective function, we present a BSE algorithm and further give its stability analysis in this paper. Simulations on image data and electrocardiogram (ECG) data indicate its better performance and the better property of tolerance to the estimation error of the time delay.

Introduction

The problem of blind source separation (BSS) [1], [2], [3], [4] forms part of the independent component analysis (ICA), which is an active research field that has attracted great interest in the field of biomedical signal analysis and processing, geophysical data processing, data mining, speech analysis and image recognition, etc. [5], [6], [7], [8], [9], [10], [11], [12]. BSS is a powerful statistical technique in blind signal processing, which considers the simultaneous recovery of all the independent components from the observations. However, in practice, extracting all the source signals from a large number of observed sensor signals, for example, a magnetoencephalographic (MEG) measurement which may output hundreds of recordings, can take a long time and in these signals only a very few are desired with given characteristics. Therefore it is necessary to develop an reliable, robust and effective method to obtain only the desired signals that contain useful information. For this purpose, another technique—blind source extraction (BSE)—was proposed, which has become one of the promising methods due to its low computation load and fast processing speed. Many source extraction algorithms [1] can extract a specific signal as the first output, in which some special characteristics of the signals have to be exploited, such as linear predictability or smoothness [1], [13], non-Gaussianity [14], [15], sparseness [16] and generalized autocorrelations [17], etc.

When the desired source signals are periodic or quasi-periodic, one convenient way to exploit this property is to employ a linear predictor within the BSE structure. Many source extraction algorithms have considered this case. For example, Barros and Cichocki [13] provided a simple algorithm (simplified with “BCBSE” algorithm) which can quickly extract a desired source signal with a specific period. This algorithm in all the cases could extract the desired sources, whether they are colored as long as they are decorrelated and have temporal structures. However, this method only carries out the constrained minimization of the mean squared error, which cannot well describe the probability distribution of the innovations of the signals. In addition, it needs a prior information about the optimal time delay and is very sensitive to the estimation error of the time delay. To overcome these drawbacks, Shi et al. [15] developed a BSE algorithm (simplified with “SemiBSE” algorithm), which is based on the non-Gaussianity and the autocorrelations of the source signals and contains the mean squared error objective function presented by Barros and Cichocki [13]. This method improves the performance of BCBSE algorithm, and its tolerance to large estimated errors of the period makes the desired signal extracted robustly. However, it must be noted that its better tolerance lies the fact that the choice of initial weight is not random but unit vector. When we initialize the weight randomly, SemiBSE algorithm becomes more sensitive to the estimation error of time delay.

The alternative approach, which addresses the BSE problem when a desired source signal has linear or nonlinear autocorrelations, was first introduced in literature [17]. Based on the generalized (i.e., linear or nonlinear) autocorrelations of the primary sources, authors proposed a BSE algorithm (called “GABSE” algorithm). It has been shown that this method has good stability and linear convergence speed. Furthermore, the convergence is global except for a zero measure region. This method only assumes the sources are decorrelated with each other and every source has different temporal structures, but dose not necessarily have to be statistically independent. GABSE algorithm has been applied to many cases directly and the performance is satisfying to a certain extent. Whereas, it also suffers some disadvantages, for example, its tolerance to estimated errors of time delay is not very robust.

In this article, we aim to develop an efficient algorithm, which incorporates the generalized autocorrelations of the desired signal and the non-Gaussianity of its innovations, for extraction of the desired signal. Based on these priori special characteristics, we first develop an objective function. Then a gradient BSE algorithm for finding a maximum of this objective function is proposed. Numerical computation and theoretical analysis show that such a combination both improves the performance of existing algorithms and has better robustness to the estimated error of time delay.

This manuscript is organized as follows. The next section describes the objective function and proposes the BSE algorithm, then gives its stability analysis. Section 3 demonstrates the present technique with experiments using image data and electrocardiogram (ECG) data. The final section provides some discussions and conclusions.

Section snippets

Objective function

Denote the observed sensor signals x(t)=(x1(t),,xn(t))T described by matrix equationx(t)=As(t),where A is an n×n unknown mixing matrix and s(t)=(s1(t),,sn(t))T is a vector of unknown temporally correlated sources. We assume that desired source signal si has specific temporal structures—linear or nonlinear autocorrelations. And it can be modelled by linear autoregressive model, which has just one predicting term assi(t)=bisi(t-τ)+δi(t),where δi(t) is a zero-mean, independent identically

Simulations

In order to verify the efficiency of our algorithm, we made many simulations on image data, artificial ECG data and real-world ECG data [20]. Moreover, we compared the proposed method with many existing techniques—BCBSE algorithm, SemiBSE algorithm, GABSE algorithm and one-unit FastICA algorithm [21]. In these comparisons, the performance of algorithms to estimate the desired signal is measured by performance index (PI), which is defined as follows:PI=j=1n|pj|maxk|pk|-1,k=1,,n,where pj

Discussions and conclusions

Due to the low computation load and fast processing speed, BSE has become one of the promising method in the field of neural networks, especially unsupervised learning, and more generally in advanced statistics and signal processing. Several approaches for extracting desired signals have been developed recently, such as SemiBSE applied to FECG extraction and GABSE applied to image and FECG extraction. These methods have their advantages or features mainly to the signals of interest with

Acknowledgments

This work is supported by Natural Science Foundation of China under Grant nos. 10571018, 60605002, 70431001, 70871015. The authors would like to thank the referees and the editorial board for their insightful comments and suggestions.

Hongjuan Zhang received her B.S. degree in Mathematics from Ludong University, China, in 2003, M.S. degree from Department of Applied Mathematics of Dalian University of Technology in 2005. She is now a doctorate student in Department of Applied Mathematics of Dalian University of Technology. Her research interests cover blind signal processing, pattern recognition, and systems optimization.

References (21)

There are more references available in the full text version of this article.

Cited by (8)

  • A fast blind source separation algorithm based on the temporal structure of signals

    2014, Neurocomputing
    Citation Excerpt :

    And the consistency and convergence of the proposed algorithm have been proved, which shows that it converges at least quadratically. And what is more, the decision of time delay is simple and practicable than the other algorithm [41], which can be set to 1 in most cases. Numerical experiments for sources with square temporal autocorrelation and the real-world applications in the analysis of the ECG and magnetoencephalographic recordings (MEG) indicate the efficiency and the applicability of the proposed algorithm.

  • Blind signal separation based on widely linear complex autoregressive process of order one

    2021, Eurasip Journal on Wireless Communications and Networking
  • A method of underdetermined blind source extraction via time-domain

    2012, Diangong Jishu Xuebao/Transactions of China Electrotechnical Society
  • A fixed-point blind source extraction algorithm and its application to ECG data analysis

    2012, 2012 IEEE 6th International Conference on Systems Biology, ISB 2012
View all citing articles on Scopus

Hongjuan Zhang received her B.S. degree in Mathematics from Ludong University, China, in 2003, M.S. degree from Department of Applied Mathematics of Dalian University of Technology in 2005. She is now a doctorate student in Department of Applied Mathematics of Dalian University of Technology. Her research interests cover blind signal processing, pattern recognition, and systems optimization.

Zhenwei Shi received his Ph.D. degree in Mathematics from Dalian University of Technology, Dalian, China, in 2005. He was a Postdoctoral Researcher in the Department of Automation, Tsinghua University, Beijing, China, from 2005 to 2007. He is currently an associate professor in the Image Processing Center, School of Astronautics, Beijing University of Aeronautics and Astronautics. His research interests include blind signal processing, image processing, pattern recognition, machine learning and neuroinformatics.

Chonghui Guo received the B.S. degree in Mathematics from Liaoning University, China, in 1995, M.S. degree in Operational Research and Control Theory, and Ph.D. degree in Management Science and Engineering from Dalian University of Technology, China, in 2002. He was a postdoctoral research fellow in the Department of Computer Science, Tsinghua University from 2002 to 2004. Now he is an associate professor of the Institute of Systems Engineering, Dalian University of Technology. His current research interests include machine learning, data mining, pattern recognition, and systems optimization.

View full text