Abstract.
We address the problem of blind separation of instantaneous and convolutive mixtures of independent signals. We formulate this problem as an optimization problem using the mutual information criterion. In the case of instantaneous mixtures, we solve the resulting optimization problem with an extended Newton's method on the Stiefel manifold. This approach works for general independent signals and enjoys quadratic convergence rate. For convolutive mixtures, we first decorrelate the signal mixtures by performing a spectral matrix factorization and then minimize the mutual information of decorrelated signal mixtures. This approach not only separates the sources but also equalizes the extracted signals. For both instantaneous and convolutive cases, we approximate the marginal density function of the output signals by a kernel estimator. The convergence of the kernel estimator is also analyzed. The simulation results demonstrate the competitiveness of our proposed methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aliyev, F.A., Bordyug, B.A., Larin, V.B.: Factorization of polynomial matrices and separation of rational matrices. Soviet Journal of Tekhnicheskaya Kibernettica 2, 49–59 (1990), Scripta Technica, Inc. 47–58 (1999)
Amari, S., Cichocki, A., Yang, H.H.: A new learning algorithm for blind signal separation. Advances in Neural Information Processing System 8, 757–763 (1996)
Amari, S., Cardoso, J.-F.: Blind source separation-semiparametric statistical approach. IEEE Transactions on Signal Processing 45(11), 2692–2700 (1997)
Biggs, M.C.: Constrained minimization using recursive quadratic programming, Towards Global Optimization (L.C.W. Dixon G.P. Szergo, eds.), North-Holland, 1975, pp. 341–349
Boscolo, R., Pan, H., Roychowdhury, V.P.: Non-parametric ICA, Proceeding of the Third International Conference on Indpendent Component Analysis and Blind Signal Separation, 2001, pp. 13–18
Cardoso, J.-F., Souloumiac, A.: Blind beamforming for non-Gaussian signals. IEE Proceeding-F 140(6), 362–370 (1993)
Comon, P.: Independent component analysis, a new concept?. Signal Proessing 36, 287–314 (1994)
Davidson, T.N., Sturm, J.F.: A primal positive real lemma for FIR systems, with applications to filter design and spectral factorization. Manuscript, 2000, pp. 1–6
Edelman, A., Arias, T., Smith, S.T.: The geometry of algorithms with orthogonality constraints. SIAM J. Matrix Analysis J. Appl. 20(2), 303–353 (1999)
Fletcher, R., Practical Methods of Optimization. John Wiley and Sons Wiley, 1980
Han, S.P.: A globally convergent method for nonlinear programming. J. Optimiz. Theory Appl. 22, 297 (1997)
Hyvärinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks 10(3), 626–634 (1999)
Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. John Wiley and Sons Wiley, 2001
Pham, D.T.: Blind separation of instantaneous mixtures of sources via an independent compnent analysis. IEEE Transactions on Signal Processing 44(11), 2768–2779 (1990)
Pham, D.T.: Mutual information approach to blind eparation of sources. Proceeding of ICA'99 workshop, Aussois, 1999, pp. 215–220
Powell, M.J.D.: The convergence of variable metric methods for nonlinearly constrained optimization calculations, Nonlinear Programming 3, (O. L. Mangasarian, R. R. Meyer and S. M. Robinson, eds.), Academic Press, 1978
Silverman, B.W.: Density Estimation for Statistics and Data Analysis. Chapman and Hall, New York, 1985
Wand, M.P., Jones, M.C.: Kernel Smoothing. Chapman and Hall, 1995
Author information
Authors and Affiliations
Additional information
This research is supported in part by the Natural Sciences and Engineering Research Council of Canada, Grant No. OPG0090391 and by the Canada Research Chair Program.
Mathematics Subject Classification (2000): 20E28, 20G40, 20C20
Rights and permissions
About this article
Cite this article
Luo, ZQ., Lu, J. On blind source separation using mutual information criterion. Math. Program., Ser. B 97, 587–603 (2003). https://doi.org/10.1007/s10107-003-0429-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10107-003-0429-z