Abstract
A non-iterative methodology for the interpolation and regularization of multidimensional sampled signals with missing data resorting to Principal Component Analysis (PCA) is introduced. Based on unbiased sub-optimal estimators for the mean and covariance of signals corrupted by zero-mean noise, the PCA is performed and the signals are interpolated and regularized. The optimal solution is obtained from a weighted least mean square minimization problem, and upper and lower bounds are provided for the mean square interpolation error. This solution is a refinement to a previously introduced method proposed by the author Oliveira (Proceedings of the IEEE international conference on acoustics, speech, and signal processing—ICASSP06, Toulouse, France, 2006), where three extensions are exploited: (i) mean substitution for covariance estimation, (ii) Tikhonov regularization method and, (iii) dynamic principal components selection. Performance assessment benchmarks relative to averaging, Papoulis-Gerchberg, and Power Factorization methods are included, given the results obtained from a series of Monte Carlo experiments with 1-D audio and 2-D image signals. Tight upper and lower bounds were observed, and improved performance was attained for the refined method. The generalization to multidimensional signals is immediate.
Similar content being viewed by others
References
Benedetto, J., & Ferreira, P. (2000). Modern sampling theory: mathematics and applications Birkhäuser.
Blanz, V., & Vetter, T. (2002). Reconstructing the complete 3D shape of faces from partial information, it+ti Oldenburg, Verlag.
Buchanan A., Fitzgibbon A.W. (2005) Damped newton algorithms for matrix factorization with missing data. IEEE Computer Vision and Pattern Recognition Conference 2: 316–322
Choi H., Munson D. (1998) Analyis and design of minimax-optimal interpolators. IEEE Transactions on Signal Processing 46(6): 1571–1579
Gerchberg R. (1974) Super-resolution through error energy reduction. Optica Acta 21(9): 709–720
Hartley, R. (2003). PowerFactorization: an approach to affine reconstruction with missing and uncertain data. In Australia-Japan advanced workshop on computer vision, Adelaide, Australia.
Jolliffe, I. (2002). Principal component analysis. Springer-Verlag.
Kailath, T., Sayed, A., & Hassibi, B. (2000). Linear estimation. Prentice Hall Information and System Sciences Series.
Kay, S. (1993). Fundamentals of statistical signal processing – Vol. I Estimation theory. Prentice-Hall Signal Processing Series.
Marvasti, F. (2001). Nonuniform sampling theory and practice series: information technology: transmission, processing and storage. Springer-Verlag.
Mertins, A. (1999). Signal analysis: wavelets, filter banks, time-frequency transforms and applications. John Wiley & Sons.
Oliveira, P. (2006). Interpolation of signals with missing data using PCA. In Proceedings of the IEEE international conference on acoustics, speech, and signal processing—ICASSP06, Toulouse, France.
Oliveira P. (2007) MMAE terrain reference navigation for underwater vehicles using PCA. Accepted for publication on a special number of the International Journal of Control, in Navigation, Guidance and Control of Uninhabited Underwater Vehicles 80(7): 1008–1017
Papoulis, A. (1973). A new method in image restoration. JSTAC, Paper VI-3.
Papoulis A. (1975) A new algorithm in spectral analysis and band-limited extrapolation. IEEE Transactions on Circuits and Systems 19: 735–742
Pascoal A., Oliveira P., Silvestre C., Bjerrum A., Ishoy A., Pignon J.-P. et al (1997) MARIUS: An autonomous underwater vehicle for coastal oceanography. IEEE Robotics & Automation Magazine 4(4): 46–59
Roweis, S. (1998). EM algorithms for PCA and SPCA. In Advances in neural information processing systems, Vol. 10, pp. 626–632.
Shum H-Y., Ikeuchi K., Reddy R. (1995) Principal component analysis with missing data and its application to polyhedral object modeling. IEEE Transactions Pattern Analyis and Machine Intelligence 17(9): 854–867
Tikhonov, A., Goncharsky, A., Stepanov, V., & YagolaKluwer, A. (1990). Numerical Methods for the solution of Ill-posed problems Academic Publishers.
Unser M. (2000) Sampling–50 Years After Shannon. Proceedings of the IEEE 88(4): 569–587
Yen, J. (1956). On nonuniform sampling of bandlimited signals. IRE Transactions on Circuit Theory, CT-3.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Oliveira, P., Gomes, L. Interpolation of signals with missing data using Principal Component Analysis. Multidim Syst Sign Process 21, 25–43 (2010). https://doi.org/10.1007/s11045-009-0086-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11045-009-0086-3