Skip to main content
Log in

Interpolation of signals with missing data using Principal Component Analysis

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

A non-iterative methodology for the interpolation and regularization of multidimensional sampled signals with missing data resorting to Principal Component Analysis (PCA) is introduced. Based on unbiased sub-optimal estimators for the mean and covariance of signals corrupted by zero-mean noise, the PCA is performed and the signals are interpolated and regularized. The optimal solution is obtained from a weighted least mean square minimization problem, and upper and lower bounds are provided for the mean square interpolation error. This solution is a refinement to a previously introduced method proposed by the author Oliveira (Proceedings of the IEEE international conference on acoustics, speech, and signal processing—ICASSP06, Toulouse, France, 2006), where three extensions are exploited: (i) mean substitution for covariance estimation, (ii) Tikhonov regularization method and, (iii) dynamic principal components selection. Performance assessment benchmarks relative to averaging, Papoulis-Gerchberg, and Power Factorization methods are included, given the results obtained from a series of Monte Carlo experiments with 1-D audio and 2-D image signals. Tight upper and lower bounds were observed, and improved performance was attained for the refined method. The generalization to multidimensional signals is immediate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Benedetto, J., & Ferreira, P. (2000). Modern sampling theory: mathematics and applications Birkhäuser.

  • Blanz, V., & Vetter, T. (2002). Reconstructing the complete 3D shape of faces from partial information, it+ti Oldenburg, Verlag.

  • Buchanan A., Fitzgibbon A.W. (2005) Damped newton algorithms for matrix factorization with missing data. IEEE Computer Vision and Pattern Recognition Conference 2: 316–322

    Google Scholar 

  • Choi H., Munson D. (1998) Analyis and design of minimax-optimal interpolators. IEEE Transactions on Signal Processing 46(6): 1571–1579

    Article  Google Scholar 

  • Gerchberg R. (1974) Super-resolution through error energy reduction. Optica Acta 21(9): 709–720

    Google Scholar 

  • Hartley, R. (2003). PowerFactorization: an approach to affine reconstruction with missing and uncertain data. In Australia-Japan advanced workshop on computer vision, Adelaide, Australia.

  • Jolliffe, I. (2002). Principal component analysis. Springer-Verlag.

  • Kailath, T., Sayed, A., & Hassibi, B. (2000). Linear estimation. Prentice Hall Information and System Sciences Series.

  • Kay, S. (1993). Fundamentals of statistical signal processing – Vol. I Estimation theory. Prentice-Hall Signal Processing Series.

  • Marvasti, F. (2001). Nonuniform sampling theory and practice series: information technology: transmission, processing and storage. Springer-Verlag.

  • Mertins, A. (1999). Signal analysis: wavelets, filter banks, time-frequency transforms and applications. John Wiley & Sons.

  • Oliveira, P. (2006). Interpolation of signals with missing data using PCA. In Proceedings of the IEEE international conference on acoustics, speech, and signal processing—ICASSP06, Toulouse, France.

  • Oliveira P. (2007) MMAE terrain reference navigation for underwater vehicles using PCA. Accepted for publication on a special number of the International Journal of Control, in Navigation, Guidance and Control of Uninhabited Underwater Vehicles 80(7): 1008–1017

    MATH  Google Scholar 

  • Papoulis, A. (1973). A new method in image restoration. JSTAC, Paper VI-3.

  • Papoulis A. (1975) A new algorithm in spectral analysis and band-limited extrapolation. IEEE Transactions on Circuits and Systems 19: 735–742

    Article  MathSciNet  Google Scholar 

  • Pascoal A., Oliveira P., Silvestre C., Bjerrum A., Ishoy A., Pignon J.-P. et al (1997) MARIUS: An autonomous underwater vehicle for coastal oceanography. IEEE Robotics & Automation Magazine 4(4): 46–59

    Article  Google Scholar 

  • Roweis, S. (1998). EM algorithms for PCA and SPCA. In Advances in neural information processing systems, Vol. 10, pp. 626–632.

  • Shum H-Y., Ikeuchi K., Reddy R. (1995) Principal component analysis with missing data and its application to polyhedral object modeling. IEEE Transactions Pattern Analyis and Machine Intelligence 17(9): 854–867

    Article  Google Scholar 

  • Tikhonov, A., Goncharsky, A., Stepanov, V., & YagolaKluwer, A. (1990). Numerical Methods for the solution of Ill-posed problems Academic Publishers.

  • Unser M. (2000) Sampling–50 Years After Shannon. Proceedings of the IEEE 88(4): 569–587

    Article  Google Scholar 

  • Yen, J. (1956). On nonuniform sampling of bandlimited signals. IRE Transactions on Circuit Theory, CT-3.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to P. Oliveira.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Oliveira, P., Gomes, L. Interpolation of signals with missing data using Principal Component Analysis. Multidim Syst Sign Process 21, 25–43 (2010). https://doi.org/10.1007/s11045-009-0086-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11045-009-0086-3

Keywords

Navigation