Abstract
This paper presents a new technique for generating a high resolution image from a blurred image sequence; this is also referred to as super-resolution restoration of images. The image sequence consists of decimated, blurred and noisy versions of the high resolution image. The high resolution image is modeled as a Markov random field (MRF) and a maximum a posteriori (MAP) estimation technique is used for super-resolution restoration. Unlike other super-resolution imaging methods, the proposed technique does not require sub-pixel registration of given observations. A simple gradient descent method is used to optimize the functional. The discontinuities in the intensity process can be preserved by introducing suitable line processes. Superiority of this technique to standard methods of image expansion like pixel replication and spline interpolation is illustrated.
Similar content being viewed by others
References
B. Bascle, A. Blake, and A. Zissermann, “Motion deblurring and super-resolution from an image sequence,” in Proc. of European Conf. on Computer Vision, Cambridge, UK, 1996, Springer-Verlag: Berlin.
A. Blake and A. Zisserman, Visual Reconstruction, MIT Press: Cambridge, MA, 1987.
S. Chaudhuri and A.N. Rajagopalan, Depth from Defocused Images: A Real Aperture Imaging Approach, Springer-Verlag: New York, 1999.
P. Cheeseman, B. Kanefsky, R. Kraft, J. Stutz, and R. Hanson, “Super-resolved surface reconstruction from multiple images,” NASA Ames Research Center, Moffet Field, CA. Technical Report FIA-94-12, 1994.
M.-C. Chiang and T.E. Boult, “Local blur estimation and superresolution,” in Proc. IEEE Conf. Computer Visin and Pattern Recognition, Puerto Rico, USA, 1997, pp. 821–826.
M. Elad and A. Feuer, “Restoration of a single super-resolution image from several blurred, noisy and undersampled measured images,” Dept. of Electrical Engg,Technion, Israel Instt. ofTechnology, Technical Report EE Pub No. 967, 1995.
M. Elad and A. Feuer, “Restoration of a single super-resolution image from several blurred, noisy and undersampled measured images,” IEEE Trans. on Image Processing, Vol. 6, No. 12, pp. 1646–1658, 1997.
S. Geman and D. Geman, “Stochastic relaxation, Gibbs distribution and the Bayesian restoration of image,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 6, No. 6, pp. 721–741, 1984.
J. Hadamard, Lectures on the Cauchy Problem in Linear Partial Differential Equations, Yale University Press: New Haven, CT, 1923.
M. Irani and S. Peleg, “Improving resolution by image registration,” CVGIP:Graphical Models and Image Processing,Vol. 53, pp. 231–239, 1991.
M. Irani and S. Peleg, “Motion analysis for image enhancement: Resolution, occlusion and transparency,” Journal of VCIR, Vol. 4, pp. 324–335, 1993.
S.P. Kim, N.K. Bose, and H.M. Valenzuela, “Recursive reconstruction of high resolution image from noisy undersampled multiframes,” IEEE Trans. on Accoustics, Speech and Signal Processing, Vol. 18, No. 6, pp. 1013–1027, 1990.
S.P. Kim and W.-Y. Su, “Recursive high-resolution reconstruction of blurred multiframe images,” IEEE Trans. on Image Processing, Vol. 2, pp. 534–539, 1993.
S. Krishnamachari and R. Chellappa, “Multiresolution Gauss-Markov random field models for texture segmentation,” IEEE Trans. on Image Processing, Vol. 6, No. 2, pp. 251–266, 1997.
S.Z. Li, Markov Random Field Modelling in Computer Vision, Springer-Verlag: Tokyo, 1995.
A. Papoulis, “Generalized sampling theorem,” IEEE Trans. on Circuits and Systems, Vol. 24, pp. 652–654, 1977.
A.J. Patti, M.I. Sezan, and A.M. Tekalp, “High resolution image reconstruction from a low resolution image sequence in the MRF-Based Approach to Generation of Super-Resolution Images 15 presence of time-varying motion blur,” in Proc. ICIP, Austin, USA, 1994, pp. 343–347.
A.N. Rajagopalan and S. Chaudhuri, “Space-variant approaches to recovery of depth from defocused images,” Computer Vision and Image Understanding, Vol. 68, No. 3, pp. 309–329, 1997.
D. Rajan and S. Chaudhuri, “Ageneralized interpolation scheme for image scaling and super-resolution,” in Proc. of Erlangen Workshop 99 on Vision, Modelling and Visualization, University of Erlangen-Nuremberg, Germany, Nov. 1999, pp. 301–308.
C.H. Russel, K.J. Barnard, and E.E. Armstrong, “Joint MA Pregistration and high resolution image estimation using a sequence of undersampled images,” IEEE Trans. on Image Processing, Vol. 6, No. 12, pp. 1621–1633, 1997.
C.H. Russel, K.J. Barnard, J.G. Bognar, E.E. Armstrong, and E.A. Watson, “Joint high resolution image reconstruction from a sequence of rotated and translated frames and its application to an infrared imaging system,” Optical Engineering, Vol. 37, No. 1, pp. 247–260, 1998.
R.R. Schultz and R.L. Stevenson, “A Bayesian approach to image expansion for improved definition,” IEEE Trans. on Image Processing, Vol. 3, No. 3, pp. 233–242, 1994.
R.R. Schultz and R.L. Stevenson, “Extraction of high-resolution frames from video sequences,” IEEE Trans. on Image Processing, Vol. 5, pp. 996–1011, 1996.
H. Shekarforoush, M. Berthod, and J. Zerubia, “3D superresolution using generalized sampling expansion,” in Proc. Int. Conf. on Image Processing, Washington D.C., 1995, pp. 300–303.
H. Shekarforoush, M. Berthod, J. Zerubia, and M. Werman, “Sub-pixel Bayesian estimation of albedo and height,” International Journal of Computer Vision, Vol. 19, No. 3, pp. 289–300, 1996.
C. Srinivas and M.D. Srinath, “A stochastic model based approach for simultaneous restoration of multiple mis-registered images,” SPIE, Vol. 1360, pp. 1416–1427, 1990.
A.M. Tekalp, M.K. Ozkan, and M.I. Sezan, “High resolution image reconstruction from lower-resolution image sequences and space-varying image restoration,” in Proc. ICAASP, San Francisco, USA, 1992, pp. 169–172.
B.C. Tom and A.K. Katsaggelos, “Reconstruction of a highresolution image by simultaneous registration, restoration and interpolation of low-resolution images,” in Proc. of Int Conf. Image Processing, Washington D.C., 1995, pp. 539–542.
R.Y. Tsai and T.S. Huang, “Multiframe image restoration and registration,” in Advances in Computer Vision and Image Processsing, JAI Press: London, 1984, pp. 317–339.
H. Ur and D. Gross, “Improved resolution from sub-pixel shifted pictures,” CVGIP:Graphical Models and Image Processing, Vol. 54, pp. 181–186, 1992.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Rajan, D., Chaudhuri, S. An MRF-Based Approach to Generation of Super-Resolution Images from Blurred Observations. Journal of Mathematical Imaging and Vision 16, 5–15 (2002). https://doi.org/10.1023/A:1013961817285
Issue Date:
DOI: https://doi.org/10.1023/A:1013961817285