Abstract
The recovery of depth from defocused images involves calculating the depth of various points in a scene by modeling the effect that the focal parameters of the camera have on images acquired with a small depth of field. In the existing methods on depth from defocus (DFD), two defocused images of a scene are obtained by capturing the scene with different sets of camera parameters. Although the DFD technique is computationally simple, the accuracy is somewhat limited compared to the stereo algorithms. Further, an arbitrary selection of the camera settings can result in observed images whose relative blurring is insufficient to yield a good estimate of the depth. In this paper, we address the DFD problem as a maximum likelihood (ML) based blur identification problem. We carry out performance analysis of the ML estimator and study the effect of the degree of relative blurring on the accuracy of the estimate of the depth. We propose a criterion for optimal selection of camera parameters to obtain an improved estimate of the depth. The optimality criterion is based on the Cramer-Rao bound of the variance of the error in the estimate of blur. A number of simulations as well as experimental results on real images are presented to substantiate our claims.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Andrews, H.C. and Hunt, B.R. 1977. Digital Image Restoration. Prentice-Hall: Englewood Cliffs.
Biemond, J., van der Putten, F.G., and Woods, J.W. 1988. Identification and restoration of images with symmetric non-causal blurs. IEEE Trans. Circuits Syst., 35, 385-394.
Born, M. and Wolf, E. 1965. Principles of Optics. Pergamon: London.
Bove, V.M. 1993. Entropy-based depth from focus. J. Optical Society of America, A, 10, 561-566.
Ens, J. and Lawrence, P. 1993. An investigation of methods for determining depth from focus. IEEE Trans. PAMI, 15, 97-107.
Gonzalez, R.C. and Wintz, P. 1987. Digital Image Processing. Addison-Wesley.
Goodman, J.W. 1968. Introduction to Fourier Optics. McGraw-Hill, Inc.
Horn, B.K.P. 1987. Robot Vision. MIT Press.
Hwang, T., Clark, J.J., and Yuille, A.C. 1989. A depth recovery algorithm using defocus information. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Diego, pp. 476-481.
Jain, A.K. 1981. Advances in mathematical models for image processing. In Proc. IEEE, 69, 502-528.
Jarvis, R.A. 1983. A perspective on range finding techniques for computer vision. IEEE Trans. PAMI, 5, 122-139.
Krotkov, E.P. 1989. Active Computer Vision by Cooperative Focus and Stereo. Springer-Verlag, New York.
Lay, K.T. and Katsaggelos, A.K. 1990. Image identification and restoration based on the expectation-maximization algorithm. Optical Engineering, 29, 436-445.
Lagendijk, R.L., Katsaggelos, A.K., and Biemond, J. 1988. Iterative identification and restoration of images. In Proc. IEEE Intl. Conf. Acoust., Speech, Signal Processing, New York, pp. 992-995.
Lagendijk, R.L., Biemond, J., and Boekee, D.E. 1990a. Identification and restoration of noisy blurred images using the expectationmaximization algorithm. IEEE Trans. Acoust., Speech, Signal Processing, 38, 1180-1191.
Lagendijk, R.L., Biemond, J., and Boekee, D.E. 1990b. Hierarchial blur identification. In Proc. IEEE Intl. Conf. Acoust., Speech, Signal Processing, New Mexico, USA, pp. 1889-1892.
Lagendijk, R.L., Tekalp, A.M., and Biemond, J. 1990c. Maximum likelihood image and blur identification: A unifying approach. Optical Engineering, 29, 422-435.
Mendel, J.M. 1987. Lessons in Digital Estimation Theory. Prentice-Hall: Englewood Clffs.
Nayar, S.K., Watanabe, M., and Noguchi, M. 1996. Real-time focus range sensor. IEEE Trans. PAMI, 18, 1186-1198.
Pavlovic, G. and Tekalp, A.M. 1992. Maximum likelihood parametric blur identification based on a continuous spatial domain model. IEEE Trans. Image Processing, 1, 496-504.
Pentland, A.P. 1982. Depth of scene from depth of field. In Proc. Image Understanding Workshop.
Pentland, A.P. 1987. A new sense for depth of field. IEEE Trans. PAMI, 9, 523-531.
Pentland, A., Darell, T., Turk, M., and Huang, W. 1989. A simple real-time range camera. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Diego, pp. 256-261.
Pentland, A., Scherock, S., Darrell, T., and Girod, B. 1994. Simple range cameras based on focal error. J. Optical Society of America A, 11, 2925-2934.
Rajagopalan, A.N. and Chaudhuri, S. 1997a. Space-variant approaches for the recovery of depth from defocused images. Computer Vision and Image Understanding, 68, 309-329.
Rajagopalan, A.N. and Chaudhuri, S. 1997b. A variational approach to depth from defocused images. IEEE Trans. PAMI, 19, 1158-1165.
Rajagopalan, A. N. and Chaudhuri, S. 1997c. Optimum camera parameter settings for recovery of depth from defocused images. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 219-224.
Rao, C.R. 1965. Linear Statistical Inference and Its Applications. John Wiley & Sons, Inc.: New York.
Schreiber, W.F. 1986. Fundamentals of Electronic Imaging Systems. Springer-Verlag.
Subbarao, M. 1988. Parallel depth recovery by changing camera parameters. In Proc. IEEE Conf. on Computer Vision, Florida, USA, pp. 149-155.
Subbarao, M. and Wei, T. 1992. Depth from defocusing and rapid auto-focusing: A practical approach. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Champaign, Illinois, pp. 773-776.
Surya, G. and Subbarao, M. 1993. Depth from defocus by changing camera aperture. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, New York, USA, pp. 61-67.
Tekalp, A.M., Kaufman, H., and Woods, J.W. 1986. Identification of image and blur parameters for the restoration of non-causal blurs. IEEE Trans. Acoust., Speech, Signal Processing, 34, 963-972.
Watanabe, M. and Nayar, S.K. 1996. Minimal operator set for passive DFD. In IEEE Conf. on Computer Vision and Pattern Recognition, San Francisco, CA, pp. 431-438.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Rajagopalan, A.N., Chaudhuri, S. Performance Analysis of Maximum Likelihood Estimator for Recovery of Depth from Defocused Images and Optimal Selection of Camera Parameters. International Journal of Computer Vision 30, 175–190 (1998). https://doi.org/10.1023/A:1008019215914
Issue Date:
DOI: https://doi.org/10.1023/A:1008019215914