Skip to main content
Log in

Rational Filters for Passive Depth from Defocus

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

A fundamental problem in depth from defocus is the measurement of relative defocus between images. The performance of previously proposed focus operators are inevitably sensitive to the frequency spectra of local scene textures. As a result, focus operators such as the Laplacian of Gaussian result in poor depth estimates. An alternative is to use large filter banks that densely sample the frequency space. Though this approach can result in better depth accuracy, it sacrifices the computational efficiency that depth from defocus offers over stereo and structure from motion. We propose a class of broadband operators that, when used together, provide invariance to scene texture and produce accurate and dense depth maps. Since the operators are broadband, a small number of them are sufficient for depth estimation of scenes with complex textural properties. In addition, a depth confidence measure is derived that can be computed from the outputs of the operators. This confidence measure permits further refinement of computed depth maps. Experiments are conducted on both synthetic and real scenes to evaluate the performance of the proposed operators. The depth detection gain error is less than 1%, irrespective of texture frequency. Depth accuracy is found to be 0.5∼1.2% of the distance of the object from the imaging optics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Besl, P.J. 1988. Range imaging sensors. Technical Report GMR-6090, General Motors Research Laboratories.

  • Born, M. and Wolf, E. 1965. Principles of Optics. Permagon: London.

    Google Scholar 

  • Bove, V.M.Jr. 1993. Entropy-based depth from focus. Journal of Optical Society of America A, 10:561-566.

    Google Scholar 

  • Bracewell, R.N. 1965. The Fourier Transform and Its Applications. McGraw Hill.

  • Burt, P.J. and Adelson, E.H. 1983. The Laplacian pyramid as a compact image code. IEEE Trans. on Communications, COM-31(4):532-540.

    Google Scholar 

  • Darrell, T. and Wohn, K. 1988. Pyramid based depth from focus. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 504-509.

  • Ens, J. and Lawrence, P. 1991. A matrix based method for determining depth from focus. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 600-609.

  • Gokstorp, M. 1994. Computing depth from out-of-focus blur using a local frequency representation. In Proc. on Intl. Conf. on Patt. Recog.

  • Hoel, P.G. 1971. Introduction to Mathematical Statistics. JohnWiley & Sons: New York.

    Google Scholar 

  • Horn, B.K.P. 1968. Focusing. Memo 160, AI Lab., Massachusetts Institute of Technology, Cambridge, MA, USA.

    Google Scholar 

  • Horn, B.K.P. 1986. Robot Vision. The MIT Press.

  • Jarvis, R.A. 1983. A perspective on range finding techniques for computer vision. IEEE Trans. on Pattern Analysis and Machine Intelligence, 5(2):122-139.

    Google Scholar 

  • Jolion, J.M. and Rosenfeld, A. 1994.APyramidFramework for Early Vision. Kluwer Academic Publishers: Boston, MA.

    Google Scholar 

  • Kingslake, R. 1983. Optical System Design. Academic Press.

  • Krotkov, E. 1987. Focusing. Intl. Journal of Computer Vision, 1:223- 237.

    Google Scholar 

  • Nayar, S.K. and Nakagawa, Y. 1994. Shape from focus: An effective approach for rough surfaces. IEEE Trans. on Pattern Analysis and Machine Intelligence, 16(8):824-831.

    Google Scholar 

  • Nayar, S.K., Watanabe, M., and Noguchi, M. 1995. Real-time focus range sensor. In Proc. of Intl. Conf. on Computer Vision, pp. 995- 1001.

  • Oppenheim, A.V. and Schafer, R.W. 1989. Discrete-Time Signal Processing. Prentice Hall: Englewood Cliffs, NJ.

    Google Scholar 

  • Peitgen, H.O. and Saupe, D. (Eds.) 1988. The Science of Fractal Images. Springer-Verlag: New York, NY.

    Google Scholar 

  • Pentland, A. 1987. A new sense for depth of field. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9(4):523-531.

    Google Scholar 

  • Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C. Cambridge University Press.

  • Subbarao, M. 1988. Parallel depth recovery by changing camera parameters. In Proc. of Intl. Conf. on Computer Vision, pp. 149- 155.

  • Subbarao, M. and Surya, G. 1994. Depth from defocus: A spatial domain approach. International Journal of Computer Vision, 13(3):271-294.

    Google Scholar 

  • Watanabe, M., Nayar, S.K., and Noguchi, M. 1995. Real-time computation of depth from defocus. In Proc. of SPIE: Three-Dimensional and Unconventional Imaging for Industrial Inspection and Metrology, 2599:A-03.

    Google Scholar 

  • Watanabe, M. and Nayar, S.K. 1995a. Minimal operator set for texture invariant depth from defocus. Technical Report CUCS-031-95, Dept. of Computer Science, Columbia University, New York, NY, USA.

    Google Scholar 

  • Watanabe, M. and Nayar, S.K. 1995b. Telecentric optics for constantmagnification imaging. Technical Report CUCS-026-95, Dept. of Computer Science, Columbia University, New York, NY, USA.

    Google Scholar 

  • Wolberg, G. 1990. Digital Image Warping. IEEE Compter Society Press: Los Alamitos, CA.

    Google Scholar 

  • Xiong, Y. and Shafer, S.A. 1993. Depth from focusing and defocusing. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 68-73. Also, Technical Report CMU-RI-TR-93-07, Pittsburgh, PA, USA.

  • Xiong, Y. and Shafer, S.A. 1995. Moment filters for high precision computation of focus and stereo. In Proc. of IROS, pp. 108- 113. Also, Technical Report CMU-RI-TR-94-28, Pittsburgh, PA, USA.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Watanabe, M., Nayar, S.K. Rational Filters for Passive Depth from Defocus. International Journal of Computer Vision 27, 203–225 (1998). https://doi.org/10.1023/A:1007905828438

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1007905828438

Navigation