Abstract
A fundamental problem in depth from defocus is the measurement of relative defocus between images. The performance of previously proposed focus operators are inevitably sensitive to the frequency spectra of local scene textures. As a result, focus operators such as the Laplacian of Gaussian result in poor depth estimates. An alternative is to use large filter banks that densely sample the frequency space. Though this approach can result in better depth accuracy, it sacrifices the computational efficiency that depth from defocus offers over stereo and structure from motion. We propose a class of broadband operators that, when used together, provide invariance to scene texture and produce accurate and dense depth maps. Since the operators are broadband, a small number of them are sufficient for depth estimation of scenes with complex textural properties. In addition, a depth confidence measure is derived that can be computed from the outputs of the operators. This confidence measure permits further refinement of computed depth maps. Experiments are conducted on both synthetic and real scenes to evaluate the performance of the proposed operators. The depth detection gain error is less than 1%, irrespective of texture frequency. Depth accuracy is found to be 0.5∼1.2% of the distance of the object from the imaging optics.
Similar content being viewed by others
References
Besl, P.J. 1988. Range imaging sensors. Technical Report GMR-6090, General Motors Research Laboratories.
Born, M. and Wolf, E. 1965. Principles of Optics. Permagon: London.
Bove, V.M.Jr. 1993. Entropy-based depth from focus. Journal of Optical Society of America A, 10:561-566.
Bracewell, R.N. 1965. The Fourier Transform and Its Applications. McGraw Hill.
Burt, P.J. and Adelson, E.H. 1983. The Laplacian pyramid as a compact image code. IEEE Trans. on Communications, COM-31(4):532-540.
Darrell, T. and Wohn, K. 1988. Pyramid based depth from focus. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 504-509.
Ens, J. and Lawrence, P. 1991. A matrix based method for determining depth from focus. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 600-609.
Gokstorp, M. 1994. Computing depth from out-of-focus blur using a local frequency representation. In Proc. on Intl. Conf. on Patt. Recog.
Hoel, P.G. 1971. Introduction to Mathematical Statistics. JohnWiley & Sons: New York.
Horn, B.K.P. 1968. Focusing. Memo 160, AI Lab., Massachusetts Institute of Technology, Cambridge, MA, USA.
Horn, B.K.P. 1986. Robot Vision. The MIT Press.
Jarvis, R.A. 1983. A perspective on range finding techniques for computer vision. IEEE Trans. on Pattern Analysis and Machine Intelligence, 5(2):122-139.
Jolion, J.M. and Rosenfeld, A. 1994.APyramidFramework for Early Vision. Kluwer Academic Publishers: Boston, MA.
Kingslake, R. 1983. Optical System Design. Academic Press.
Krotkov, E. 1987. Focusing. Intl. Journal of Computer Vision, 1:223- 237.
Nayar, S.K. and Nakagawa, Y. 1994. Shape from focus: An effective approach for rough surfaces. IEEE Trans. on Pattern Analysis and Machine Intelligence, 16(8):824-831.
Nayar, S.K., Watanabe, M., and Noguchi, M. 1995. Real-time focus range sensor. In Proc. of Intl. Conf. on Computer Vision, pp. 995- 1001.
Oppenheim, A.V. and Schafer, R.W. 1989. Discrete-Time Signal Processing. Prentice Hall: Englewood Cliffs, NJ.
Peitgen, H.O. and Saupe, D. (Eds.) 1988. The Science of Fractal Images. Springer-Verlag: New York, NY.
Pentland, A. 1987. A new sense for depth of field. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9(4):523-531.
Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C. Cambridge University Press.
Subbarao, M. 1988. Parallel depth recovery by changing camera parameters. In Proc. of Intl. Conf. on Computer Vision, pp. 149- 155.
Subbarao, M. and Surya, G. 1994. Depth from defocus: A spatial domain approach. International Journal of Computer Vision, 13(3):271-294.
Watanabe, M., Nayar, S.K., and Noguchi, M. 1995. Real-time computation of depth from defocus. In Proc. of SPIE: Three-Dimensional and Unconventional Imaging for Industrial Inspection and Metrology, 2599:A-03.
Watanabe, M. and Nayar, S.K. 1995a. Minimal operator set for texture invariant depth from defocus. Technical Report CUCS-031-95, Dept. of Computer Science, Columbia University, New York, NY, USA.
Watanabe, M. and Nayar, S.K. 1995b. Telecentric optics for constantmagnification imaging. Technical Report CUCS-026-95, Dept. of Computer Science, Columbia University, New York, NY, USA.
Wolberg, G. 1990. Digital Image Warping. IEEE Compter Society Press: Los Alamitos, CA.
Xiong, Y. and Shafer, S.A. 1993. Depth from focusing and defocusing. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 68-73. Also, Technical Report CMU-RI-TR-93-07, Pittsburgh, PA, USA.
Xiong, Y. and Shafer, S.A. 1995. Moment filters for high precision computation of focus and stereo. In Proc. of IROS, pp. 108- 113. Also, Technical Report CMU-RI-TR-94-28, Pittsburgh, PA, USA.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Watanabe, M., Nayar, S.K. Rational Filters for Passive Depth from Defocus. International Journal of Computer Vision 27, 203–225 (1998). https://doi.org/10.1023/A:1007905828438
Issue Date:
DOI: https://doi.org/10.1023/A:1007905828438