Abstract
While many algorithms for computing stereo correspondence have been proposed, there has been very little work on experimentally evaluating algorithm performance, especially using real (rather than synthetic) imagery. In this paper we propose an experimental comparison of several different stereo algorithms. We use real imagery, and explore two different methodologies, with different strengths and weaknesses. Our first methodology is based upon manual computation of dense ground truth. Here we make use of a two stereo pairs: one of these, from the University of Tsukuba, contains mostly fronto-parallel surfaces; while the other, which we built, is a simple scene with a slanted surface. Our second methodology uses the notion of prediction error, which is the ability of a disparity map to predict an (unseen) third image, taken from a known camera position with respect to the input pair. We present results for both correlation-style stereo algorithms and techniques based on global methods such as energy minimization. Our experiments suggest that the two methodologies give qualitatively consistent results. Source images and additional materials, such as the implementations of various algorithms, are available on the web from http://www.research.microsoft.com/~szeliski/stereo.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
H.H. Baker and T.O. Binford. Depth from edge and intensity based stereo. In IJCAI81, pages 631–636, 1981.
Stephen Barnard. Stochastic stereo matching over scale. International Journal of Computer Vision, 3(1):17–32, 1989.
J.L Barron, D.J. Fleet, and S.S. Beauchemin. Performance of optical flow techniques. International Journal of Computer Vision, 12(1):43–77, February 1994.
P. N. Belhumeur and D. Mumford. A Bayesian treatment of the stereo correspondence problem using half-occluded regions. In Computer Vision and Pattern Recognition, pages 506–512, Champaign-Urbana, Illinois, 1992.
Michael Black and P. Anandan. A framework for the robust estimation of optical flow. In 4th International Conference on Computer Vision, pages 231–236, 1993.
Andrew Blake. Comparison of the efficiency of deterministic and stochastic algorithms for visual reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(1):2–12, January 1989.
Yuri Boykov, Olga Veksler, and Ramin Zabih. Fast approximate energy minimization via graph cuts. In Seventh International Conference on Computer Vision (ICCV’99), pages 377–384, Kerkyra, Greece, September 1999.
Lisa Brown. A survey of image registration techniques. ACM Computing Surveys, 24(4):325–376, December 1992.
I. Cox, S. Hingorani, S. Rao, and B. Maggs. A maximum likelihood stereo algorithm. Computer Vision, Graphics and Image Processing, 63(3):542–567, 1996.
U. Dhond and J. Aggarwal. Structure from stereo — a review. IEEE Transactions on Systems, Man and Cybernetics, 19(6), 1989.
Davi Geiger and Federico Girosi. Parallel and deterministic algorithms from MRF’s: Surface reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(5):401–412, May 1991.
S. Geman and D. Geman. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6:721–741, 1984.
Y. C. Hsieh, D. McKeown, and F. P. Perlant. Performance evaluation of scene registration and stereo matching for cartographic feature extraction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):214–238, February 1992.
S. S. Intille and A. F. Bobick. Disparity-space images and large occlusion stereo. In Proc. Third European Conference on Computer Vision (ECCV’94), volume 1, Stockholm, Sweden, May 1994. Springer-Verlag.
H. Ishikawa and D. Geiger. Occlusions, discontinuities, and epipolar lines in stereo. In Fifth European Conference on Computer Vision (ECCV’98), pages 332–248, Freiburg, Germany, June 1998. Springer-Verlag.
Y. G. Leclerc, Q.-T. Luong, and P. Fua. Self-consistency: A novel approach to characterizing the accuracy and reliability of point correspondence algorithms. In DARPA Image Understanding Workshop, Monterey, California, November 1998.
Peter Rousseeuw and Annick Leroy. Robust Regression and Outlier Detection. New York: Wiley, 1987.
S. Roy and I. J. Cox. A maximum-flow formulation of the n-camera stereo correspondence problem. In Sixth International Conference on Computer Vision (ICCV’98), pages 492–499, Bombay, January 1998.
D. Scharstein and R. Szeliski. Stereo matching with nonlinear diffusion. International Journal of Computer Vision, 28(2):155–174, July 1998.
R. Szeliski. Prediction error as a quality metric for motion and stereo. In Seventh International Conference on Computer Vision (ICCV’99), pages 781–788, Kerkyra, Greece, September 1999.
Olga Veksler. Efficient Graph-based Energy Minimization Methods in Computer Vision. PhD thesis, Cornell University, July 1999.
G. Wolberg and T. Pavlidis. Restoration of binary images using stochastic relaxation with annealing. Pattern Recognition Letters, 3:375–388, 1985.
Charles Zitnick and Takeo Kanade. A cooperative algorithm for stereo matching and occlusion detection. Technical Report CMU-RI-TR-99-35, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, October 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Szeliski, R., Zabih, R. (2000). An Experimental Comparison of Stereo Algorithms. In: Triggs, B., Zisserman, A., Szeliski, R. (eds) Vision Algorithms: Theory and Practice. IWVA 1999. Lecture Notes in Computer Science, vol 1883. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44480-7_1
Download citation
DOI: https://doi.org/10.1007/3-540-44480-7_1
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67973-8
Online ISBN: 978-3-540-44480-0
eBook Packages: Springer Book Archive