Skip to main content

An Experimental Comparison of Stereo Algorithms

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1883))

Abstract

While many algorithms for computing stereo correspondence have been proposed, there has been very little work on experimentally evaluating algorithm performance, especially using real (rather than synthetic) imagery. In this paper we propose an experimental comparison of several different stereo algorithms. We use real imagery, and explore two different methodologies, with different strengths and weaknesses. Our first methodology is based upon manual computation of dense ground truth. Here we make use of a two stereo pairs: one of these, from the University of Tsukuba, contains mostly fronto-parallel surfaces; while the other, which we built, is a simple scene with a slanted surface. Our second methodology uses the notion of prediction error, which is the ability of a disparity map to predict an (unseen) third image, taken from a known camera position with respect to the input pair. We present results for both correlation-style stereo algorithms and techniques based on global methods such as energy minimization. Our experiments suggest that the two methodologies give qualitatively consistent results. Source images and additional materials, such as the implementations of various algorithms, are available on the web from http://www.research.microsoft.com/~szeliski/stereo.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. H.H. Baker and T.O. Binford. Depth from edge and intensity based stereo. In IJCAI81, pages 631–636, 1981.

    Google Scholar 

  2. Stephen Barnard. Stochastic stereo matching over scale. International Journal of Computer Vision, 3(1):17–32, 1989.

    Article  MathSciNet  Google Scholar 

  3. J.L Barron, D.J. Fleet, and S.S. Beauchemin. Performance of optical flow techniques. International Journal of Computer Vision, 12(1):43–77, February 1994.

    Google Scholar 

  4. P. N. Belhumeur and D. Mumford. A Bayesian treatment of the stereo correspondence problem using half-occluded regions. In Computer Vision and Pattern Recognition, pages 506–512, Champaign-Urbana, Illinois, 1992.

    Google Scholar 

  5. Michael Black and P. Anandan. A framework for the robust estimation of optical flow. In 4th International Conference on Computer Vision, pages 231–236, 1993.

    Google Scholar 

  6. Andrew Blake. Comparison of the efficiency of deterministic and stochastic algorithms for visual reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(1):2–12, January 1989.

    Google Scholar 

  7. Yuri Boykov, Olga Veksler, and Ramin Zabih. Fast approximate energy minimization via graph cuts. In Seventh International Conference on Computer Vision (ICCV’99), pages 377–384, Kerkyra, Greece, September 1999.

    Google Scholar 

  8. Lisa Brown. A survey of image registration techniques. ACM Computing Surveys, 24(4):325–376, December 1992.

    Google Scholar 

  9. I. Cox, S. Hingorani, S. Rao, and B. Maggs. A maximum likelihood stereo algorithm. Computer Vision, Graphics and Image Processing, 63(3):542–567, 1996.

    Article  Google Scholar 

  10. U. Dhond and J. Aggarwal. Structure from stereo — a review. IEEE Transactions on Systems, Man and Cybernetics, 19(6), 1989.

    Google Scholar 

  11. Davi Geiger and Federico Girosi. Parallel and deterministic algorithms from MRF’s: Surface reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(5):401–412, May 1991.

    Google Scholar 

  12. S. Geman and D. Geman. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6:721–741, 1984.

    MATH  Google Scholar 

  13. Y. C. Hsieh, D. McKeown, and F. P. Perlant. Performance evaluation of scene registration and stereo matching for cartographic feature extraction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):214–238, February 1992.

    Google Scholar 

  14. S. S. Intille and A. F. Bobick. Disparity-space images and large occlusion stereo. In Proc. Third European Conference on Computer Vision (ECCV’94), volume 1, Stockholm, Sweden, May 1994. Springer-Verlag.

    Google Scholar 

  15. H. Ishikawa and D. Geiger. Occlusions, discontinuities, and epipolar lines in stereo. In Fifth European Conference on Computer Vision (ECCV’98), pages 332–248, Freiburg, Germany, June 1998. Springer-Verlag.

    Google Scholar 

  16. Y. G. Leclerc, Q.-T. Luong, and P. Fua. Self-consistency: A novel approach to characterizing the accuracy and reliability of point correspondence algorithms. In DARPA Image Understanding Workshop, Monterey, California, November 1998.

    Google Scholar 

  17. Peter Rousseeuw and Annick Leroy. Robust Regression and Outlier Detection. New York: Wiley, 1987.

    MATH  Google Scholar 

  18. S. Roy and I. J. Cox. A maximum-flow formulation of the n-camera stereo correspondence problem. In Sixth International Conference on Computer Vision (ICCV’98), pages 492–499, Bombay, January 1998.

    Google Scholar 

  19. D. Scharstein and R. Szeliski. Stereo matching with nonlinear diffusion. International Journal of Computer Vision, 28(2):155–174, July 1998.

    Google Scholar 

  20. R. Szeliski. Prediction error as a quality metric for motion and stereo. In Seventh International Conference on Computer Vision (ICCV’99), pages 781–788, Kerkyra, Greece, September 1999.

    Google Scholar 

  21. Olga Veksler. Efficient Graph-based Energy Minimization Methods in Computer Vision. PhD thesis, Cornell University, July 1999.

    Google Scholar 

  22. G. Wolberg and T. Pavlidis. Restoration of binary images using stochastic relaxation with annealing. Pattern Recognition Letters, 3:375–388, 1985.

    Article  Google Scholar 

  23. Charles Zitnick and Takeo Kanade. A cooperative algorithm for stereo matching and occlusion detection. Technical Report CMU-RI-TR-99-35, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, October 1999.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Szeliski, R., Zabih, R. (2000). An Experimental Comparison of Stereo Algorithms. In: Triggs, B., Zisserman, A., Szeliski, R. (eds) Vision Algorithms: Theory and Practice. IWVA 1999. Lecture Notes in Computer Science, vol 1883. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44480-7_1

Download citation

  • DOI: https://doi.org/10.1007/3-540-44480-7_1

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-67973-8

  • Online ISBN: 978-3-540-44480-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics