Skip to main content
SpringerLink
Log in
Book cover

Asian Conference on Computer Vision

ACCV 2006: Computer Vision – ACCV 2006 pp 761–770Cite as

Correspondence Search in the Presence of Specular Highlights Using Specular-Free Two-Band Images

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 3852))

Abstract

In this paper, we present a new method to deal with specular highlights in correspondence search. The proposed method is essentially based on the specular-free two-band image that we introduce to deal with specular reflection. For given input images, specular-free two-band images are generated using simple pixel-wise computations in real-time. Specular-free two-band images are then used to compute per-pixel raw matching costs. By using the specular-free two-band images instead of input images, reliable raw matching costs that are independent of the specularities of image pixels are obtained. As a result, we can find correct correspondences even in the presence of specular highlights. Experimental results show that the proposed method successfully produces accurate disparity maps for stereo images with specular highlights.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kanade, T., Okutomi, M.: A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment. IEEE Trans. Pattern Analysis and Machine Intelligence 16, 920–932 (1994)

    Article  Google Scholar 

  2. Bobick, A.F., Intille, S.S.: Large Occlusion Stereo. Int’l J. Computer Vision 33, 181–200 (1999)

    Article  Google Scholar 

  3. Kang, S.B., Szeliski, R., Jinxjang, C.: Handling Occlusions in Dense Multi-View Stereo. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 103–110 (2001)

    Google Scholar 

  4. Kolmogorov, V., Zabih, R.: Computing Visual Correspondence with Occlusions using Graph Cuts. In: Proc. Int’l Conf. Computer Vision, vol. 2, pp. 508–515 (2001)

    Google Scholar 

  5. Veksler, O.: Stereo Correspondence with Compact Windows via Minimum Ratio Cycle. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 1654–1660 (2002)

    Article  Google Scholar 

  6. Yoon, K., Kweon, I.-S.: Locally Adaptive Support-Weight Approach for Visual Correspondence Search. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 924–931 (2005)

    Google Scholar 

  7. Scharstein, D., Szeliski, R.: A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithm. Int’l J. Computer Vision 47, 7–42 (2002)

    Article  MATH  Google Scholar 

  8. Bhat, D.N., Nayar, S.K.: Stereo and Specular Reflection. Int’l J. Computer Vision 26, 91–106 (1998)

    Article  Google Scholar 

  9. Zickler, T.E., Belhumeur, P.N., Kriegman, D.J.: Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction. Int’l J. Computer Vision 49, 215–227 (2002)

    Article  MATH  Google Scholar 

  10. Li, Y., Lin, S., Lu, H., Kang, S.B., Shum, H.-Y.: Multibaseline Stereo in the Presence of Specular Reflections. In: Proc. Int’l Conf. Pattern Recognetion, pp. 573–576 (2002)

    Google Scholar 

  11. Lin, S., Li, Y., Kang, S.B., Tong, X., Shum, H.-Y.: Diffuse-Specular Separation and Depth Recovery from Image Sequences. In: Proc. European Conf. Computer Vision, pp. 210–224 (2002)

    Google Scholar 

  12. Kim, J., Kolmogorov, V., Zabih, R.: Visual Correspondence Using Energy Minimization and Mutual Information. In: Proc. Int’l Conf. Computer Vision, pp. 1033–1040 (2003)

    Google Scholar 

  13. Yang, R., Pollefeys, M., Welch, G.: Dealing with Textureless Regions and Specular Highlights — A Progressive Space Carving Scheme Using a Novel Photo-consistency Measure. In: Proc. Int’l Conf. Computer Vision, pp. 576–584 (2003)

    Google Scholar 

  14. Tan, R.T., Ikeuchi, K.: Separating Reflection Components of Textured Surfaces using a Single Image. In: Int’l Conf. Computer Vision, pp. 870–877 (2003)

    Google Scholar 

  15. Tan, R.T., Ikeuchi, K.: Reflection Components Decomposition of Textured Surfaces using Linear Basis Functions. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 125–131 (2005)

    Google Scholar 

  16. Shafer, S.: Using Color to Separate Reflection Components. Color Res. Appl. 10, 210–218 (1985)

    Article  Google Scholar 

  17. Lee, H.-C., Breneman, E.J., Schulte, C.P.: Modeling Light Reflection for Computer Color Vision. IEEE Trans. Pattern Analysis and Machine Intelligence 12, 402–409 (1990)

    Article  Google Scholar 

  18. Tan, R.T., Nishono, K., Ikeuchi, K.: Color Constancy Through Inverse-Intensity Chromaticity Space. J. Opt. Soc. Amer. A (JOSA A) 21, 321–334 (2004)

    Article  Google Scholar 

  19. Klinker, G.J., Shafer, S.A., Kanade, T.: A Physical Approach to Color Image Understanding. Int’l J. Computer Vision 4, 7–38 (1990)

    Article  Google Scholar 

  20. Finlayson, G.D., Schaefer, G.: Solving for Color Constancy Using a Constrained Dichromatic Reflection Model. Int’l J. Computer Vision 42, 127–144 (2001)

    Article  MATH  Google Scholar 

  21. Lee, H.C.: Method for Computing the Scene-Illuminant Chromaticity from Specular Highlights. J. Opt. Soc. Am. A 3, 29–33 (1986)

    Article  Google Scholar 

  22. Lehmann, T.M., Palm, C.: Color Line Search for Illuminant Estimation in Real-World Scenes. J. Opt. Soc. Am. A 18, 2679–2691 (2001)

    Article  Google Scholar 

  23. Miyazaki, D., Tan, R.T., Hara, K., Ikeuchi, K.: Polarization-based Inverse Rendering from a Single View. In: Proc. Int’l Conf. Computer Vision, pp. 982–987 (2003)

    Google Scholar 

  24. Mallick, S., Zickler, T., Kriegman, D., Belhumeur, P.: Beyond Lambert: Reconstructing Specular Surfaces Using Color. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 619–626 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Robotics and Computer Vision Lab., Dept. Electrical Engineering and Computer Science, KAIST, Korea

    Kuk-Jin Yoon & In-So Kweon

Authors
  1. Kuk-Jin Yoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. In-So Kweon
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for Visual Information Technology, International Institute of Information Technology, Hyderabad, India

    P. J. Narayanan

  2. Department of Computer Science, Columbia University, 500 West 120th Street, NY 10027, New York, USA

    Shree K. Nayar

  3. Microsoft Research Asia, P.O. Box, Beijing, P.R. China

    Heung-Yeung Shum

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yoon, KJ., Kweon, IS. (2006). Correspondence Search in the Presence of Specular Highlights Using Specular-Free Two-Band Images. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3852. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612704_76

Download citation

  • DOI: https://doi.org/10.1007/11612704_76

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-31244-4

  • Online ISBN: 978-3-540-32432-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation