Skip to main content

Stereo Fusion Using a Refractive Medium on a Binocular Base

  • Conference paper
  • First Online:
Computer Vision -- ACCV 2014 (ACCV 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9004))

Included in the following conference series:

Abstract

The performance of depth reconstruction in binocular stereo relies on how adequate the predefined baseline for a target scene is. Wide-baseline stereo is capable of discriminating depth better than the narrow one, but it often suffers from spatial artifacts. Narrow-baseline stereo can provide a more elaborate depth map with less artifacts, while its depth resolution tends to be biased or coarse due to the short disparity. In this paper, we propose a novel optical design of heterogeneous stereo fusion on a binocular imaging system with a refractive medium, where the binocular stereo part operates as wide-baseline stereo; the refractive stereo module works as narrow-baseline stereo. We then introduce a stereo fusion workflow that combines the refractive and binocular stereo algorithms to estimate fine depth information through this fusion design. The quantitative and qualitative results validate the performance of our stereo fusion system in measuring depth, compared with homogeneous stereo approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. (IJCV) 47, 7–42 (2002)

    Article  MATH  Google Scholar 

  2. Rhemann, C., Hosni, A., Bleyer, M., Rother, C., Gelautz, M.: Fast cost-volume filtering for visual correspondence and beyond. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), pp. 3017–3024. IEEE (2011)

    Google Scholar 

  3. Okutomi, M., Kanade, T.: A multiple-baseline stereo. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 15, 353–363 (1993)

    Article  Google Scholar 

  4. Zilly, F., Riechert, C., Mller, M., Eisert, P., Sikora, T., Kauff, P.: Real-time generation of multi-view video plus depth content using mixed narrow and wide baseline. J. Vis. Commun. Image Represent. 25, 632–648 (2013)

    Article  Google Scholar 

  5. Gao, C., Ahuja, N.: Single camera stereo using planar parallel plate. In: Proceedings of the International Conference on Pattern Recognition (ICPR), vol. 4, pp. 108–111 (2004)

    Google Scholar 

  6. Gao, C., Ahuja, N.: A refractive camera for acquiring stereo and super-resolution images. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), pp. 2316–2323 (2006)

    Google Scholar 

  7. Chen, Z., Wong, K.Y.K., Matsushita, Y., Zhu, X.: Depth from refraction using a transparent medium with unknown pose and refractive index. Int. J. Comput. Vis. (ICJV) 102, 1–15 (2013)

    Article  MathSciNet  Google Scholar 

  8. Gallup, D., Frahm, J.M., Mordohai, P., Pollefeys, M.: Variable baseline/resolution stereo. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)

    Google Scholar 

  9. Nakabo, Y., Mukai, T., Hattori, Y., Takeuchi, Y., Ohnishi, N.: Variable baseline stereo tracking vision system using high-speed linear slider. In: Proceedings of the International Conference on Robotics and Automation (ICRA), pp. 1567–1572 (2005)

    Google Scholar 

  10. Nishimoto, Y., Shirai, Y.: A feature-based stereo model using small disparities. In: Proceedings of the Computer Vision and Pattern Recognition (CVPR), pp. 192–196 (1987)

    Google Scholar 

  11. Lee, D., Kweon, I.: A novel stereo camera system by a biprism. IEEE Trans. Robot. Autom. 16, 528–541 (2000)

    Article  Google Scholar 

  12. Shimizu, M., Okutomi, M.: Reflection stereo-novel monocular stereo using a transparent plate. In: Proceedings of the Canadian Conference on Computer and Robot Vision (CRV), pp. 14–14. IEEE (2006)

    Google Scholar 

  13. Shimizu, M., Okutomi, M.: Monocular range estimation through a double-sided half-mirror plate. In: Proceedings of the Canadian Conference on Computer and Robot Vision (CRV), pp. 347–354. IEEE (2007)

    Google Scholar 

  14. Chen, Z., Wong, K., Matsushita, Y., Zhu, X., Liu, M.: Self-calibrating depth from refraction. In: Proceedings of the International Conference on Computer Vision (ICCV), pp. 635–642 (2011)

    Google Scholar 

  15. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. (IJCV) 60, 91–110 (2004)

    Article  Google Scholar 

  16. Hecht, E.: Optics. Addison-Wesley, Reading (1987)

    Google Scholar 

  17. Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 22, 1330–1334 (2000)

    Article  Google Scholar 

  18. Kim, M.H., Kautz, J.: Characterization for high dynamic range imaging. Comput. Graph. Forum (Proc. EUROGRAPHICS 2008) 27, 691–697 (2008)

    Article  Google Scholar 

  19. Kim, C., Zimmer, H., Pritch, Y., Sorkine-Hornung, A., Gross, M.: Scene reconstruction from high spatio-angular resolution light fields. ACM Trans. Graph. (TOG) 32(73), 1–12 (2013)

    Google Scholar 

  20. Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. Wiley, New York (1973)

    MATH  Google Scholar 

  21. Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 24, 603–619 (2002)

    Article  Google Scholar 

  22. Yoon, K.J., Kweon, I.S.: Adaptive support-weight approach for correspondence search. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 28, 650–656 (2006)

    Article  Google Scholar 

  23. Ma, Z., He, K., Wei, Y., Sun, J., Wu, E.: Constant time weighted median filtering for stereo matching and beyond. In: Proceedings of the International Conference on Computer Vision (ICCV), pp. 1–8 (2013)

    Google Scholar 

  24. He, K., Sun, J., Tang, X.: Guided image filtering. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 1–14. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  25. Barnard, S.T.: Stochastic stereo matching over scale. Int. J. Comput. Vis. (IJCV) 3, 17–32 (1989)

    Article  Google Scholar 

  26. Chen, J.S., Medioni, G.: Parallel multiscale stereo matching using adaptive smoothing. In: Faugeras, O. (ed.) ECCV 1990. LNCS, vol. 427, pp. 99–103. Springer, Heidelberg (1990)

    Chapter  Google Scholar 

  27. Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 23, 1222–1239 (2001)

    Article  Google Scholar 

Download references

Acknowledgement

Min H. Kim gratefully acknowledges Korea NRF grants (2013R1A1A1010165 and 2013M3A6A6073718) and additional support by Microsoft Research Asia and an ICT R&D program of MSIP/IITP (10041313).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Min H. Kim .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Baek, SH., Kim, M.H. (2015). Stereo Fusion Using a Refractive Medium on a Binocular Base. In: Cremers, D., Reid, I., Saito, H., Yang, MH. (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science(), vol 9004. Springer, Cham. https://doi.org/10.1007/978-3-319-16808-1_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-16808-1_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-16807-4

  • Online ISBN: 978-3-319-16808-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics