Abstract
In underwater imaging, refraction changes the geometry of image formation, causing the perspective camera model to be invalid. Hence, a systematic model error occurs when computing 3D models using the perspective camera model. This paper deals with the problem of computing dense depth maps of underwater scenes with explicit incorporation of refraction of light at the underwater housing. It is assumed that extrinsic, intrinsic, and housing parameters have been calibrated for all cameras. Due to the refractive camera’s characteristics it is not possible to directly apply epipolar geometry or rectification to images because the single-view-point model and, consequently, homographies are invalid. Additionally, the projection of 3D points into the camera cannot be computed efficiently, but requires solving a 12th degree polynomial. Therefore, the method proposed is an adapted plane sweep algorithm that is based on the idea of back-projecting rays for each pixel and view onto the 3D-hypothesis planes using the GPU. This allows to efficiently warp all images onto the plane, where they can be compared. Consequently, projections of 3D points and homographies are not utilized.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Agrawal, A., Ramalingam, S., Taguchi, Y., Chari, V.: A theory of multi-layer flat refractive geometry. In: CVPR (2012)
Chang, Y.J., Chen, T.: Multi-view 3d reconstruction for scenes under the refractive plane with known vertical direction. In: IEEE International Conference on Computer Vision (ICCV) (2011)
Chari, V., Sturm, P.: Multiple-view geometry of the refractive plane. In: Proceedings of the 20th British Machine Vision Conference, London, UK (September 2009)
Costa, C., Loy, A., Cataudella, S., Davis, D., Scardi, M.: Extracting fish size using dual underwater cameras. Aquacultural Engineering 35(3), 218–227 (2006)
Eustice, R., Singh, H., Howland, J.: Image registration underwater for fluid flow measurements and mosaicking. In: OCEANS 2000 MTS/IEEE Conference and Exhibition, vol. 3, pp. 1529–1534 (2000)
Fryer, J.G., Fraser, C.S.: On the calibration of underwater cameras. The Photogrammetric Record 12, 73–85 (1986)
Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. IEEE Trans. on Pattern Analysis and Machine Intelligence 32(8), 1362–1376 (2010)
Gallup, D., Frahm, J.M., Mordohai, P., Yang, Q., Pollefeys, M.: Real-time plane-sweeping stereo with multiple sweeping directions. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8 (2007)
Grossberg, M.D., Nayar, S.K.: The raxel imaging model and ray-based calibration. International Journal of Computer Vision 61(2), 119–137 (2005)
Hirschmueller, H.: Improvements in real-time correlation-based stereo vision. In: Proc. of IEEE Workshop on Stereo and Multi-Baseline Vision, Kauai, Hawaii (2001)
Johnson-Roberson, M., Pizarro, O., Williams, S., Mahon, I.: Generation and visualization of large-scale three-dimensional reconstructions from underwater robotic surveys. Journal of Field Robotics 27 (2010)
Jordt-Sedlazeck, A., Koch, R.: Refractive calibration of underwater cameras. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part V. LNCS, vol. 7576, pp. 846–859. Springer, Heidelberg (2012)
Kang, L., Wu, L., Yang, Y.H.: Two-view underwater structure and motion for cameras under flat refractive interfaces. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 303–316. Springer, Heidelberg (2012)
Maas, H.G.: New developments in multimedia photogrammetry. In: Optical 3-D Measurement Techniques III. Wichmann Verlag, Karlsruhe (1995)
do Nascimento, E.R., Campos, M.F.M., de Barros, W.F.: Stereo based structure recovery of underwater scenes from automatically restored images. In: Proceedings SIBGRAPI 2009 (Brazilian Symposium on Computer Graphics and Image Processing), October 11-14 (2009)
Schechner, Y.Y., Karpel, N.: Clear underwater vision. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 1, pp. I-536–I-543 (2004)
Sedlazeck, A., Koser, K., Koch, R.: 3d reconstruction based on underwater video from rov kiel 6000 considering underwater imaging conditions. In: Proc. OCEANS 2009, OCEANS 2009-EUROPE, pp. 1–10 (2009)
Sturm, P., Ramalingam, S., Lodha, S.: On calibration, structure from motion and multi-view geometry for generic camera models. In: Daniilidis, K., Klette, R. (eds.) Imaging Beyond the Pinhole Camera, Computational Imaging and Vision, vol. 33. Springer (2006)
Szeliski, R.: Computer Vision Algorithms and Applications. Springer (2011)
Treibitz, T., Schechner, Y., Singh, H.: Flat refractive geometry. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jordt-Sedlazeck, A., Jung, D., Koch, R. (2013). Refractive Plane Sweep for Underwater Images. In: Weickert, J., Hein, M., Schiele, B. (eds) Pattern Recognition. GCPR 2013. Lecture Notes in Computer Science, vol 8142. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40602-7_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-40602-7_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40601-0
Online ISBN: 978-3-642-40602-7
eBook Packages: Computer ScienceComputer Science (R0)