Skip to main content
SpringerLink
Log in

Reconstruction of coarse depth estimates using hierarchical image partitions

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

This paper presents a novel depth map enhancement method which takes as inputs a single view and an associated coarse depth estimate. The depth estimate is reconstructed according to the region boundaries proposed within a set of image partitions of the associated view. Image partitions are determined through a color-based region merging procedure and organized within a hierarchy. Novel depth estimates are computed according to plane-fitting procedures using the proposed regions as support and selected coarse depth estimates. The use of partition hierarchies provides an efficient mechanism for evaluating plane-fitting results over various scales and, in this way, reduce the dependency of the results on the quality of a single color-based segmentation. Experimental results on publicly available test sequences illustrate the potential of the algorithm in significantly improving low quality depth estimates.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Call for proposals on 3d video coding technology. ISO/IEC JTC1/SC29/WG11 MPEG 2011/N12036, 2011.

  • Domanski, M., Grajek, T., Klimaszewski, K., Kurc, M., Stankiewicz, O., Stankowski, J., et al. (2009). Poznan multiview video test sequences and camera parameters. ISO/IEC JTC1/SC29/WG11 MPEG 2009/M17050.

  • Dorea C., Pardas M., Marques F. (2009) Trajectory tree as an object-oriented hierarchical representation for video. IEEE Transactions on Circuits and Systems for Video Technology 19(4): 547–560

    Article  Google Scholar 

  • Dorea, C., & de Queiroz, R. L. (2011). Depth map reconstruction using color-based region merging. In ICIP.

  • Ekmekcioglu, E., Velisavljevic, V., & Worrall, S. T. (2009). Edge and motion adaptive median filetring for multi-view depth enhancement. In Proceesings of PCS.

  • Garrido, L., & Salembier, P. (1998). Region based analysis of video sequences with a general merging algorithm. In EUSIPCO.

  • Huihai L., Woods J.C., Ghanbari M. (2007) Binary partition tree analysis based on region evolution and its application to tree simplification. IEEE Transactions on Image Processing 16(4): 1131–1138

    Article  MathSciNet  Google Scholar 

  • Kauff P., Atzpadin N., Fehn C., Muller K., Schreer O., Smolic A. et al (2007) Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. Image Communications 22: 217–234

    Google Scholar 

  • Kolb, A., Barth, E., Koch, R., & Larsen, R. (2009, March). Time-of-flight sensors in computer graphics. Eurographics (state-of-the-art report) (pp. 119–134).

  • Merkle, P., Smolic, A., Muller, K., & Wiegand, T. (2007). Multi-view video plus depth representation and coding. In Proceedings of PCS.

  • Muller, K., Smolic, A., Dix, K., Merkle, P., Kauff, P., & Wiegand, T. (2008). View synthesis for advanced 3D video systems. EURASIP Journal on Image and Video Processing, 2008, 1–11.

  • Oh K.J., Yea S., Vetro A., Ho Y.S. (2009) Depth reconstruction filter and down/up sampling for depth coding in 3D video. IEEE Signal Processing Letters, 16(9): 747–750

    Article  Google Scholar 

  • Reference software of depth estimation and view synthesis for FTV/3DV: ISO/IEC JTC1/SC29/WG11, M15386. October 2008.

  • Scharstein D., Szeliski R. (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47(1–3): 7–42

    Article  MATH  Google Scholar 

  • Tanimoto Lab at Nagoya University. (2008). http://www.tanimoto.nuee.nagoya-u.ac.jp/.

  • Torres-Mendez, L. A., & Dudek, G. (2004). Reconstruction of 3D models from intensity images and partial depth. In Proceecings of American Association for Artificial Intelligence.

  • Wang, L., Jin, H., Yang, R., & Gong, M. (2008). Stereoscopic inpainting: Joint color and depth completion from stereo images. In IEEE Proceedings of CVPR.

  • Wang Z., Bovik A.C., Sheikh H.R., Simoncelli E.P. (2004) Image quality assessment: From error measurement to structural similarity. IEEE Transactions on Image Processing 13(4): 600–612

    Article  Google Scholar 

  • Yang, Q., Yang, R., Davis, J., & Nister, D. (2007). Spatial-depth super resolution for range images. In IEEE Proceedings of CVPR.

  • Zhao, Y., Chen, Z., Tian, D., Zhu, C., & Yu, L. (2010). Suppressing texture-depth misalignment for boundary noise removal in view synthesis. In Proceedings of PCS.

  • Zitnick C.L., Kang S.B., Uyttendaele M., Winder S., Szeliski R. (2004) High-quality video view interpolation using a layered representation. ACM SIGGRAPH and Transactions on Graph 23: 600–608

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Brasilia, Brasilia, DF, 70919-970, Brazil

    Camilo Dorea & Ricardo L. de Queiroz

Authors
  1. Camilo Dorea
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ricardo L. de Queiroz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Camilo Dorea.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dorea, C., de Queiroz, R.L. Reconstruction of coarse depth estimates using hierarchical image partitions. Multidim Syst Sign Process 24, 379–393 (2013). https://doi.org/10.1007/s11045-012-0191-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11045-012-0191-6

Keywords

Search

Navigation