Abstract
Color-guided depth image restoration is an issue of great interest. However, the edge in color image is not always consistent with the depth image. There is a certain relationship between the shading component of RGB image and the depth, so a depth image restoration method is proposed with shading structure guidance. First, the RGB image is decomposed into the shading component and the reflectance component based on Retinex Theory; next, calculate the structure tensors of the shading component and the depth image respectively, and the corresponding eigenvalues and eigenvectors; then, design the diffusion tensor with the eigenvalues and eigenvectors of the depth structure tensor to make the diffusion be along the level lines isophotes, finally the shading structure is introduced to inhibit the diffusion in the direction perpendicular to the edge, and the depth image is restored by diffusion. Experiments show, visually and quantitatively, the better restoration results are achieved by the introduction of the shading structure.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zheng, J., Zuo, X., Ren, J., Wang, S.: Multiple depth maps integration for 3D reconstruction using geodesic graph cuts. Int. J. Softw. Eng. Knowl. Eng. 25(3), 473–492 (2015)
Zhao, D., Zheng, J., Ren, J.: Effective removal of artifacts from views synthesized using depth image based rendering, pp. 65–71 (2015)
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proceedings of 27th Annual Conference on Computer Graphics, New Orleans, pp. 417–422 (2000)
Benzarti, F., Amiri, H: Image inpainting via isophotes propagation. In: 6th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications, Sousse, pp. 359–364 (2012)
Shen, J.H., Kang, S.H., Chan, T.F.: Euler’s elastica and curvature-based inpainting. SIAM J. Math. Anal. 63(2), 564–592 (2002)
Shen, J.H., Chan, T.F.: Non-texure inpainting by curvature-driven diffusion. J. Vis. Commun. Image Represent. 12(4), 436–449 (2001)
Wu, J.Y., Ruan, Q.Q.: A novel exemplar-based image completion model. J. Inf. Sci. Eng. 25(2), 481–497 (2009)
Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, pp. 721–728 (2003)
Liu, W., Chen, X.G., Yang, J., Wu, Q.: Robust color guided depth map restoration. IEEE Trans. Image Process. 26(1), 315–327 (2017)
Lu, S., Ren, X.F., Liu, F.: Depth enhancement via low-rank matrix completion. In: IEEE Conference on Computer Vision and Pattern Recognition, Columbus, pp. 4321–4328 (2014)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–611 (2004)
Liu, M.Y., Tuzek, O., Taguohi, Y.: Joint geodesic upsampling of depth images. In: IEEE Conference on Computer Vision and Pattern Recognition, Portland, pp. 169–176 (2013)
Park, J., Kim, H., Tai, Y.W., Brown, M.S., Kweon, I.: High quality depth map upsampling for 3D-TOF cameras. In: IEEE International Conference on Computer Vision, Barcelona, pp. 1623–1630 (2011)
Wichkert, J.: Coherence-enhancing diffusion filtering. Int. J. Comput. Vis. 31, 111–127 (1999)
Ham, B., Min, D., Sohn, K.: Depth supersolution by transduction. IEEE Trans. Image Process. 24(5), 1524–1535 (2015)
Zosso, D., Tran, G., Osher, S.: A unifying Retinex model based on non-local differential operators. Proc. SPIE 8657, 1–12 (2013)
Wichkert, J.: Anisotropic Diffusion in Image Processing. Teubner-Verlag, Leipzig (1998)
Benzarit, F., Amiri, H.: Repairing and inpainting damaged image using diffusion. Int. J. Comput. Sci. 9(3), 1–7 (2012)
Zhou, Y., Zeng, F., Zhao, H., Murray, P., Ren, J.: Hierarchical visual perception and two-dimensional compressive sensing for effective content-based color image retrieval. Cogn. Comput. 8(5), 877–889 (2016)
Yan, Y., Ren, J., Li, Y., Chao, K.: Adaptive fusion of color and spatial features for noise-robust retrieval of colored logo and trademark images. Multidimension. Syst. Signal Process. 27(4), 945–968 (2016)
Acknowledgements
This work has been partially supported by the National Natural Science Foundation of China under Grant Nos. 6150238 and 61501370.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, X., Jin, H., Liu, Y., Shi, L. (2018). Shading Structure-Guided Depth Image Restoration. In: Ren, J., et al. Advances in Brain Inspired Cognitive Systems. BICS 2018. Lecture Notes in Computer Science(), vol 10989. Springer, Cham. https://doi.org/10.1007/978-3-030-00563-4_78
Download citation
DOI: https://doi.org/10.1007/978-3-030-00563-4_78
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00562-7
Online ISBN: 978-3-030-00563-4
eBook Packages: Computer ScienceComputer Science (R0)