Abstract
Depth map is a critical factor in Depth-Image-Based-Rendering system. Conventionally the depth map is encoded with the block-based method, such as H.264/AVC or some MVC methods. The traditional coding strategy cannot guarantee the quality of the boundary of the objects in the depth map. The distortion on boundary will cause unrecoverable distortions in the synthesized view. To guarantee the precision of the object boundary, we proposed a Contour Based Depth map Coding (CBDC) method. In the proposal, depth maps are divided into several layers in the depth dimension and further segmented into regions. Each region is regarded to be made up of contours and interiors. We adopted a lossless vectorized method to represent the contour and a lossy dynamical modeling method to represent the interior. This paper is based on our previous work, which is a preliminary framework of the CBDC. In this paper, two further contributions are illustrated. One is a data structure improvement of contour bypassing. Redundant contour segments are bypassed under our proposed rules. Experimental result shows that the bypassing strategy reduces 40% to 60% bit cost for the CBDC. Compared with other contour based coding strategy, the improved CBDC achieves higher quality of the synthesized view and better coding efficiency. Compared with block-based method, CBDC achieves much higher image quality (3–15 dB) in high bitrate scenarios. The other contribution is about the parallel process design of CBDC. The layer-region structure is with relatively low data dependency. Taking that advantage, we implemented and evaluated the parallel structure of CBDC. Experimental results show that the parallelized process speeds up by as much as 1.8 to 2.5 times when 2 to 4 process units are employed. Up to 90% parallel efficiency is achieved when 2 process units is employed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE, Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93–104 (2004)
Ugur, K., Liu, H., Lainema, J., Gabbouf, M., Li, H.: Parallel encoding - decoding operation for multiview video coding with high coding efficiency. In: 3DTV Conference 2007, 7–9 May 2007
Liu, D., Sun, X., Wu, F.: Intra prediction via edge-based inpainting. In: Data Compression Conference, DCC 2008, pp. 282–291 (2008)
Liu, D., Sun, X., Wu, F.: Edge-based inpainting and texture synthesis for image compression. In: IEEE International Conference on Multimedia and Expo, pp. 1443–1446 (2007)
Chaumont, M., Pateux, S., Nicolas, H.: Object-based video coding using a dynamic coding approach. In: International Conference on Image Processing, ICIP 2004, 24–27 October 2004
Liu, X., Chang, Y., Li, Z., Yuan, H.: A depth estimation method for edge precision improvement of depth map. In: International Conference on Computer and Communication Technologies in Agriculture Engineering (CCTAE), 12–13 June 2010
Wang, M., He, X., Jin, X., Goto, S.: Framework of contour based depth map coding system. In: The 2011 Pacific-Rim Conference on Multimedia (PCM 2011), Sydney, Australia, 20-22 December 2011
Yea, S., Vetro, A.: Multi-layered coding of depth for virtual view synthesis. In: Proceedings of Picture Coding Symposium (PCS 2009), Chicago, USA, May 2009
TrueType specification (Apple): http://developer.apple.com/fonts/TTRefMan/index.html
Wang, M., He, X., Jin, X., Goto, S.: Region-interior painting in contour based depth map coding system. In: 2011 IEEE 18th International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), ChiangMai, Thailand, 7–9 December 2011
Pinheiro, A., Ghanbari, M.: Piecewise approximation of contours through scale-space selection of dominant points. IEEE Trans. Image Process. 19(6), 1442–1450 (2010)
Jager, F.: Contour-based segmentation and coding for depth map compression. In: Visual Communications and Image Processing, November 2011
Connected component labeling. http://en.wikipedia.org/wiki/Connected-component_labeling
El-Yamany, N.A., Ugur, K., Hannuksela, M.M., Gabbouj, M.: Evaluation of depth compression and view synthesis distortions in multiview-video-plus-depth coding systems. In: 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 7–9 June 2010
Cheung, N.M., Au, O.C., Kung, M.C., Wong, P.H.W., Liu, C.H.: Highly parallel rate-distortion optimized intra-mode decision on multicore graphics processors. IEEE Trans. Circuits Syst. Video Technol. 19(11), 1692–1703 (2009)
Acknowledgments
This research was supported by A Project [16ZA0131] which supported by Scientific Research Fund of Sichuan Provincial Education Department, [2018GZ0517] which supported by Sichuan Provincial Science and Technology Department, Science and Technology Planning Project of Guangdong Province [2017B010110007], [2018KF003] Supported by State Key Laboratory of ASIC & System.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Yu, W. et al. (2018). Parallelized Contour Based Depth Map Coding in DIBR. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11164. Springer, Cham. https://doi.org/10.1007/978-3-030-00776-8_59
Download citation
DOI: https://doi.org/10.1007/978-3-030-00776-8_59
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00775-1
Online ISBN: 978-3-030-00776-8
eBook Packages: Computer ScienceComputer Science (R0)