ABSTRACT
In recent years, the diffusion-based image compression scheme has achieved significant success, which inspires us to use diffusion theory to employ the diffusion model for point cloud attribute compression. However, the relevant existing methods cannot be used to deal with our task due to the irregular structure of point clouds. To handle this, we propose the partial differential equation (PDE) based progressive prediction framework for attribute compression of 3D point clouds. Firstly, we propose a PDE-based prediction module, which performs prediction by optimizing attribute gradients, allowing the geometric distribution of adjacent areas to be fully utilized and explaining the weighting method for prediction. Besides, we propose a low-complexity method for calculating partial derivative operations on point clouds to address the uncertainty of neighbor occupancy in three-dimensional space. In the proposed prediction framework, we design a two-layer level of detail (LOD) structure, where the attribute information in the high level is used for interpolating the low level by edge-enhancing anisotropic diffusion (EED) to infer local features from the high-level information. After the diffusion-based interpolation, we design a texture-wise prediction method making use of interpolated values and texture information. Experiment results show that our proposed framework achieves an average of 12.00% BD-rate reduction and 1.59% bitrate saving compared with Predlift (PLT) under attribute near-lossless and attribute lossless conditions, respectively. Furthermore, additional experiments demonstrate our proposed scheme has better texture preservation and subjective quality.
- Pierre Charbonnier, Laure Blanc-Féraud, Gilles Aubert, and Michel Barlaud. 1997. Deterministic edge-preserving regularization in computed imaging. IEEE Transactions on image processing, Vol. 6, 2 (1997), 298--311.Google ScholarDigital Library
- Jiafeng Chen, Lu Yu, and Wenyi Wang. 2022. Hilbert Space Filling Curve Based Scan-Order for Point Cloud Attribute Compression. IEEE Transactions on Image Processing, Vol. 31 (2022), 4609--4621.Google ScholarDigital Library
- WG 07 MPEG 3D Graphics Coding and Haptics Coding. 2023. Common test conditions for G-PCC. document ISO/IEC JTC1/SC29/WG11 w22425.Google Scholar
- Robert A Cohen, Dong Tian, and Anthony Vetro. 2016. Attribute compression for sparse point clouds using graph transforms. In 2016 IEEE International Conference on Image Processing (ICIP). IEEE, 1374--1378.Google ScholarCross Ref
- Ricardo L De Queiroz and Philip A Chou. 2016. Compression of 3D point clouds using a region-adaptive hierarchical transform. IEEE Transactions on Image Processing, Vol. 25, 8 (2016), 3947--3956.Google ScholarDigital Library
- Olivier Devillers and P-M Gandoin. 2000. Geometric compression for interactive transmission. In Proceedings Visualization 2000. VIS 2000 (Cat. No. 00CH37145). IEEE, 319--326.Google ScholarCross Ref
- Abderrahim Elmoataz, Olivier Lezoray, and Sébastien Bougleux. 2008. Nonlocal discrete regularization on weighted graphs: a framework for image and manifold processing. IEEE transactions on Image Processing, Vol. 17, 7 (2008), 1047--1060.Google Scholar
- Irena Galić, Joachim Weickert, Martin Welk, Andrés Bruhn, Alexander Belyaev, and Hans-Peter Seidel. 2005. Towards PDE-based image compression. In Variational, Geometric, and Level Set Methods in Computer Vision: Third International Workshop, VLSM 2005, Beijing, China, October 16, 2005. Proceedings. Springer, 37--48.Google Scholar
- Irena Galić, Joachim Weickert, Martin Welk, Andrés Bruhn, Alexander Belyaev, and Hans-Peter Seidel. 2008. Image compression with anisotropic diffusion. Journal of Mathematical Imaging and Vision, Vol. 31 (2008), 255--269.Google ScholarDigital Library
- Shuai Gu, Junhui Hou, Huanqiang Zeng, and Hui Yuan. 2020. 3D point cloud attribute compression via graph prediction. IEEE Signal Processing Letters, Vol. 27 (2020), 176--180.Google ScholarCross Ref
- Shuai Gu, Junhui Hou, Huanqiang Zeng, Hui Yuan, and Kai-Kuang Ma. 2019. 3D point cloud attribute compression using geometry-guided sparse representation. IEEE Transactions on Image Processing, Vol. 29 (2019), 796--808.Google ScholarDigital Library
- Stefan Gumhold, Zachi Kami, Martin Isenburg, and Hans-Peter Seidel. 2005. Predictive point-cloud compression. In ACM SIGGRAPH 2005 Sketches. 137--es.Google ScholarDigital Library
- Reetu Hooda and W David Pan. 2021. Early termination of dyadic region-adaptive hierarchical transform for efficient attribute compression of 3d point clouds. IEEE Signal Processing Letters, Vol. 29 (2021), 214--218.Google ScholarCross Ref
- Yan Huang, Jingliang Peng, C-C Jay Kuo, and M Gopi. 2008. A generic scheme for progressive point cloud coding. IEEE Transactions on Visualization and Computer Graphics, Vol. 14, 2 (2008), 440--453.Google ScholarDigital Library
- Birendra Kathariya, Vladyslav Zakharchenko, Zhu Li, and Jianle Chen. 2019. Level-of-detail generation using binary-tree for lifting scheme in LiDAR point cloud attributes coding. In 2019 data compression conference (DCC). IEEE, 580--580.Google Scholar
- Rongjie Lai, Jiang Liang, and Hongkai Zhao. 2013. A LOCAL MESH METHOD FOR SOLVING PDES ON POINT CLOUDS. Inverse Problems & Imaging, Vol. 7, 3 (2013).Google ScholarCross Ref
- Jian Liang, Rongjie Lai, Tsz Wai Wong, and Hongkai Zhao. 2012. Geometric understanding of point clouds using Laplace-Beltrami operator. In 2012 IEEE conference on computer vision and pattern recognition. IEEE, 214--221.Google ScholarCross Ref
- C Loop, Q Cai, SO Escolano, and PA Chou. 2016. Microsoft Voxelized Upper Bodies -- A Voxelized Point Cloud Dataset. document ISO/IEC JTC1/SC29/WG11 m38673.Google Scholar
- François Lozes, Abderrahim Elmoataz, and Olivier Lézoray. 2014. Partial difference operators on weighted graphs for image processing on surfaces and point clouds. IEEE Transactions on Image Processing, Vol. 23, 9 (2014), 3896--3909.Google ScholarCross Ref
- Chuang Ma, Ge Li, Qi Zhang, Yiting Shao, Jing Wang, and Shan Liu. 2020. Fast Recolor Prediction Scheme in Point Cloud Attribute Compression. In 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP). IEEE, 50--53.Google Scholar
- Markus Mainberger and Joachim Weickert. 2009. Edge-based image compression with homogeneous diffusion. In Computer Analysis of Images and Patterns: 13th International Conference, CAIP 2009, Münster, Germany, September 2-4, 2009. Proceedings 13. Springer, 476--483.Google ScholarDigital Library
- Khaled Mammou, Alexis Tourapis, Jungsun Kim, Fabrice Robinet, Valery Valentin, and Yeping Su. 2018. Lifting Scheme for Lossy Attribute Encoding in TMC1. document ISO/IEC JTC1/SC29/WG11 m42640.Google Scholar
- Khaled Mammou, Alexis M Tourapis, David Singer, and Yeping Su. 2017. Video-Based and Hierarchical Approaches Point Cloud Compression. document ISO/IEC JTC1/SC29/WG11 m41649.Google Scholar
- Christian Schmaltz, Pascal Peter, Markus Mainberger, Franziska Ebel, Joachim Weickert, and Andrés Bruhn. 2014. Understanding, optimising, and extending data compression with anisotropic diffusion. International Journal of Computer Vision, Vol. 108 (2014), 222--240.Google ScholarDigital Library
- Ruwen Schnabel and Reinhard Klein. 2006. Octree-based Point-Cloud Compression. PBG@ SIGGRAPH, Vol. 3 (2006).Google Scholar
- Sebastian Schwarz, Marius Preda, Vittorio Baroncini, Madhukar Budagavi, Pablo Cesar, Philip A Chou, Robert A Cohen, Maja Krivokuća, Sébastien Lasserre, Zhu Li, et al. 2018. Emerging MPEG standards for point cloud compression. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 9, 1 (2018), 133--148.Google ScholarCross Ref
- Yiting Shao, Qi Zhang, Ge Li, Zhu Li, and Li Li. 2018. Hybrid point cloud attribute compression using slice-based layered structure and block-based intra prediction. In Proceedings of the 26th ACM international conference on Multimedia. 1199--1207.Google ScholarDigital Library
- Yiting Shao, Zhaobin Zhang, Zhu Li, Kui Fan, and Ge Li. 2017. Attribute compression of 3D point clouds using Laplacian sparsity optimized graph transform. In 2017 IEEE Visual Communications and Image Processing (VCIP). IEEE, 1--4.Google Scholar
- Fei Song, Ge Li, Xiaodong Yang, Wei Gao, and Shan Liu. 2023. Block-Adaptive Point Cloud Attribute Coding with Region-Aware Optimized Transform. IEEE Transactions on Circuits and Systems for Video Technology (2023).Google ScholarDigital Library
- Lei Wei, Shuai Wan, Fuzheng Yang, Zhecheng Wang, et al. 2022. Content-Adaptive Level of Detail for Lossless Point Cloud Compression. APSIPA Transactions on Signal and Information Processing, Vol. 11, 1 (2022).Google ScholarCross Ref
- Zhang Wei, Yang Lihui, Yang Fuzheng, Tian Tengya, Champel Mary-Luc, and Gao Shuo. 2021. Neighbor Search Improvements for Attribute LoD Prediction. document ISO/IEC JTC1/SC29/WG11 m57324.Google Scholar
- Yiqun Xu, Wei Hu, Shanshe Wang, Xinfeng Zhang, Shiqi Wang, Siwei Ma, Zongming Guo, and Wen Gao. 2020. Predictive generalized graph Fourier transform for attribute compression of dynamic point clouds. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, 5 (2020), 1968--1982.Google ScholarDigital Library
- Cha Zhang, Dinei Florencio, and Charles Loop. 2014. Point cloud attribute compression with graph transform. In 2014 IEEE International Conference on Image Processing (ICIP). IEEE, 2066--2070.Google ScholarCross Ref
- Qi Zhang, Yiting Shao, and Ge Li. 2018. Point clouds attribute compression using data-adaptive intra prediction. In 2018 IEEE Visual Communications and Image Processing (VCIP). IEEE, 1--4.Google Scholar
- Xiang Zhang and Wen Gao. 2021. Adaptive geometry partition for point cloud compression. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, 12 (2021), 4561--4574.Google ScholarCross Ref
Index Terms
- PDE-based Progressive Prediction Framework for Attribute Compression of 3D Point Clouds
Recommendations
Lossless video coding based on pixel-wise prediction
The state-of-the-art H.264/AVC was designed for lossy video coding in the beginning. Recently, the H.264/AVC FRExt was developed by removing transformation and quantization for lossless coding. In this paper, we propose an efficient intra lossless ...
HEVC-based lossless intra coding for efficient still image compression
Latest advancements in capture and display technologies demand better compression techniques for the storage and transmission of still images and video. High efficiency video coding (HEVC) is the latest video compression standard developed by the joint ...
Piecewise DC prediction in HEVC
In this paper, we propose an improved DC prediction method for high-efficiency video coding (HEVC) intra coding. The technique involves the application of pixel-wise predictors rather than block-based predictor in the DC mode. In HEVC, the pixels of ...
Comments