skip to main content
10.1145/3581783.3612422acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

PDE-based Progressive Prediction Framework for Attribute Compression of 3D Point Clouds

Authors Info & Claims
Published:27 October 2023Publication History

ABSTRACT

In recent years, the diffusion-based image compression scheme has achieved significant success, which inspires us to use diffusion theory to employ the diffusion model for point cloud attribute compression. However, the relevant existing methods cannot be used to deal with our task due to the irregular structure of point clouds. To handle this, we propose the partial differential equation (PDE) based progressive prediction framework for attribute compression of 3D point clouds. Firstly, we propose a PDE-based prediction module, which performs prediction by optimizing attribute gradients, allowing the geometric distribution of adjacent areas to be fully utilized and explaining the weighting method for prediction. Besides, we propose a low-complexity method for calculating partial derivative operations on point clouds to address the uncertainty of neighbor occupancy in three-dimensional space. In the proposed prediction framework, we design a two-layer level of detail (LOD) structure, where the attribute information in the high level is used for interpolating the low level by edge-enhancing anisotropic diffusion (EED) to infer local features from the high-level information. After the diffusion-based interpolation, we design a texture-wise prediction method making use of interpolated values and texture information. Experiment results show that our proposed framework achieves an average of 12.00% BD-rate reduction and 1.59% bitrate saving compared with Predlift (PLT) under attribute near-lossless and attribute lossless conditions, respectively. Furthermore, additional experiments demonstrate our proposed scheme has better texture preservation and subjective quality.

References

  1. Pierre Charbonnier, Laure Blanc-Féraud, Gilles Aubert, and Michel Barlaud. 1997. Deterministic edge-preserving regularization in computed imaging. IEEE Transactions on image processing, Vol. 6, 2 (1997), 298--311.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Jiafeng Chen, Lu Yu, and Wenyi Wang. 2022. Hilbert Space Filling Curve Based Scan-Order for Point Cloud Attribute Compression. IEEE Transactions on Image Processing, Vol. 31 (2022), 4609--4621.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. WG 07 MPEG 3D Graphics Coding and Haptics Coding. 2023. Common test conditions for G-PCC. document ISO/IEC JTC1/SC29/WG11 w22425.Google ScholarGoogle Scholar
  4. Robert A Cohen, Dong Tian, and Anthony Vetro. 2016. Attribute compression for sparse point clouds using graph transforms. In 2016 IEEE International Conference on Image Processing (ICIP). IEEE, 1374--1378.Google ScholarGoogle ScholarCross RefCross Ref
  5. Ricardo L De Queiroz and Philip A Chou. 2016. Compression of 3D point clouds using a region-adaptive hierarchical transform. IEEE Transactions on Image Processing, Vol. 25, 8 (2016), 3947--3956.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Olivier Devillers and P-M Gandoin. 2000. Geometric compression for interactive transmission. In Proceedings Visualization 2000. VIS 2000 (Cat. No. 00CH37145). IEEE, 319--326.Google ScholarGoogle ScholarCross RefCross Ref
  7. Abderrahim Elmoataz, Olivier Lezoray, and Sébastien Bougleux. 2008. Nonlocal discrete regularization on weighted graphs: a framework for image and manifold processing. IEEE transactions on Image Processing, Vol. 17, 7 (2008), 1047--1060.Google ScholarGoogle Scholar
  8. Irena Galić, Joachim Weickert, Martin Welk, Andrés Bruhn, Alexander Belyaev, and Hans-Peter Seidel. 2005. Towards PDE-based image compression. In Variational, Geometric, and Level Set Methods in Computer Vision: Third International Workshop, VLSM 2005, Beijing, China, October 16, 2005. Proceedings. Springer, 37--48.Google ScholarGoogle Scholar
  9. Irena Galić, Joachim Weickert, Martin Welk, Andrés Bruhn, Alexander Belyaev, and Hans-Peter Seidel. 2008. Image compression with anisotropic diffusion. Journal of Mathematical Imaging and Vision, Vol. 31 (2008), 255--269.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Shuai Gu, Junhui Hou, Huanqiang Zeng, and Hui Yuan. 2020. 3D point cloud attribute compression via graph prediction. IEEE Signal Processing Letters, Vol. 27 (2020), 176--180.Google ScholarGoogle ScholarCross RefCross Ref
  11. Shuai Gu, Junhui Hou, Huanqiang Zeng, Hui Yuan, and Kai-Kuang Ma. 2019. 3D point cloud attribute compression using geometry-guided sparse representation. IEEE Transactions on Image Processing, Vol. 29 (2019), 796--808.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Stefan Gumhold, Zachi Kami, Martin Isenburg, and Hans-Peter Seidel. 2005. Predictive point-cloud compression. In ACM SIGGRAPH 2005 Sketches. 137--es.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Reetu Hooda and W David Pan. 2021. Early termination of dyadic region-adaptive hierarchical transform for efficient attribute compression of 3d point clouds. IEEE Signal Processing Letters, Vol. 29 (2021), 214--218.Google ScholarGoogle ScholarCross RefCross Ref
  14. Yan Huang, Jingliang Peng, C-C Jay Kuo, and M Gopi. 2008. A generic scheme for progressive point cloud coding. IEEE Transactions on Visualization and Computer Graphics, Vol. 14, 2 (2008), 440--453.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Birendra Kathariya, Vladyslav Zakharchenko, Zhu Li, and Jianle Chen. 2019. Level-of-detail generation using binary-tree for lifting scheme in LiDAR point cloud attributes coding. In 2019 data compression conference (DCC). IEEE, 580--580.Google ScholarGoogle Scholar
  16. Rongjie Lai, Jiang Liang, and Hongkai Zhao. 2013. A LOCAL MESH METHOD FOR SOLVING PDES ON POINT CLOUDS. Inverse Problems & Imaging, Vol. 7, 3 (2013).Google ScholarGoogle ScholarCross RefCross Ref
  17. Jian Liang, Rongjie Lai, Tsz Wai Wong, and Hongkai Zhao. 2012. Geometric understanding of point clouds using Laplace-Beltrami operator. In 2012 IEEE conference on computer vision and pattern recognition. IEEE, 214--221.Google ScholarGoogle ScholarCross RefCross Ref
  18. C Loop, Q Cai, SO Escolano, and PA Chou. 2016. Microsoft Voxelized Upper Bodies -- A Voxelized Point Cloud Dataset. document ISO/IEC JTC1/SC29/WG11 m38673.Google ScholarGoogle Scholar
  19. François Lozes, Abderrahim Elmoataz, and Olivier Lézoray. 2014. Partial difference operators on weighted graphs for image processing on surfaces and point clouds. IEEE Transactions on Image Processing, Vol. 23, 9 (2014), 3896--3909.Google ScholarGoogle ScholarCross RefCross Ref
  20. Chuang Ma, Ge Li, Qi Zhang, Yiting Shao, Jing Wang, and Shan Liu. 2020. Fast Recolor Prediction Scheme in Point Cloud Attribute Compression. In 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP). IEEE, 50--53.Google ScholarGoogle Scholar
  21. Markus Mainberger and Joachim Weickert. 2009. Edge-based image compression with homogeneous diffusion. In Computer Analysis of Images and Patterns: 13th International Conference, CAIP 2009, Münster, Germany, September 2-4, 2009. Proceedings 13. Springer, 476--483.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Khaled Mammou, Alexis Tourapis, Jungsun Kim, Fabrice Robinet, Valery Valentin, and Yeping Su. 2018. Lifting Scheme for Lossy Attribute Encoding in TMC1. document ISO/IEC JTC1/SC29/WG11 m42640.Google ScholarGoogle Scholar
  23. Khaled Mammou, Alexis M Tourapis, David Singer, and Yeping Su. 2017. Video-Based and Hierarchical Approaches Point Cloud Compression. document ISO/IEC JTC1/SC29/WG11 m41649.Google ScholarGoogle Scholar
  24. Christian Schmaltz, Pascal Peter, Markus Mainberger, Franziska Ebel, Joachim Weickert, and Andrés Bruhn. 2014. Understanding, optimising, and extending data compression with anisotropic diffusion. International Journal of Computer Vision, Vol. 108 (2014), 222--240.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Ruwen Schnabel and Reinhard Klein. 2006. Octree-based Point-Cloud Compression. PBG@ SIGGRAPH, Vol. 3 (2006).Google ScholarGoogle Scholar
  26. Sebastian Schwarz, Marius Preda, Vittorio Baroncini, Madhukar Budagavi, Pablo Cesar, Philip A Chou, Robert A Cohen, Maja Krivokuća, Sébastien Lasserre, Zhu Li, et al. 2018. Emerging MPEG standards for point cloud compression. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 9, 1 (2018), 133--148.Google ScholarGoogle ScholarCross RefCross Ref
  27. Yiting Shao, Qi Zhang, Ge Li, Zhu Li, and Li Li. 2018. Hybrid point cloud attribute compression using slice-based layered structure and block-based intra prediction. In Proceedings of the 26th ACM international conference on Multimedia. 1199--1207.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Yiting Shao, Zhaobin Zhang, Zhu Li, Kui Fan, and Ge Li. 2017. Attribute compression of 3D point clouds using Laplacian sparsity optimized graph transform. In 2017 IEEE Visual Communications and Image Processing (VCIP). IEEE, 1--4.Google ScholarGoogle Scholar
  29. Fei Song, Ge Li, Xiaodong Yang, Wei Gao, and Shan Liu. 2023. Block-Adaptive Point Cloud Attribute Coding with Region-Aware Optimized Transform. IEEE Transactions on Circuits and Systems for Video Technology (2023).Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Lei Wei, Shuai Wan, Fuzheng Yang, Zhecheng Wang, et al. 2022. Content-Adaptive Level of Detail for Lossless Point Cloud Compression. APSIPA Transactions on Signal and Information Processing, Vol. 11, 1 (2022).Google ScholarGoogle ScholarCross RefCross Ref
  31. Zhang Wei, Yang Lihui, Yang Fuzheng, Tian Tengya, Champel Mary-Luc, and Gao Shuo. 2021. Neighbor Search Improvements for Attribute LoD Prediction. document ISO/IEC JTC1/SC29/WG11 m57324.Google ScholarGoogle Scholar
  32. Yiqun Xu, Wei Hu, Shanshe Wang, Xinfeng Zhang, Shiqi Wang, Siwei Ma, Zongming Guo, and Wen Gao. 2020. Predictive generalized graph Fourier transform for attribute compression of dynamic point clouds. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, 5 (2020), 1968--1982.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Cha Zhang, Dinei Florencio, and Charles Loop. 2014. Point cloud attribute compression with graph transform. In 2014 IEEE International Conference on Image Processing (ICIP). IEEE, 2066--2070.Google ScholarGoogle ScholarCross RefCross Ref
  34. Qi Zhang, Yiting Shao, and Ge Li. 2018. Point clouds attribute compression using data-adaptive intra prediction. In 2018 IEEE Visual Communications and Image Processing (VCIP). IEEE, 1--4.Google ScholarGoogle Scholar
  35. Xiang Zhang and Wen Gao. 2021. Adaptive geometry partition for point cloud compression. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, 12 (2021), 4561--4574.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. PDE-based Progressive Prediction Framework for Attribute Compression of 3D Point Clouds

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MM '23: Proceedings of the 31st ACM International Conference on Multimedia
        October 2023
        9913 pages
        ISBN:9798400701085
        DOI:10.1145/3581783

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 27 October 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate995of4,171submissions,24%

        Upcoming Conference

        MM '24
        MM '24: The 32nd ACM International Conference on Multimedia
        October 28 - November 1, 2024
        Melbourne , VIC , Australia
      • Article Metrics

        • Downloads (Last 12 months)158
        • Downloads (Last 6 weeks)25

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader