skip to main content
10.1145/3581783.3613827acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

G-PCC++: Enhanced Geometry-based Point Cloud Compression

Published: 27 October 2023 Publication History

Abstract

MPEG Geometry-based Point Cloud Compression (G-PCC) standard is developed for lossy encoding of point clouds to enable immersive services over the Internet. However, lossy G-PCC introduces superimposed distortions from both geometry and attribute information, seriously deteriorating the Quality of Experience (QoE). This paper thus proposes the Enhanced G-PCC (GPCC++), to effectively address the compression distortion and restore the quality. G-PCC++ separates the enhancement into two stages: it first enhances the geometry and then maps the decoded attribute to the enhanced geometry for refinement. As for geometry restoration, a k Nearest Neighbors (kNN)-based Linear Interpolation is first used to generate a denser geometry representation, on top of which GeoNet further generates sufficient candidates to restore geometry through probability-sorted selection. For attribute enhancement, a kNN-based Gaussian Distance Weighted Mapping is devised to re-colorize all points in enhanced geometry tensor, which are then refined by AttNet for the final reconstruction. G-PCC++ is the first solution addressing the geometry and attribute artifacts together. Extensive experiments on several public datasets demonstrate the superiority of G-PCC++, e.g., on the solid point cloud dataset 8iVFB, G-PCC++ outperforms G-PCC by 88.24% (80.54%) BD-BR in D1 (D2) measurement of geometry and by 14.64% (13.09%) BD-BR in Y (YUV) attribute. Moreover, when considering both geometry and attribute, G-PCC++ also largely surpasses G-PCC by 25.58% BD-BR using PCQM assessment.

Supplemental Material

MP4 File
Recently, the growth of new applications puts forward higher requirements for point cloud compression technology. Previous learning-based point cloud compression post-processing have shown advantages in enhancement compressed by G-PCC. But these methods only consider the geometry or attribute separately. Therefore, we propose the G-PCC++ Enhanced Geometry-based Point Cloud Compression, which can process jointly geometry and attribute. In this framework, we propose GeoNet, AttNet and a Score-based loss function. The experiment results show that our method outperforms state-of-the-art G-PCC methods, e.g., for geometry average 88.24% D1 BDSR and 80.51% D2 BDBR, and for attribute average 14.64% Y PSNR and 13.09% YUV PSNR. In addition, kNN-based Linear Interpolation, kNN-based Gaussian Distance Weighted Mapping and Score-based Loss Function have also been proved to be effective in ablation studies.

References

[1]
A. AKhtar, Z. Li, G. V. Auwera, L. Li, and J. Chen. 2022. PU-Dense: Sparse Tensor-based Point Cloud Geometry Upsampling. IEEE Trans. Image Processing (2022).
[2]
Zaghetto Alexandre, Danillo Graziosi, and Tabatabai Ali. Jan. 2022. Dataset split for AI-PCC. ISO/IEC JTC 1/SC 29/WG 7 m58754 (Jan. 2022).
[3]
G. Bjøntegaard. 2001. Calculation of average PSNR differences between RD-curves. In ITU-T SG 16/Q6, 13th VCEG Meeting. document VCEG-M33.
[4]
Chao Cao, Marius Preda, and Titus Zaharia. 2019. 3D point cloud compression: A survey. In The 24th International Conference on 3D Web Technology. 1--9.
[5]
Chao Cao, Marius Preda, Vladyslav Zakharchenko, Euee S Jang, and Titus Zaharia. 2021. Compression of sparse and dense dynamic point clouds-methods and standards. Proc. IEEE 109, 9 (2021), 1537--1558.
[6]
Kenneth R Castleman. 1996. Digital image processing. Prentice Hall Press.
[7]
Angel X Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, et al. 2015. ShapeNet: An information-rich 3D model repository. arXiv preprint arXiv:1512.03012 (2015).
[8]
Haolan Chen, Shitong Luo, Wei Hu, et al. 2022. Deep point set resampling via gradient fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022).
[9]
C. Choy, J. Gwak, and S. Savarese. 2019. 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. 2019 IEEE/CVF CVPR (2019), 3070--3079.
[10]
Robert A Cohen, Dong Tian, and Anthony Vetro. 2016. Point cloud attribute compression using 3-D intra prediction and shape-adaptive transforms. In 2016 Data Compression Conference (DCC). IEEE, 141--150.
[11]
Ricardo L De Queiroz and Philip A Chou. 2016. Compression of 3D point clouds using a region-adaptive hierarchical transform. IEEE Transactions on Image Processing 25, 8 (2016), 3947--3956.
[12]
Eugene d'Eon, Bob Harrison, Taos Myers, and Philip A. Chou. May 2016. 8i Voxelized Full Bodies - A Voxelized Point Cloud Dataset. ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) m38673/M72012 (May 2016).
[13]
Xiaoqing Fan, Ge Li, Dingquan Li, Yurui Ren, Wei Gao, and Thomas H Li. 2022. Deep Geometry Post-Processing for Decompressed Point Clouds. In 2022 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6.
[14]
Chunyang Fu, Ge Li, Rui Song, Wei Gao, and Shan Liu. 2022. OctAttention: Octree-based Large-scale Context Model for Point Cloud Compression. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI).
[15]
Linyao Gao, Tingyu Fan, Jianqiang Wan, Yiling Xu, Jun Sun, and Zhan Ma. 2021. Point cloud geometry compression via neural graph sampling. In 2021 IEEE International Conference on Image Processing (ICIP). IEEE, 3373--3377.
[16]
D Graziosi, O Nakagami, S Kuma, A Zaghetto, T Suzuki, and A Tabatabai. 2020. An overview of ongoing point cloud compression standardization activities: Video-based (V-PCC) and geometry-based (G-PCC). APSIPA Transactions on Signal and Information Processing 9 (2020).
[17]
Zhenyu Guan, Qunliang Xing, Mai Xu, Ren Yang, Tie Liu, and Zulin Wang. 2019. MFQE 2.0: A new approach for multi-frame quality enhancement on compressed video. IEEE transactions on pattern analysis and machine intelligence 43, 3 (2019), 949--963.
[18]
André FR Guarda, Nuno MM Rodrigues, and Fernando Pereira. 2020. Adaptive deep learning-based point cloud geometry coding. IEEE Journal of Selected Topics in Signal Processing 15, 2 (2020), 415--430.
[19]
Yulan Guo, Hanyun Wang, Qingyong Hu, Hao Liu, Li Liu, and Mohammed Bennamoun. 2020. Deep learning for 3d point clouds: A survey. IEEE transactions on pattern analysis and machine intelligence 43, 12 (2020), 4338--4364.
[20]
Lila Huang, Shenlong Wang, Kelvin Wong, Jerry Liu, and Raquel Urtasun. 2020. OctSqueeze: Octree-structured entropy model for LiDAR compression. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 1313--1323.
[21]
Tianxin Huang and Yong Liu. 2019. 3D point cloud geometry compression on deep learning. In Proceedings of the 27th ACM International Conference on Multimedia. 890--898.
[22]
Anil K Jain. 1989. Fundamentals of digital image processing. Prentice-Hall, Inc.
[23]
Jianwei Li, Yongtao Wang, Haihua Xie, and Kai-Kuang Ma. 2020. Learning a single model with a wide range of quality factors for JPEG image artifacts removal. IEEE Transactions on Image Processing 29 (2020), 8842--8854.
[24]
Ruihui Li, Xianzhi Li, Chi-Wing Fu, Daniel Cohen-Or, and Pheng-Ann Heng. 2019. PU-GAN: a point cloud upsampling adversarial network. In Proceedings of the IEEE/CVF international conference on computer vision. 7203--7212.
[25]
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014. Microsoft COCO: Common objects in context. In European conference on computer vision. Springer, 740--755.
[26]
Gexin Liu, Jianqiang Wang, Dandan Ding, and Zhan Ma. 2022. PCGFormer: Lossy Point Cloud Geometry Compression via Local Self-Attention. In 2022 IEEE International Conference on Visual Communications and Image Processing (VCIP). IEEE, 1--5.
[27]
Hao Liu, Hui Yuan, Junhui Hou, Raouf Hamzaoui, and Wei Gao. 2022. Pufa-gan: A frequency-aware generative adversarial network for 3d point cloud upsampling. IEEE Transactions on Image Processing 31 (2022), 7389--7402.
[28]
Hao Liu, Hui Yuan, Qi Liu, Junhui Hou, and Ju Liu. 2019. A comprehensive study and comparison of core technologies for MPEG 3-D point cloud compression. IEEE Transactions on Broadcasting 66, 3 (2019), 701--717.
[29]
Qi Liu, Hui Yuan, Raouf Hamzaoui, Honglei Su, Junhui Hou, and Huan Yang. 2021. Reduced reference perceptual quality model with application to rate control for video-based point cloud compression. IEEE Transactions on Image Processing 30 (2021), 6623--6636.
[30]
C. Loop, Q. Cai, S. Orts Escolano, and P.A. Chou. 2016. Microsoft Voxelized Upper Bodies - A Voxelized Point Cloud Dataset. In ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document m38673/M72012.
[31]
Shitong Luo and Wei Hu. 2021. Score-based point cloud denoising. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 4583--4592.
[32]
K Mammou, A Tourapis, J Kim, F Robinet, V Valentin, and Y Su. 2018. Lifting scheme for lossy attribute encoding in TMC1. Document ISO/IEC JTC1/SC29/WG11 m42640, San Diego, CA, US (2018).
[33]
Aihua Mao, Zihui Du, Junhui Hou, Yaqi Duan, Yong-jin Liu, and Ying He. 2022. PU-Flow: A point cloud upsampling network with normalizing flows. IEEE Transactions on Visualization and Computer Graphics (2022).
[34]
Gabriel Meynet, Yana Nehmé, Julie Digne, and Guillaume Lavoué. 2020. PCQM: A full-reference quality metric for colored 3D point clouds. In 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 1--6.
[35]
Dat Thanh Nguyen and André Kaup. 2023. Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Model. IEEE Transactions on Circuits and Systems for Video Technology (2023).
[36]
Dat Thanh Nguyen, Maurice Quach, Giuseppe Valenzise, and Pierre Duhamel. 2021. Lossless coding of point cloud geometry using a deep generative model. IEEE Transactions on Circuits and Systems for Video Technology 31, 12 (2021), 4617--4629.
[37]
Jiahao Pang, Muhammad Asad Lodhi, and Dong Tian. 2022. GRASP-Net: Geometric Residual Analysis and Synthesis for Point Cloud Compression. In Proceedings of the 1st International Workshop on Advances in Point Cloud Compression, Processing and Analysis. 11--19.
[38]
JPEG Pleno. 2020. JPEG Pleno Point Cloud Coding Common Test Conditions v3.5. ISO/IEC JTC1/SC29/WG1 N90053 (2020).
[39]
Guocheng Qian, Abdulellah Abualshour, Guohao Li, Ali Thabet, and Bernard Ghanem. 2021. PU-GCN: Point cloud upsampling using graph convolutional networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11683--11692.
[40]
Maurice Quach, Jiahao Pang, Dong Tian, Giuseppe Valenzise, and Frédéric Dufaux. 2022. Survey on Deep Learning-based Point Cloud Compression. Frontiers in Signal Processing (2022).
[41]
Maurice Quach, Giuseppe Valenzise, and Frederic Dufaux. 2019. Learning convolutional transforms for lossy point cloud geometry compression. In IEEE ICIP. 4320--4324.
[42]
Zizheng Que, Guo Lu, and Dong Xu. 2021. VoxelContext-Net: An octree based framework for point cloud compression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6042--6051.
[43]
Sebastian Schwarz, Marius Preda, Vittorio Baroncini, Madhukar Budagavi, Pablo Cesar, Philip A Chou, Robert A Cohen, Maja Krivokuća, Sébastien Lasserre, Zhu Li, et al. 2018. Emerging MPEG standards for point cloud compression. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (2018), 133--148.
[44]
Xihua Sheng, Li Li, Dong Liu, and Zhiwei Xiong. 2022. Attribute Artifacts Removal for Geometry-Based Point Cloud Compression. IEEE Transactions on Image Processing 31 (2022), 3399--3413.
[45]
Xihua Sheng, Li Li, Dong Liu, Zhiwei Xiong, Zhu Li, and Feng Wu. 2021. Deep-PCAC: An end-to-end deep lossy compression framework for point cloud attributes. IEEE Transactions on Multimedia 24 (2021), 2617--2632.
[46]
Dong Tian, Hideaki Ochimizu, Chen Feng, Robert Cohen, and Anthony Vetro. 2017. Geometric distortion metrics for point cloud compression. In 2017 IEEE International Conference on Image Processing (ICIP). IEEE, 3460--3464.
[47]
Jianqiang Wang, Dandan Ding, Zhu Li, and Zhan Ma. 2021. Multiscale point cloud geometry compression. In 2021 Data Compression Conference (DCC). IEEE, 73--82.
[48]
Jianqiang Wang, Dandan Ding, and Zhan Ma. 2023. Lossless Point Cloud Attribute Compression Using Cross-scale, Cross-group, and Cross-color Prediction. In Data Compression Conference (DCC). IEEE.
[49]
Jianqiang Wang and Zhan Ma. 2022. Sparse Tensor-based Point Cloud Attribute Compression. In 2022 IEEE 5th International Conference on Multimedia Information Processing and Retrieval (MIPR). 59--64. https://doi.org/10.1109/MIPR54900.2022. 00018
[50]
Jianqiang Wang, Hao Zhu, Haojie Liu, and Zhan Ma. 2021. Lossy point cloud geometry compression via end-to-end learning. IEEE Transactions on Circuits and Systems for Video Technology 31, 12 (2021), 4909--4923.
[51]
Xuanzheng Wen, Xu Wang, Junhui Hou, Lin Ma, Yu Zhou, and Jianmin Jiang. 2020. Lossy geometry compression of 3D point cloud data via an adaptive octree-guided network. In 2020 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6.
[52]
WG7. 2021. Common test conditions for G-PCC. ISO/IEC JTC1/SC29/WG11 N00106 (2021).
[53]
WG7, MPEG 3D Graphics Coding. July 2022. Description of Exploration Experiment 5.3 on AI-based Dynamic PC Coding. ISO/IEC JTC 1/SC 29/WG 7 N00386 (July 2022).
[54]
Ruixiang Xue, Jianqiang Wang, and Zhan Ma. 2022. Efficient LiDAR Point Cloud Geometry Compression Through Neighborhood Point Attention. ArXiv abs/2208.12573 (2022).
[55]
Wei Yan, Shan Liu, Thomas H Li, Zhu Li, Ge Li, et al. 2019. Deep autoencoder-based lossy geometry compression for point clouds. arXiv preprint arXiv:1905.03691 (2019).
[56]
Qi Yang, Zhan Ma, Yiling Xu, Zhu Li, and Jun Sun. 2020. Inferring point cloud quality via graph similarity. IEEE transactions on pattern analysis and machine intelligence 44, 6 (2020), 3015--3029.
[57]
Xu Yi, Lu Yao, and Wen Ziyu. October, 2017. Owlii Dynamic human mesh sequence dataset. ISO/IEC JTC1/SC29/WG11 (MPEG/JPEG) m41658 (October, 2017).
[58]
Kang You and Pan Gao. 2021. Patch-Based Deep Autoencoder for Point Cloud Geometry Compression. In ACM Multimedia Asia. 1--7.
[59]
Kang You, Pan Gao, and Qing Li. 2022. IPDAE: Improved Patch-Based Deep Autoencoder for Lossy Point Cloud Geometry Compression. In Proceedings of the 1st International Workshop on Advances in Point Cloud Compression, Processing and Analysis. 1--10.
[60]
Lequan Yu, Xianzhi Li, Chi-Wing Fu, Daniel Cohen-Or, and Pheng-Ann Heng. 2018. EC-NET: an edge-aware point set consolidation network. In Proceedings of the European conference on computer vision (ECCV). 386--402.
[61]
Lequan Yu, Xianzhi Li, Chi-Wing Fu, Daniel Cohen-Or, and Pheng-Ann Heng. 2018. PU-NET: Point cloud upsampling network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2790--2799.
[62]
Cha Zhang, Dinei Florencio, and Charles Loop. 2014. Point cloud attribute compression with graph transform. In 2014 IEEE International Conference on Image Processing (ICIP). IEEE, 2066--2070.
[63]
Junteng Zhang, Gexin Liu, Dandan Ding, and Zhan Ma. 2022. Transformer and Upsampling-Based Point Cloud Compression. In Proceedings of the 1st International Workshop on Advances in Point Cloud Compression, Processing and Analysis (Lisboa, Portugal) (APCCPA '22). Association for Computing Machinery, New York, NY, USA, 33--39

Cited By

View all
  • (2025)Three-Dimensional Point Cloud Applications, Datasets, and Compression Methodologies for Remote Sensing: A Meta-SurveySensors10.3390/s2506166025:6(1660)Online publication date: 7-Mar-2025
  • (2025)A Versatile Point Cloud Compressor Using Universal Multiscale Conditional Coding – Part II: AttributeIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.346294547:1(252-268)Online publication date: Jan-2025
  • (2025)A Versatile Point Cloud Compressor Using Universal Multiscale Conditional Coding – Part I: GeometryIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.346293847:1(269-287)Online publication date: Jan-2025
  • Show More Cited By

Index Terms

  1. G-PCC++: Enhanced Geometry-based Point Cloud Compression

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '23: Proceedings of the 31st ACM International Conference on Multimedia
    October 2023
    9913 pages
    ISBN:9798400701085
    DOI:10.1145/3581783
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. compression artifact
    2. point cloud compression
    3. quality enhancement

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China

    Conference

    MM '23
    Sponsor:
    MM '23: The 31st ACM International Conference on Multimedia
    October 29 - November 3, 2023
    Ottawa ON, Canada

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)415
    • Downloads (Last 6 weeks)33
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Three-Dimensional Point Cloud Applications, Datasets, and Compression Methodologies for Remote Sensing: A Meta-SurveySensors10.3390/s2506166025:6(1660)Online publication date: 7-Mar-2025
    • (2025)A Versatile Point Cloud Compressor Using Universal Multiscale Conditional Coding – Part II: AttributeIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.346294547:1(252-268)Online publication date: Jan-2025
    • (2025)A Versatile Point Cloud Compressor Using Universal Multiscale Conditional Coding – Part I: GeometryIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.346293847:1(269-287)Online publication date: Jan-2025
    • (2024)Encoding auxiliary information to restore compressed point cloud geometryProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence10.24963/ijcai.2024/242(2189-2197)Online publication date: 3-Aug-2024
    • (2024)LightUrban: Similarity Based Fine‐grained Instancing for Lightweighting Complex Urban Point CloudsComputer Graphics Forum10.1111/cgf.1523843:7Online publication date: 7-Nov-2024
    • (2024)Dependence-Based Coarse-to-Fine Approach for Reducing Distortion Accumulation in G-PCC Attribute CompressionIEEE Transactions on Industrial Informatics10.1109/TII.2024.340326220:9(11393-11403)Online publication date: Sep-2024
    • (2024)Compression without Compromise: Optimizing Point Cloud Object Detection with Bottleneck Architectures For Split Computing2024 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)10.1109/ICMEW63481.2024.10645461(1-6)Online publication date: 15-Jul-2024
    • (2024)Differential Lightweight Processing in Digital Twin Construction of Substations2024 3rd International Conference on Energy and Electrical Power Systems (ICEEPS)10.1109/ICEEPS62542.2024.10693200(354-360)Online publication date: 14-Jul-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media