Quality Assessment and Modeling for MPEG V-PCC Volumetric Video
Pages 64 - 70
Abstract
Volumetric video, which is typically represented by 3D point clouds, requires efficient point cloud compression (PCC) technologies for practical storage and transmission. Particularly, developed by the Moving Picture Experts Group (MPEG), video-based PCC (V-PCC) converts 3D point clouds into 2D image maps and compresses them with 2D video codecs, showing excellent compression performance. However, understanding the impact of compression on the perceptual quality of volumetric videos, which consist of both geometry and texture components, remains challenging. In this study, we propose a quality of experience (QoE) model to predict the subjective quality with respect to the compression level of geometry and texture, quantifying the impact of geometry and texture compression on perceptual quality. To the best of our knowledge, this study is the first to accurately model the perceptual quality of V-PCC-encoded volumetric videos. The QoE model is built based on a volumetric video quality assessment dataset, VOLVQAD, collected by us. We further evaluate our QoE model on the vsenseVVDB2 dataset, which was collected from diverse study settings, to validate its robustness and generalization ability. Both evaluations demonstrate the effectiveness of our model in various compression scenarios. This study makes a valuable contribution to our understanding of the factors that influence the QoE in V-PCC-encoded volumetric videos. The proposed model also holds potential for various other applications, such as adaptive bitrate allocation.
References
[1]
Ali Ak, Emin Zerman, Maurice Quach, Aladine Chetouani, Aljosa Smolic, Giuseppe Valenzise, and Patrick Le Callet. BASICS: Broad quality assessment of static point clouds in a compression scenario. IEEE Transactions on Multimedia, pages 1-13, Early Access, 2024.
[2]
Evangelos Alexiou, Irene Viola, Tomás M Borges, Tiago A Fonseca, Ricardo L De Queiroz, and Touradj Ebrahimi. A comprehensive study of the rate-distortion performance in mpeg point cloud compression. APSIPA Transactions on Signal and Information Processing, 8:e27, Nov 2019.
[3]
Samuel Rhys Cox, May Lim, and Wei Tsang Ooi. VOLVQAD: an MPEG V-PCC volumetric video quality assessment dataset. In Proceedings of the 14th Conference on ACM Multimedia Systems, MMSys 2023, Vancouver, BC, Canada, June 7-10, 2023, pages 357-362. ACM, 2023.
[4]
Luís Alberto da Silva Cruz, Emil Dumic, Evangelos Alexiou, João Prazeres, Carlos Rafael Duarte, Manuela Pereira, António M. G. Pinheiro, and Touradj Ebrahimi. Point cloud quality evaluation: Towards a definition for test conditions. In Proceedings of the 11th International Conference on Quality of Multimedia Experience, QoMEX 2019, Berlin, Germany, June 5-7, 2019, pages 1--6. IEEE, 2019.
[5]
Sam Van Damme, Maria Torres Vega, and Filip De Turck. A full- and no-reference metrics accuracy analysis for volumetric media streaming. In Proceedings of the 13th International Conference on Quality of Multimedia Experience, QoMEX 2021, Montreal, Canada, June 14-17, 2021, pages 225--230. IEEE, 2021.
[6]
Eugene d'Eon, Bob Harrison, Taos Myers, and Philip A Chou. 8i voxelized full bodies-a voxelized point cloud dataset. ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document WG11M40059/WG1M74006, 7(8):11, 2017.
[7]
Eugene d'Eon, Bob Harrison, Taos Myers, and Philip A Chou. Common test conditions for point cloud compression. ISO/IEC JTC1/SC29/WG11 w17766, 2018.
[8]
Arnd Eden. No-reference image quality analysis for compressed video sequences. IEEE Transactions on Broadcasting, 54(3):691--697, Sept 2008.
[9]
Rosario Feghali, Filippo Speranza, Demin Wang, and Andr Vincent. Video quality metric for bit rate control via joint adjustment of quantization and frame rate. IEEE Transactions on Broadcasting, 53(1):441--446, Mar 2007.
[10]
Mateus M. Gonçalves, Luciano Agostini, Daniel Palomino, Marcelo Schiavon Porto, and Guilherme Corrêa. Encoding efficiency and computational cost assessment of state-of-the-art point cloud codecs. In Proceedings of the 2019 IEEE International Conference on Image Processing, ICIP 2019, Taipei, Taiwan, September 22-25, 2019, pages 3726--3730. IEEE, 2019.
[11]
Danillo Graziosi, Ohji Nakagami, Satoru Kuma, Alexandre Zaghetto, Teruhiko Suzuki, and Ali Tabatabai. An overview of ongoing point cloud compression standardization activities: Video-based (V-PCC) and geometry-based (G-PCC). APSIPA Transactions on Signal and Information Processing, 9:e13, Apr 2020.
[12]
Zhouyan He, Gangyi Jiang, Mei Yu, Zhidi Jiang, Zongju Peng, and Fen Chen. TGP-PCQA: Texture and geometry projection based quality assessment for colored point clouds. Journal of Visual Communication and Image Representation, 83:103449, Jan 2022.
[13]
ITU-R. Methodology for the subjective assessment of the quality of television pictures. ITU-R Recommendation BT.500-13, 2012.
[14]
ITU-T. Subjective video quality assessment methods for multimedia applications. ITU-T Recommendation, page 910, 2008.
[15]
Shraboni Jana, An (Jack) Chan, Amit Pande, and Prasant Mohapatra. QoE prediction model for mobile video telephony. Multimedia Tools and Applications, 75(13):7957--7980, Jun 2015.
[16]
Asiya Khan, Lingfen Sun, and Emmanuel C. Ifeachor. QoE prediction model and its application in video quality adaptation over umts networks. IEEE Transactions on Multimedia, 14(2):431--442, Apr 2012.
[17]
Yipeng Liu, Qi Yang, Yiling Xu, and Le Yang. Point cloud quality assessment: Dataset construction and learning-based no-reference metric. ACM Transactions on Multimedia Computing, Communications and Applications, 19(2s):80:1--80:26, Feb 2023.
[18]
A Mike Burton. Why has research in face recognition progressed so slowly? the importance of variability. Quarterly Journal of Experimental Psychology, 66(8):1467--1485, Aug 2013.
[19]
Yana Nehmé, Johanna Delanoy, Florent Dupont, Jean-Philippe Farrugia, Patrick Le Callet, and Guillaume Lavoué. Textured mesh quality assessment: Large-scale dataset and deep learning-based quality metric. ACM Transactions on Graphics, 42(3), Jun 2023.
[20]
Yana Nehmé, Florent Dupont, Jean-Philippe Farrugia, Patrick Le Callet, and Guillaume Lavoué. Visual quality of 3D meshes with diffuse colors in virtual reality: Subjective and objective evaluation. IEEE Transactions on Visualization and Computer Graphics, 27(3):2202--2219, Nov 2021.
[21]
Minh Nguyen, Shivi Vats, Sam Van Damme, Jeroen van der Hooft, Maria Torres Vega, Tim Wauters, Christian Timmerer, and Hermann Hellwagner. Impact of quality and distance on the perception of point clouds in mixed reality. In Proceedings of the 15th International Conference on Quality of Multimedia Experience, QoMEX 2023, Ghent, Belgium, June 20-22, 2023, pages 87--90. IEEE, 2023.
[22]
Yuang Shi, Pranav Venkatram, Yifan Ding, and Wei Tsang Ooi. Enabling low bit-rate MPEG V-PCC-encoded volumetric video streaming with 3D sub-sampling. In Proceedings of the 14th Conference on ACM Multimedia Systems, MMSys 2023, Vancouver, BC, Canada, June 7-10, 2023, pages 108--118. ACM, 2023.
[23]
Honglei Su, Zhengfang Duanmu, Wentao Liu, Qi Liu, and Zhou Wang. Perceptual quality assessment of 3d point clouds. In 2019 IEEE International Conference on Image Processing, ICIP 2019, Taipei, Taiwan, September 22-25, 2019, pages 3182--3186. IEEE, 2019.
[24]
Eric M. Torlig, Evangelos Alexiou, Tiago A. Fonseca, Ricardo L. de Queiroz, and Touradj Ebrahimi. A novel methodology for quality assessment of voxelized point clouds. In Applications of Digital Image Processing XLI, volume 10752, pages 174--190. International Society for Optics and Photonics, SPIE, 2018.
[25]
Jeroen van der Hooft, Maria Torres Vega, Christian Timmerer, Ali C. Begen, Filip De Turck, and Raimund Schatz. Objective and subjective qoe evaluation for adaptive point cloud streaming. In Proceedings of the 12th International Conference on Quality of Multimedia Experience, QoMEX 2020, Athlone, Ireland, May 26-28, 2020, pages 1--6. IEEE, 2020.
[26]
Irene Viola, Shishir Subramanyam, Jie Li, and Pablo Cesar. On the impact of VR assessment on the quality of experience of highly realistic digital humans: A volumetric video case study. Quality and User Experience, 7(1):3, May 2022.
[27]
Jannis Weil, Yassin Alkhalili, Anam Tahir, Thomas Gruczyk, Tobias Meuser, Mu Mu, Heinz Koeppl, and Andreas Mauthe. Modeling quality of experience for compressed point cloud sequences based on a subjective study. In Proceedings of the 15th International Conference on Quality of Multimedia Experience, QoMEX 2023, Ghent, Belgium, June 20-22, 2023, pages 135--140. IEEE, 2023.
[28]
Yi Xu, Yao Lu, and Ziyu Wen. Owlii dynamic human mesh sequence dataset. ISO/IEC JTC1/SC29/WG11 m41658, 7(8):11, 2017.
[29]
Emin Zerman, Pan Gao, Cagri Ozcinar, and Aljosa Smolic. Subjective and objective quality assessment for volumetric video compression. In Image Quality and System Performance XVI, Electronic Imaging 2019, IQSP, Burlingame, CA, USA, 13-17 January 2019. Society for Imaging Science and Technology, 2019.
[30]
Emin Zerman, Cagri Ozcinar, Pan Gao, and Aljosa Smolic. Textured mesh vs coloured point cloud: A subjective study for volumetric video compression. In Proceedings of the 12th International Conference on Quality of Multimedia Experience, QoMEX 2020, Athlone, Ireland, May 26-28, 2020, pages 1--6. IEEE, 2020.
[31]
Xuemei Zhou, Irene Viola, Evangelos Alexiou, Jack Jansen, and Pablo César. QAVA-DPC: eye-tracking based quality assessment and visual attention dataset for dynamic point cloud in 6 DoF. In Proceedings of the 2023 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2023, Sydney, Australia, October 16-20, 2023, pages 69--78. IEEE, 2023.
Index Terms
- Quality Assessment and Modeling for MPEG V-PCC Volumetric Video
Recommendations
Volumetric Video Compression Through Neural-based Representation
MMVE '24: Proceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment SystemsVolumetric video offers immersive exploration and interaction in 3D space, revolutionizing visual storytelling. Recently, Neural Radiance Fields (NeRF) have emerged as a powerful neural-based technique for generating high-fidelity images from 3D scenes. ...
Perceptual Impact of Facial Quality in MPEG V-PCC-encoded Volumetric Videos
MMVE '24: Proceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment SystemsVolumetric video, a technique used in augmented reality (AR) and virtual reality (VR) applications, presents unique challenges in rendering and compression. To enable efficient compression, video-based point cloud compression (V-PCC) techniques have been ...
Enabling Low Bit-Rate MPEG V-PCC-encoded Volumetric Video Streaming with 3D Sub-sampling
MMSys '23: Proceedings of the 14th ACM Multimedia Systems ConferenceMPEG's Video-based Point Cloud Compression (V-PCC) is a recent new standard for volumetric video compression. By mapping a 3D dynamic point cloud to a 2D image sequence, V-PCC can rely on state-of-the-art video codecs to achieve high compression rate ...
Comments
Information & Contributors
Information
Published In
April 2024
101 pages
ISBN:9798400706189
DOI:10.1145/3652212
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 April 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Singapore Ministry of Education
Conference
MMSys '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 26 of 44 submissions, 59%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 196Total Downloads
- Downloads (Last 12 months)196
- Downloads (Last 6 weeks)30
Reflects downloads up to 27 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in