skip to main content
10.1145/3386290.3396936acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article

PC-MCU: point cloud multipoint control unit for multi-user holoconferencing systems

Published: 08 June 2020 Publication History

Abstract

This paper introduces the Point Cloud Multipoint Control Unit (PC-MCU): a key component for multi-user holoconferencing systems, where remote participants are represented as Point Clouds. The presented solution redefines the idea of MCU, broadly used to optimize connections and communications between users in traditional videoconferencing, and introduces a set of key features for the optimization of holoconferencing services where multiple users can be remotely connected. The PC-MCU is a virtualized cloud-based component, that aims at reducing the end-user client computational resources and bandwidth usage, providing the following key features: fusion of volumetric videos, Level of Detail (LoD) adjustment and non visible data removal. The results obtained for a scenario with two remote users, show how the introduction of the PC-MCU provides significant benefits in terms of computational resources and bandwidth savings, thus alleviating the requirements at the client side in holoconferencing services when compared to a baseline condition without using it. These improvements open the door to further research on this area to enable scalable and adaptive holoconferencing services using lightweight devices.

References

[1]
M Reha Civanlar, Öznur Özkasap, and Tahir Çelebi. 2005. Peer-to-peer multipoint videoconferencing on the Internet. Signal Processing: Image Communication 20, 8 (2005), 743--754.
[2]
Sylvie Dijkstra-Soudarissanane, Karim El Assal, Simon Gunkel, Frank ter Haar, Rick Hindriks, Jan Willem Kleinrouweler, and Omar Niamut. 2019. Multi-sensor capture and network processing for virtual reality conferencing. In Proceedings of the 10th ACM Multimedia Systems Conference. 316--319.
[3]
Eugene d'Eon, Bob Harrison, Taos Myers, and Phil A. Chou. 2017. 8i voxelized full bodies-a voxelized point cloud dataset. ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document WG11M40059/WG1M74006 (2017).
[4]
Global System for Mobile Communications Association. [n.d.]. Cloud AR/VR Whitepaper. https://www.gsma.com/futurenetworks/wiki/cloud-ar-vr-whitepaper/. Accessed: 2020-03-09.
[5]
Silvano Gai, Tommi Salli, and Roger Andersson. 2010. Cisco Unified Computing System (UCS)(Data Center): A Complete Reference Guide to the Cisco Data Center Virtualization Server Architecture. Pearson Education.
[6]
Mohammad Hosseini and Christian Timmerer. 2018. Dynamic adaptive point cloud streaming. In Proceedings of the 23rd Packet Video Workshop. 25--30.
[7]
Junlin Li, Li-wei He, and Dinei Florêncio. 2007. Multi-party audio conferencing based on a simpler MCU and client-side echo cancellation. In 2007 IEEE International Conference on Multimedia and Expo. IEEE, 84--87.
[8]
David Luebke, Martin Reddy, Jonathan D Cohen, Amitabh Varshney, Benjamin Watson, and Robert Huebner. 2003. Level of detail for 3D graphics. Morgan Kaufmann.
[9]
Rufael Mekuria, Kees Blom, and Pablo Cesar. 2016. Design, implementation, and evaluation of a point cloud codec for tele-immersive video. IEEE Transactions on Circuits and Systems for Video Technology 27, 4 (2016), 828--842.
[10]
M. Montagud, J.A. De Rus, R. Fayos-Jordán, M. García-Pineda, and J. Segura-Garcia. 2020. Open-Source Software Tools for Measuring Resources Consumption and DASH Metrics. In Proceedings of the 11th ACM Multimedia System Conference.
[11]
Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, et al. 2016. Holoportation: Virtual 3d teleportation in real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 741--754.
[12]
Cagri Ozcinar, Ana De Abreu, and Aljosa Smolic. 2017. Viewport-aware adaptive 360 video streaming using tiles for virtual reality. In 2017 IEEE International Conference on Image Processing (ICIP). IEEE, 2174--2178.
[13]
Jounsup Park, Philip A Chou, and Jenq-Neng Hwang. 2019. Rate-utility optimized streaming of volumetric media for augmented reality. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (2019), 149--162.
[14]
Kyungmo Park. [n.d.]. Network Based Media Processing. ISO/IEC JTC1/SC29/WG11 N18270, January, 2019.
[15]
Feng Qian, Bo Han, Jarrell Pair, and Vijay Gopalakrishnan. 2019. Toward practical volumetric video streaming on commodity smartphones. In Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications. 135--140.
[16]
Maurice Quach, Giuseppe Valenzise, and Frederic Dufaux. 2019. Learning convolutional transforms for lossy point cloud geometry compression. In 2019 IEEE International Conference on Image Processing (ICIP). IEEE, 4320--4324.
[17]
Sebastian Schwarz, Marius Preda, Vittorio Baroncini, Madhukar Budagavi, Pablo Cesar, Philip A Chou, Robert A Cohen, Maja Krivokuća, Sebastien Lasserre, Zhu Li, et al. 2018. Emerging MPEG standards for point cloud compression. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (2018), 133--148.
[18]
Gary A Thom. 1996. H. 323: the multimedia communications standard for local area networks. IEEE communications Magazine 34, 12 (1996), 52--56.
[19]
MH Willebeek-LeMair, Dilip D Kandlur, and Z-Y Shae. 1994. On multipoint control units for videoconferencing. In Proceedings of 19th conference on local computer networks. IEEE, 356--364.

Cited By

View all
  • (2024)Toward Interactive and Distributed Hybrid Extended Reality ExperiencesProceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops10.1145/3672406.3672424(127-130)Online publication date: 12-Jun-2024
  • (2024)FSVFG: Towards Immersive Full-Scene Volumetric Video Streaming with Adaptive Feature GridProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680908(11089-11098)Online publication date: 28-Oct-2024
  • (2024)VP9 bitstream-based Tiled Multipoint Control UnitProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647608(23-33)Online publication date: 15-Apr-2024
  • Show More Cited By

Index Terms

  1. PC-MCU: point cloud multipoint control unit for multi-user holoconferencing systems

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      NOSSDAV '20: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video
      June 2020
      73 pages
      ISBN:9781450379458
      DOI:10.1145/3386290
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 08 June 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Best Paper

      Author Tags

      1. AR
      2. MCU
      3. VR
      4. XR
      5. holoconferencing
      6. holoportation
      7. point clouds
      8. social VR
      9. volumetric video

      Qualifiers

      • Research-article

      Funding Sources

      • EU H2020 Program

      Conference

      MMSys '20
      Sponsor:
      MMSys '20: 11th ACM Multimedia Systems Conference
      June 10 - 11, 2020
      Istanbul, Turkey

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)33
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 15 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Toward Interactive and Distributed Hybrid Extended Reality ExperiencesProceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops10.1145/3672406.3672424(127-130)Online publication date: 12-Jun-2024
      • (2024)FSVFG: Towards Immersive Full-Scene Volumetric Video Streaming with Adaptive Feature GridProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680908(11089-11098)Online publication date: 28-Oct-2024
      • (2024)VP9 bitstream-based Tiled Multipoint Control UnitProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647608(23-33)Online publication date: 15-Apr-2024
      • (2024)Look Over Here! Comparing Interaction Methods for User-Assisted Remote Scene ReconstructionExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650982(1-8)Online publication date: 11-May-2024
      • (2024)On the Way to Holographic-Type Communications: Perspectives and Enabling TechnologiesIEEE Access10.1109/ACCESS.2024.339312412(59236-59259)Online publication date: 2024
      • (2023)Addressing Scalability for Real-time Multiuser Holo-portation: Introducing and Assessing a Multipoint Control Unit (MCU) for Volumetric VideoProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3613777(9243-9251)Online publication date: 26-Oct-2023
      • (2023)Robust QUIC-Based Signalling for WebRTC in Impaired Networks2023 IEEE International Mediterranean Conference on Communications and Networking (MeditCom)10.1109/MeditCom58224.2023.10266652(187-192)Online publication date: 4-Sep-2023
      • (2023)VR2Gather: A Collaborative, Social Virtual Reality System for Adaptive, Multiparty Real-Time CommunicationIEEE MultiMedia10.1109/MMUL.2023.326394330:2(48-59)Online publication date: 1-Apr-2023
      • (2023)6G-BRICKS: Developing a Modern Experimentation Facility for Validation, Testing and Showcasing of 6G Breakthrough Technologies and DevicesArtificial Intelligence Applications and Innovations. AIAI 2023 IFIP WG 12.5 International Workshops10.1007/978-3-031-34171-7_1(17-31)Online publication date: 2-Jun-2023
      • (2022)Challenges in Implementing Low-Latency Holographic-Type Communication SystemsSensors10.3390/s2224961722:24(9617)Online publication date: 8-Dec-2022
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media