Design and Implementation of an Immersive Network Collaborative Environment Using OpenPose with 360VR Camera and WebXR

Abstract

Recently, VR goggles like Oculus Quest 2 have become popularized because such goggles are more portable and cheaper than ever. As a result, Metaverse to be realized using such goggles will become popular as one of the immersive network collaborative environments. So, in this paper, the authors propose the design and implementation for that. For multiple persons’ network collaborations, the functionality to capture their actions simultaneously is required. So, the authors propose the use of OpenPose with 360VR camera in their design because OpenPose generates multiple persons’ pose information from a video almost in real-time and 360VR camera generates a video that covers a wide area including multiple persons. On the other hand, such immersive network collaborative environments are very complicated and their development is not easy. So, the authors also propose the use of WebXR of Three.js in their design because Three.js is one of the popular 3D graphics libraries for web contents and it provides functionality required for WebXR that supports VR goggles. For justifying the proposed design, the authors implemented a prototype system of an immersive network collaborative environment. This paper explains the proposed design and the details of the prototype system.