Abstract
In recent years, the Metaverse has been attracting attention as online communication tool. But the avatar that represents the user’s figure in the Metaverse cannot express the facial expression of the user, because it is usually constructed with CG model. In order to solve such problems, this research proposes video avatar that uses live video image of the user as an avatar in the Metaverse environment. However, for the users wearing HMDs, facial expressions cannot be seen, because most of their faces are covered by headset. Therefore, a method of reconstructing a whole face image from the face image wearing an HMD was developed by using the machine learning technology, and the effectiveness of this method was evaluated through the experiments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Park, S.-M., Kim, Y.-G.: A Metaverse: taxonomy, components, applications, and open challenges. IEEE Access 10, 4209–4251 (2022)
Duan, H., Li, J., Fan, S., Lin, Z., Wu, X., Cai, W.: Metaverse for social good: a university campus prototype. In: Proceedings of the 29th ACM International Conference Multimedia, pp. 153–161 (2021)
Aseeri, S., Interrante, V.: The influence of avatar representation on interpersonal communication in virtual social environments. IEEE Trans. Visual Comput. Graphics 27(5), 2608–2617 (2021)
Hu, L., et al.: Avatar digitization from a single image for real-time rendering. ACM Trans. Graphics 36(6), 1–14 (2017)
Bao, L., et al.: High-fidelity 3D digital human head creation from RGB-D selfies. ACM Trans. Graph. 41(1), 1–21 (2021)
Ogi, T., Yamada, T., Tamagawa, K., Hirose, M.: Video Avatar Communication in Networked Virtual Environment. In: INET 2000 the Internet Global Summit Proceedings, Yokoham (2000)
Ogi, T., Yu, S.: Development of informal communication environment using interactive tiled display wall, iDECON 2014. In: 3rd International Conference on Design and Concurrent Engineering (2014)
Tamagawa, K., Yamada, T., Ogi, T., Hirose, M.: Developing a 2.5-D Video Avatar. IEEE Signal Process. Mag. 18(3), 35–42 (2001)
Ogi, T., Sakai, M.: Real time 3D video avatar using serial distributed processing method. In: 2008 ASIAGRAPH Proceedings, vol.2, no.1, pp.292 (2008)
ChromaCam https://www.chromacam.me/
Cengil, E., Çınar, A., Özbay, E.: Image classification with caffe deep learning framework. In: 2017 International Conference on Computer Science and Engineering (UBMK), pp.440–444 (2017)
Liu, S., Deng, W.: Very deep convolutional neural network based image classification using small training sample size. In: 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp.730–734 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ogi, T., Sumida, K., Kida, Y. (2023). Video Avatar Communication Among HMD Users in Metaverse Environment. In: Barolli, L. (eds) Advances in Networked-based Information Systems. NBiS 2023. Lecture Notes on Data Engineering and Communications Technologies, vol 183. Springer, Cham. https://doi.org/10.1007/978-3-031-40978-3_34
Download citation
DOI: https://doi.org/10.1007/978-3-031-40978-3_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-40977-6
Online ISBN: 978-3-031-40978-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)