Abstract
Shadow is an effective projection for presence of real objects, and has important roles in three-dimensional effects and reality of virtual space. Therefore avatar’s shadow would be able to have interactive effects with the avatar’s self in a virtual space. In our previous research, we reported that an auto-generated interactive avatar’s motion which is different from the talker’s own motion not always supports human communication. However, by using an avatar-shadow, talkers could communicate effectively without inconsistency between their own motions and their avatar’s motions in a virtual space, in which the avatar-shadow’s motions are expressed by combining the talker’s own motions with auto-generated interactive motions. Accordingly we propose an embodied entrainment system called “Avatar Twin” using shadow avatar. This system is constructed by talkers’ shadow avatars based on their own motions, and their avatars based on auto-generated entrained motions, in addition to the previous avatar-shadows. In previous studies, an avatar was a subject as a substitute for the user, and the main purpose was to investigate the effects of shadow support in communication. In this paper, we propose the master-slave inversed approach by swapping between measured and entrainment motions in shadow avatar communication system, and develop the system prototype.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Takeuchi, K., Yamazaki, Y., Yoshifuji, K.: Avatar work: telework for disabled people unable to go outside by using avatar robots “OriHime-D” and its verification. In: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2020 Companion) (2020). https://doi.org/10.1145/3371382.3380737
Kawamoto, S., et al.: Design of software toolkit for anthropomorphic spoken dialog agent software with customization-oriented features. IPSJ J. 43(7), 2249–2263 (2002). (in Japanese)
Lee, A., Oura, K., Tokuda, K.: An open-source toolkit realizing attractive voice interaction systems. MMDAgent. IEICE Technical Report, NLC2011–51, SP2011–96, vol. 111, no. 364, pp. 159–164 (2011). (in Japanese)
Narumi, T.: Ghost engineering: designing our cognitive functions by modifying our body. Cogn. Sci. 26(1), 14–29 (2019). (in Japanese)
Miwa, Y., Itai, S., Watanabe T., Nishi, H., Shadow awareness enhancing theater space through the mutual projection of images on a connective slit-screen. J. Int. Soc. Arts Sci. Technol. (SIGGRAPH 2011 Art Paper) 44(4), 325–333 (2011)
Esaki, K., Inoue, S., Watanabe, T., Ishii, Y.: An embodied entrainment avatar-shadow system to support avatar mediated communication. In: Proceedings of the 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN2015), pp. 419–424, 31 August 2015
Ishii, Y., Watanabe, T., Sejima, Y.: Development of an embodied avatar system using avatar-shadow’s color expressions with an interaction-activated communication model. In: Proceedings of the 4th International Conference on Human-Agent Interaction (HAI 2016) pp. 337–340, 4 October 2016
Watanabe, T.: Human-Entrained Embodied Interaction and Communication Technology, pp. 161–177. Emotional Engineering, Springer (2011). https://doi.org/10.1007/978-1-84996-423-4_9
Watanabe, T., Ogikubo, M., Ishii, Y.: Visualization of respiration in the embodied virtual communication system and its evaluation. Int. J. Hum. Comput. Interact. 17, 89–102 (2004)
Watanabe, T., Okubo, M., Ishii, Y., Nakabayashi, K.: An embodied virtual communication system with human virtual actor and abstract virtual wave. J. Hum. Interface Soc. 2(2), 1–10 (2000)
Yamamoto, M., Takabayashi, N., Watanabe, T. Ishii, Y.: A nursing communication education support system with the function of reflection. In: Proceedings of the 2015 IEEE/SICE International Symposium on System Integration (SII2015), pp. 912–917, 11 December 11 2015
Acknowledgments
This work was supported by JSPS KAKENHI Grant Number 19K12067.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Ishii, Y., Kurokawa, S., Watanabe, T. (2021). Avatar Twin Using Shadow Avatar in Avatar-Mediated Communication. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information. Information Presentation and Visualization. HCII 2021. Lecture Notes in Computer Science(), vol 12765. Springer, Cham. https://doi.org/10.1007/978-3-030-78321-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-78321-1_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78320-4
Online ISBN: 978-3-030-78321-1
eBook Packages: Computer ScienceComputer Science (R0)