Skip to main content

Investigating the Effect of Embodied Visualization in Remote Collaborative Augmented Reality

  • Conference paper
  • First Online:
Virtual Reality and Augmented Reality (EuroVR 2019)

Abstract

This paper investigates the influence of embodied visualization on the effectiveness of remote collaboration in a worker-instructor scenario in augmented reality (AR). For this purpose, we conducted a user study where we used avatars in a remote collaboration system in AR to allow natural human communication. In a worker-instructor scenario, spatially separated pairs of subjects have to solve a common task, while their respective counterpart is either visualized as an avatar or without bodily representation. As a baseline, a Face-to-face (F2F) interaction is carried out to define an ideal interaction. In the subsequent analysis of the results, the embodied visualization indicates significant differences in copresence and social presence, but no significant differences in the performance and workload. Verbal feedback of our subjects hints that augmentations, like the visualization of the viewing direction, are more important in our scenario than the visualization of the interaction partner.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Achenbach, J., Waltemate, T., Latoschik, M.E., Botsch, M.: Fast generation of realistic virtual humans. In: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, p. 12. ACM (2017)

    Google Scholar 

  2. Amores, J., Benavides, X., Maes, P.: Showme: a remote collaboration system that supports immersive gestural communication. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1343–1348. ACM (2015)

    Google Scholar 

  3. Argelaguet, F., Kulik, A., Kunert, A., Andujar, C., Froehlich, B.: See-through techniques for referential awareness in collaborative virtual reality. Int. J. Hum.-Comput. Stud. 69(6), 387–400 (2011)

    Article  Google Scholar 

  4. Ashdown, M., Cummings, M.L.: Asymmetric synchronous collaboration within distributed teams. In: Harris, D. (ed.) EPCE 2007. LNCS (LNAI), vol. 4562, pp. 245–255. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73331-7_26

    Chapter  Google Scholar 

  5. Battiste, V., Bortolussi, M.: Transport pilot workload: a comparison of two subjective techniques. In: Proceedings of the Human Factors Society Annual Meeting, vol. 32, pp. 150–154. SAGE Publications, Los Angeles (1988)

    Google Scholar 

  6. Beck, S., Froehlich, B.: Volumetric calibration and registration of multiple RGBD-sensors into a joint coordinate system. In: 2015 IEEE Symposium on 3D User Interfaces (3DUI), pp. 89–96. IEEE (2015)

    Google Scholar 

  7. Beck, S., Kunert, A., Kulik, A., Froehlich, B.: Immersive group-to-group telepresence. IEEE Trans. Vis. Comput. Graph. 19(4), 616–625 (2013)

    Article  Google Scholar 

  8. Billinghurst, M., Bee, S., Bowskill, J., Kato, H.: Asymmetries in collaborative wearable interfaces. In: Digest of Papers. Third International Symposium on Wearable Computers, pp. 133–140. IEEE (1999)

    Google Scholar 

  9. Boud, A.C., Haniff, D.J., Baber, C., Steiner, S.: Virtual reality and augmented reality as a training tool for assembly tasks. In: 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210), pp. 32–36. IEEE (1999)

    Google Scholar 

  10. Datcu, D., Lukosch, S., Lukosch, H., Cidota, M.: Using augmented reality for supporting information exchange in teams from the security domain. Secur. Inform. 4(1), 10 (2015)

    Article  Google Scholar 

  11. Dey, A., Billinghurst, M., Lindeman, R.W., Swan, J.: A systematic review of 10 years of augmented reality usability studies: 2005 to 2014. Front. Robot. AI 5, 37 (2018)

    Article  Google Scholar 

  12. Fairchild, A.J., Campion, S.P., García, A.S., Wolff, R., Fernando, T., Roberts, D.J.: A mixed reality telepresence system for collaborative space operation. IEEE Trans. Circuits Syst. Video Technol. 27(4), 814–827 (2017)

    Article  Google Scholar 

  13. Gao, L., Bai, H., Lee, G., Billinghurst, M.: An oriented point-cloud view for MR remote collaboration. In: SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, p. 8. ACM (2016)

    Google Scholar 

  14. Garau, M., Slater, M., Vinayagamoorthy, V., Brogni, A., Steed, A., Sasse, M.A.: The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 529–536. ACM (2003)

    Google Scholar 

  15. George, C., Spitzer, M., Hussmann, H.: Training in IVR: investigating the effect of instructor design on social presence and performance of the VR user. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, p. 27. ACM (2018)

    Google Scholar 

  16. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Advances in Psychology, vol. 52, pp. 139–183. Elsevier (1988)

    Google Scholar 

  17. Higuch, K., Yonetani, R., Sato, Y.: Can eye help you?: effects of visualizing eye fixations on remote collaboration scenarios for physical tasks. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5180–5190. ACM (2016)

    Google Scholar 

  18. Ho, C.C., MacDorman, K.F.: Measuring the uncanny valley effect. Int. J. Soc. Robot. 9(1), 129–139 (2017)

    Article  Google Scholar 

  19. Kim, K., Boelling, L., Haesler, S., Bailenson, J., Bruder, G., Welch, G.F.: Does a digital assistant need a body? The influence of visual embodiment and social behavior on the perception of intelligent virtual agents in AR. In: 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 105–114. IEEE (2018)

    Google Scholar 

  20. Kiyokawa, K., Iwasa, H., Takemura, H., Yokoya, N.: Collaborative immersive workspace through a shared augmented environment. In: Intelligent Systems in Design and Manufacturing, vol. 3517, pp. 2–14. International Society for Optics and Photonics (1998)

    Google Scholar 

  21. Kolkmeier, J., Harmsen, E., Giesselink, S., Reidsma, D., Theune, M., Heylen, D.: With a little help from a holographic friend: the openimpress mixed reality telepresence toolkit for remote collaboration systems. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, p. 26. ACM (2018)

    Google Scholar 

  22. Komiyama, R., Miyaki, T., Rekimoto, J.: Jackin space: designing a seamless transition between first and third person view for effective telepresence collaborations. In: Proceedings of the 8th Augmented Human International Conference, p. 14. ACM (2017)

    Google Scholar 

  23. Latoschik, M.E., Roth, D., Gall, D., Achenbach, J., Waltemate, T., Botsch, M.: The effect of avatar realism in immersive social virtual realities, pp. 1–10. ACM Press (2017). https://doi.org/10.1145/3139131.3139156. http://dl.acm.org/citation.cfm?doid=3139131.3139156

  24. Le Chénéchal, M., Duval, T., Gouranton, V., Royan, J., Arnaldi, B.: Vishnu: virtual immersive support for helping users an interaction paradigm for collaborative remote guiding in mixed reality. In: 2016 IEEE Third VR International Workshop on Collaborative Virtual Environments (3DCVE), pp. 9–12. IEEE (2016)

    Google Scholar 

  25. Lee, M., Norouzi, N., Bruder, G., Wisniewski, P.J., Welch, G.F.: The physical-virtual table: exploring the effects of a virtual human’s physical influence on social interaction. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, p. 25. ACM (2018)

    Google Scholar 

  26. Li, H., et al.: Facial performance sensing head-mounted display. ACM Trans. Graph. (ToG) 34(4), 47 (2015)

    Google Scholar 

  27. Mattessich, P.W., Monsey, B.R.: Collaboration: what makes it work. A review of research literature on factors influencing successful collaboration, ERIC (1992)

    Google Scholar 

  28. McDonnell, R., Breidt, M., Bülthoff, H.H.: Render me real?: investigating the effect of render style on the perception of animated virtual humans, 31(4), 1–11 (2012). https://doi.org/10.1145/2185520.2185587. http://dl.acm.org/citation.cfm?doid=2185520.2185587

    Article  Google Scholar 

  29. Mori, M.: The uncanny valley. Energy 7(4), 33–35 (1970)

    Google Scholar 

  30. Motion, M.: Idle MoCap - Unity3d Asset Store (2019). https://assetstore.unity.com/packages/3d/animations/idle-mocap-28345, Accessed Mar 2019

  31. Nowak, K.L., Biocca, F.: The effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments. Presence: Teleoperators Virtual Environ. 12(5), 481–494 (2003)

    Article  Google Scholar 

  32. Oman-Reagan, M.: Telexploration, onsight, and hololens “on” mars (2015). http://winnower-production.s3.amazonaws.com/papers/165/v4/pdf/165-telexploration-onsight-and-hololens-on-mars.pdf. Accessed June 2019

  33. Orts-Escolano, S., et al.: Holoportation: virtual 3D teleportation in real-time. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pp. 741–754. ACM (2016)

    Google Scholar 

  34. Parger, M., Mueller, J.H., Schmalstieg, D., Steinberger, M.: Human upper-body inverse kinematics for increased embodiment in consumer-grade virtual reality. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, p. 23. ACM (2018)

    Google Scholar 

  35. Pejsa, T., Kantor, J., Benko, H., Ofek, E., Wilson, A.: Room2room: enabling life-size telepresence in a projected augmented reality environment. In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, pp. 1716–1725. ACM (2016)

    Google Scholar 

  36. Piumsomboon, T., Dey, A., Ens, B., Lee, G., Billinghurst, M.: The effects of sharing awareness cues in collaborative mixed reality. Front. Robot. AI 6, 5 (2019)

    Article  Google Scholar 

  37. Piumsomboon, T., et al.: Mini-me: an adaptive avatar for mixed reality remote collaboration, pp. 1–13. ACM Press (2018). https://doi.org/10.1145/3173574.3173620. http://dl.acm.org/citation.cfm?doid=3173574.3173620

  38. Schmalz, J.S.: Zwischen Kooperation und Kollaboration, zwischen Hierarchie und Heterarchie: Organisationsprinzipien und -strukturen von Wikis. kommunikation@ gesellschaft 8, 21 (2007)

    Google Scholar 

  39. Steed, A., Steptoe, W., Oyekoya, W., Pece, F., Weyrich, T., Kautz, J., Friedman, D., Peer, A., Solazzi, M., Tecchia, F., et al.: Beaming: an asymmetric telepresence system. IEEE Comput. Graph. Appl. 32(6), 10–17 (2012)

    Article  Google Scholar 

  40. Object Theory: Object theory - collaboration services (2019). https://objecttheory.com/services/. Accessed June 2019

  41. Waldow, K., Fuhrmann, A.: Using MQTT for platform independent remote mixed reality collaboration. In: Proceedings of the Mensch und Computer 2019 Workshop on User-Embodied Interaction in Virtual Reality (2019)

    Google Scholar 

  42. Waldow, K., Misiak, M., Derichs, U., Clausen, O., Fuhrmann, A.: An evaluation of smartphone-based interaction in AR for constrained object manipulation. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, p. 69. ACM (2018)

    Google Scholar 

  43. Waltemate, T., Gall, D., Roth, D., Botsch, M., Latoschik, M.E.: The impact of avatar personalization and immersion on virtual body ownership, presence, and emotional response, 24(4), 1643–1652 (2018). https://doi.org/10.1109/TVCG.2018.2794629

    Article  Google Scholar 

  44. Yura, S., Usaka, T., Sakamura, K.: Video avatar: embedded video for collaborative virtual environment. In: Proceedings IEEE International Conference on Multimedia Computing and Systems, vol. 2, pp. 433–438. IEEE (1999)

    Google Scholar 

Download references

Acknowledgments

This work was funded by the German Federal Ministry of Education and Research (BMBF) under grant number 02K16C232 as part of the project Retail 4.0.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kristoffer Waldow .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Waldow, K., Fuhrmann, A., Grünvogel, S.M. (2019). Investigating the Effect of Embodied Visualization in Remote Collaborative Augmented Reality. In: Bourdot, P., Interrante, V., Nedel, L., Magnenat-Thalmann, N., Zachmann, G. (eds) Virtual Reality and Augmented Reality. EuroVR 2019. Lecture Notes in Computer Science(), vol 11883. Springer, Cham. https://doi.org/10.1007/978-3-030-31908-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-31908-3_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-31907-6

  • Online ISBN: 978-3-030-31908-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics