Skip to main content
Springer Nature Link
Log in

Asynchronous Manual Work in Mixed Reality Remote Collaboration

  • Conference paper
  • First Online:
Extended Reality (XR Salento 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13446))

Included in the following conference series:

  • 1941 Accesses

Abstract

Research in Collaborative Virtual Environments (CVEs) is becoming more and more significant with increasing accessibility of Virtual Reality (VR) and Augmented Reality (AR) technology, additionally reinforced by the increasing demand for remote collaboration groupware. While the research is focusing on methods for synchronous remote collaboration, asynchronous remote collaboration remains a niche. Nevertheless, future CVEs should support both paradigms of collaborative work, since asynchronous collaboration has as well its benefits, for instance a more flexible time-coordination. In this paper we present a concept of recording and later playback of highly interactive collaborative tasks in Mixed Reality (MR). Furthermore, we apply the concept in an assembly training scenario from the manufacturing industry and test it during pilot user experiments. The pilot study compared two modalities, the first one with a manufacturing manual, and another using our concept and featuring a ghost avatar. First results revealed no significant differences between both modalities in terms of time completion, hand movements, cognitive workload and usability. Some differences were not expected, however, these results and the feedback brought by the participants provide insights to further develop our concept.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Almeida, F., Duarte Santos, J., Augusto Monteiro, J.: The challenges and opportunities in the digitalization of companies in a post-covid-19 world. IEEE Eng. Manage. Rev. 48(3), 97–103 (2020). https://doi.org/10.1109/EMR.2020.3013206

    Article  Google Scholar 

  2. Baek, S., Lee, S., Kim, G.J.: Motion retargeting and evaluation for VR-based training of free motions. Visual Comput. 19(4), 222–242 (2003). https://doi.org/10.1007/s00371-003-0194-2

  3. de Belen, R.A., Nguyen, H., Filonik, D., Favero, D., Bednarz, T.: A systematic review of the current state of collaborative mixed reality technologies: 2013–2018. AIMS Electronics and Electrical Engineering 3, 181–223 (2019). https://doi.org/10.3934/ElectrEng.2019.2.181

  4. Chan, J.C., Leung, H., Tang, J.K., Komura, T.: A virtual reality dance training system using motion capture technology. IEEE Trans. Learn. Technol. 4(2), 187–195 (2011). https://doi.org/10.1109/TLT.2010.27

    Article  Google Scholar 

  5. Checa, D., Miguel-Alonso, I., Bustillo, A.: Immersive virtual-reality computer-assembly serious game to enhance autonomous learning. Virtual Reality (4), 1–18 (2021). https://doi.org/10.1007/s10055-021-00607-1

  6. Chen, H., Lee, A.S., Swift, M., Tang, J.C.: 3d collaboration method over hololens and skype end points. In: Proceedings of the 3rd International Workshop on Immersive Media Experiences, ImmersiveME 2015, pp. 27–30. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2814347.2814350

  7. Chow, K., Coyiuto, C., Nguyen, C., Yoon, D.: Challenges and design considerations for multimodal asynchronous collaboration in VR. In: Proceedings of the ACM on Human-Computer Interaction 3 (CSCW) (2019). https://doi.org/10.1145/3359142

  8. Dürr, M., Kn, M.D., Weber, R., Pfeil, U., Reiterer, H.: EGuide: Investigating different Visual Appearances and Guidance Techniques for Egocentric Guidance Visualizations (2020). https://doi.org/10.1145/3374920.3374945

  9. Ens, B., et al.: Revisiting collaboration through mixed reality: the evolution of groupware. Int. J. Human-Comput. Stud. 131, 81–98 (2019). https://doi.org/10.1016/j.ijhcs.2019.05.011

    Article  Google Scholar 

  10. Frécon, E., Nöu, A.A.: Building distributed virtual environments to support collaborative work. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST, pp. 105–114 (2019). https://doi.org/10.1145/293701.293715

  11. Greenhalgh, C., Flintham, M., Purbrick, J., Benford, S.: Applications of temporal links: recording and replaying virtual environments. In: Proceedings IEEE Virtual Reality 2002, pp. 101–108 (2002). https://doi.org/10.1109/VR.2002.996512

  12. Guerreiro, J., et al.: Beyond Post-It: Structured Multimedia Annotations for Collaborative VEs. In: Nojima, T., Reiners, D., Staadt, O. (eds.) ICAT-EGVE 2014 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments. The Eurographics Association (2014). https://doi.org/10.2312/ve.20141365

  13. Hollan, J., Stornetta, S.: Beyond being there. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1992, p. 119–125. Association for Computing Machinery, New York (1992). https://doi.org/10.1145/142750.142769

  14. Imai, T., Johnson, A., Leigh, J., Pape, D., DeFanti, T.: Supporting transoceanic collaborations in virtual environment, vol. 2, pp. 1059–1062 (1999). https://doi.org/10.1109/APCC.1999.820446

  15. Irlitti, A., Smith, R.T., Itzstein, S.V., Billinghurst, M., Thomas, B.H.: Challenges for Asynchronous Collaboration in Augmented Reality. In: Adjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016, pp. 31–35 (2017). https://doi.org/10.1109/ISMAR-Adjunct.2016.0032

  16. Irlitti, A., Von Itzstein, S., Alem, L., Thomas, B.: Tangible interaction techniques to support asynchronous collaboration. In: 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 1–6 (2013). https://doi.org/10.1109/ISMAR.2013.6671840

  17. Kasahara, S., Heun, V., Lee, A.S., Ishii, H.: Second surface: multi-user spatial collaboration system based on augmented reality. In: SIGGRAPH Asia 2012 Emerging Technologies, SA 2012, p. 1–4. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2407707.2407727

  18. Ladwig, P., Geiger, C.: A literature review on collaboration in mixed reality. In: Auer, M.E., Langmann, R. (eds.) REV 2018. LNNS, vol. 47, pp. 591–600. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-95678-7_65

    Chapter  Google Scholar 

  19. Langlotz, T., Grubert, J., Grasset, R.: Augmented reality browsers: Essential products or only gadgets? Commun. ACM 56(11), 34–36 (2013). https://doi.org/10.1145/2527190

  20. Lindlbauer, D., Wilson, A.D.: Remixed Reality: Manipulating Space and Time in Augmented Reality, pp. 1–13. Association for Computing Machinery, New York (2018)

    Google Scholar 

  21. Marques, B., Silva, S., Rocha, A., Dias, P., Santos, B.S.: Remote asynchronous collaboration in maintenance scenarios using augmented reality and annotations. In: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 567–568 (2021). https://doi.org/10.1109/VRW52623.2021.00166

  22. Matsas, E., Vosniakos, G.C., Batras, D.: Modelling simple human-robot collaborative manufacturing tasks in interactive virtual environments. In: Proceedings of the 2016 Virtual Reality International Conference, VRIC 2016. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2927929.2927948

  23. Moloney, J., Amor, R.: Stringcve: advances in a game engine-based collaborative virtual environment for architectural design. In: Proceedings of CONVR 2003 Conference on Construction Applications of Virtual Reality, pp. 24–26 (2003)

    Google Scholar 

  24. Nassani, A., Bai, H., Lee, G., Billinghurst, M.: Tag it! ar annotation using wearable sensors. In: SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications, SA 2015. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2818427.2818438

  25. Nguyen, C., DiVerdi, S., Hertzmann, A., Liu, F.: Collavr: collaborative in-headset review for vr video. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 pp. 267–277. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3126594.3126659

  26. Ogasawara, H., Shibata, Y.: Asynchronous collaborative support system by revision tree method. In: Proceedings - International Conference on Advanced Information Networking and Applications, AINA, pp. 564–569 (2009). https://doi.org/10.1109/WAINA.2009.180

  27. Olson, G.M., Olson, J.S.: Distance matters. Human-Computer Interaction 15(2–3), 139–178 (2000). https://doi.org/10.1207/S15327051HCI1523_4

  28. Orts-Escolano, S., et al.: Holoportation: virtual 3d teleportation in real-time. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST 2016, pp. 741–754, Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2984511.2984517

  29. Poelman, R., Akman, O., Lukosch, S., Jonker, P.: As if being there: mediated reality for crime scene investigation. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, CSCW 2012, pp. 1267–1276. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2145204.2145394

  30. Regenbrecht, H., Meng, K., Reepen, A., Beck, S., Langlotz, T.: Mixed voxel reality: presence and embodiment in low fidelity, visually coherent, mixed reality environments, pp. 90–99 (2017). https://doi.org/10.1109/ISMAR.2017.26

  31. Reisner-Kollmann, I., Aschauer, A.: Design and implementation of asynchronous remote support. CEUR Workshop Proc. 2618, 9–11 (2020)

    Google Scholar 

  32. Schönauer, C., Fukushi, K., Olwal, A., Kaufmann, H., Raskar, R.: Multimodal motion guidance: Techniques for adaptive and dynamic feedback. In: ICMI 2012 - Proceedings of the ACM International Conference on Multimodal Interaction, pp. 133–140 (2012). https://doi.org/10.1145/2388676.2388706

  33. Tam, J., Greenberg, S.: A framework for asynchronous change awareness in collaborative documents and workspaces. International Journal of Human-Computer Studies 64(7), 583–598 (2006). https://doi.org/10.1016/j.ijhcs.2006.02.004

  34. Tecchia, F., Alem, L., Huang, W.: 3d helping hands: a gesture based mr system for remote collaboration. In: Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2012, pp. 323–328. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2407516.2407590

  35. Tsang, M., Fitzmzurice, G.W., Kurtenbach, G., Khan, A., Buxton, B.: Boom Chameleon: Simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display (2003)

    Google Scholar 

  36. Tseng, P.Y., Haraldsson, H., Belongie, S.: Annotate all ! A Perspective Preserved Asynchronous Annotation System for Collaborative Augmented Reality, pp. 1–3 (2019)

    Google Scholar 

  37. Wang, C.Y., Sakashita, M., Ehsan, U., Li, J., Won, A.S.: Again, Together: Socially Reliving Virtual Reality Experiences When Separated, pp. 1–12. Association for Computing Machinery, New York (2020)

    Google Scholar 

  38. Yang, U., Kim, G.J.: Implementation and evaluation of “just follow me”: an immersive, vr-based, motion-training system. Presence: Teleoper. Virtual Environ. 11(3), 304–323 (2002). https://doi.org/10.1162/105474602317473240

Download references

Author information

Authors and Affiliations

  1. Institute for Information Management in Engineering, Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany

    Anjela Mayer, Théo Combe & Jivka Ovtcharova

  2. Arts et Metiers Institute of Technology, LISPEN, HESAM Université, Chalon-sur-Saône, France

    Théo Combe & Jean-Rémy Chardonnet

Authors
  1. Anjela Mayer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Théo Combe
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jean-Rémy Chardonnet
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jivka Ovtcharova
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anjela Mayer .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. Università di Napoli Federico II, Naples, Italy

    Pasquale Arpaia

  3. CNR-STIIMA, Lecco, Italy

    Marco Sacco

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mayer, A., Combe, T., Chardonnet, JR., Ovtcharova, J. (2022). Asynchronous Manual Work in Mixed Reality Remote Collaboration. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2022. Lecture Notes in Computer Science, vol 13446. Springer, Cham. https://doi.org/10.1007/978-3-031-15553-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-15553-6_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-15552-9

  • Online ISBN: 978-3-031-15553-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics