skip to main content
10.1145/3131542.3131559acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiotConference Proceedingsconference-collections
research-article

HoloCollab: a shared virtual platform for physical assembly training using spatially-aware head-mounted displays

Published:22 October 2017Publication History

ABSTRACT

Today's industrial jobs require a skilled and trained workforce as tasks such as maintenance, service, and repair are becoming more complicated and more demanding. Therefore, both education and training for executing these tasks are becoming more important. Usually training is conducted on-site at designated training facilities with physical hardware. However, on-site hands-on training can be expensive as it requires designated training facilities that have to be maintained and need to be traveled to. With Augmented Reality (AR) becoming a substantial part of modern day manufacturing, using AR-based systems to train new workforces is becoming increasingly popular. In this paper, we investigate different training environments that use AR-based support during workforce training. We draw the design space for a shared collaborative AR-based learning space, and present the concept and implementation of HoloCollab which combines having a scalable virtual representation of an industrial scenario, such as assembly, with the benefit of having a trainer on-site with a trainee.

References

  1. Alexander Bannat, Frank Wallhoff, Gerhard Rigoll, Florian Friesdorf, H Bubb, Sonja Stork, HJ Müller, Anna Schubö, Mathey Wiesbeck, and Michael F Zäh. 2008. Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In Proceedings of the 1st international workshop on cognition for technical systems, Cotesys.Google ScholarGoogle Scholar
  2. Mark Billinghurst, Mika Hakkarainen, and Charles Woodward. 2008. Augmented assembly using a mobile phone. In Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia. ACM, 84--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jonas Blattgerste, Benjamin Strenge, Patrick Renner, Thies Pfeiffer, and Kai Essig. 2017. Comparing Conventional and Augmented Reality Instructions for Manual Assembly Tasks. (2017).Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Sébastien Bottecchia, Jean-Marc Cieutat, and Jean-Pierre Jessel. 2010. TAC: augmented reality system for collaborative tele-assistance in the field of maintenance through internet. In Proceedings of the 1st Augmented Human International Conference. ACM, 14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Sebastian Büttner, Markus Funk, Oliver Sand, and Carsten Röcker. 2016. Using Head-Mounted Displays and In-Situ Projection for Assistive Systems: A Comparison. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sebastian Büttner, Henrik Mucha, Markus Funk, Thomas Kosch, Mario Aehnelt, Sebastian Robert, and Carsten Röcker. 2017. The Design Space of Augmented and Virtual Reality Applications for Assistive Environments in Manufacturing: A Visual Approach. In Proceedings of the 10th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York, NY, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Pierre Dillenbourg, Daniel Schneider, and Paraskevi Synteta. 2002. Virtual learning environments. In 3rd Hellenic Conference" Information & Communication Technologies in Education". Kastaniotis Editions, Greece, 3--18.Google ScholarGoogle Scholar
  8. Markus Funk, Andreas Bächler, Liane Bächler, Thomas Kosch, Thomas Heidenreich, and Albrecht Schmidt. 2017. Working with Augmented Reality? A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace. In Proceedings of the 10th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York, NY, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Markus Funk, Sven Mayer, and Albrecht Schmidt. 2015. Using in-situ projection to support cognitively impaired workers at the workplace. In Proceedings of the 17th international ACM SIGACCESS conference on Computers & accessibility. ACM, 185--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Steffen Gauglitz, Cha Lee, Matthew Turk, and Tobias Höllerer. 2012. Integrating the physical environment into mobile remote collaboration. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. ACM, 241--250. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Scott W Greenwald, Markus Funk, Luke Loreti, David Mayo, and Pattie Maes. 2016. EVA: Exploratory Learning with Virtual Companions Sharing Attention and Context. In Advanced Learning Technologies (ICALT), 2016 IEEE 16th International Conference on. IEEE, 26--30.Google ScholarGoogle ScholarCross RefCross Ref
  12. Pavel Gurevich, Joel Lanir, Benjamin Cohen, and Ran Stone. 2012. TeleAdvisor: a versatile augmented reality tool for remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 619--622. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Jim Hollan and Scott Stornetta. 1992. Beyond being there. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 119--125. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Mareike Kritzler, Magdalena Murr, and Florian Michahelles. 2016. RemoteBob: Support of On-site Workers via a Telepresence Remote Expert System. In Proceedings of the 6th International Conference on the Internet of Things. ACM, 7--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jaron Lanier. 2001. Virtually there. Scientific American 284, 4 (2001), 66--75.Google ScholarGoogle ScholarCross RefCross Ref
  16. Kangdon Lee. 2012. Augmented reality in education and training. TechTrends 56, 2 (2012), 13--21.Google ScholarGoogle ScholarCross RefCross Ref
  17. Fotis Liarokapis and Eike F Anderson. 2010. Using augmented reality as a medium to assist teaching in higher education. (2010).Google ScholarGoogle Scholar
  18. Fotis Liarokapis, Nikolaos Mourkoussis, Martin White, Joe Darcy, Maria Sifniotis, Panos Petridis, Anirban Basu, and Paul F Lister. 2004. Web3D and augmented reality to support engineering education. World Transactions on Engineering and Technology Education 3, 1 (2004), 11--14.Google ScholarGoogle Scholar
  19. Wei Liu, Adrian David Cheok, Charissa Lim Mei-Ling, and Yin-Leng Theng. 2007. Mixed reality classroom: learning from entertainment. In Proceedings of the 2nd international conference on Digital interactive media in entertainment and arts. ACM, 65--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. GI McCalla, JE Greer, VS Kumar, P Meagher, JA Collins, R Tkatch, and B Parkinson. 1997. A peer help system for workplace training. Artificial Intelligence in Education: Knowledge and Media in Learning Systems (1997), 183--190.Google ScholarGoogle Scholar
  21. Sakata Nobuchika, Kurata Takeshi, and Kuzuoka Hideaki. Visual Assist with a Laser Pointer and Wearable Display for Remote Collaboration. In Proceedings of The Second International Conference on Collaboration Technologies, Vol. 2006. 66--71.Google ScholarGoogle Scholar
  22. Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, and others. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 741--754. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. N Sakata, T Kurata, T Kato, M Kourogi, and H Kuzuoka. 2005. WACL: supporting telecommunications using-wearable active camera with laser pointer. In Wearable Computers, 2003. Proceedings. Seventh IEEE International Symposium on. IEEE, 53--56. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. S Yuen, Gallayanee Yaoyuneyong, and Erik Johnson. 2011. Augmented reality: An overview and five directions for AR in education. Journal of Educational Technology Development and Exchange 4, 1 (2011), 119--140.Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    IoT '17: Proceedings of the Seventh International Conference on the Internet of Things
    October 2017
    211 pages
    ISBN:9781450353182
    DOI:10.1145/3131542

    Copyright © 2017 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 22 October 2017

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    Overall Acceptance Rate28of84submissions,33%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader