Emmanuel Bricard
ABSTRACT
Augmented Reality (AR), part of Industry 4.0 concepts, is an emerging technology with a great potential in assisting humans in a wide range of industrial processes. Among various use-cases, AR has started to be used as a training tool in manual assembly, by enabling workers to access contextualized digital information overlaid in the physical world. However, very few AR solutions have been adopted so far in industrial sectors, mainly because of technical and acceptability issues, as well as the effort to create AR contents. In this paper we present an AR training system designed for and within the framework of manual assembly production. The proposed approach aims to find the right balance between usability, effectiveness, user acceptance and authoring efforts, to address significant industrial challenges and provide an AR training tool adapted to the shop floor context. We demonstrated the usability and effectiveness of the proposed AR system in multiple experiments and comparatively evaluated authoring efforts with the state-of-the-art. Overall, our proposal reported excellent usability scores and was almost unanimously preferred by the participants to the experiments. Authoring was almost twice as fast as the state-of-the-art while the error rate during training was zero, validating therefore the effectiveness of the system.
- 2019. Unity 2019.4.10. https://unity3d.com/unity/whats-new/2019.4.10Google Scholar
- 2019. Vuforia Expert Capture | PTC. https://www.ptc.com/en/products/vuforia/vuforia-expert-captureGoogle Scholar
- 2020. Mixed Reality Toolkit | Microsoft Docs. https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/Google Scholar
- 2021. Overview of Dynamics 365 Guides - Dynamics 365 Mixed Reality | Microsoft. https://docs.microsoft.com/en-us/dynamics365/mixed-reality/guides/Google Scholar
- Şirin Barutçuoǧlu and Meral Azizoǧlu. 2011. Flexible assembly line design problem with fixed number of workstations. International Journal of Production Research 49, 12 (2011), 3691–3714. https://doi.org/10.1080/00207543.2010.492410Google ScholarCross Ref
- Fahmi Bellalouna. 2020. Industrial Use Cases for Augmented Reality Application. 11th IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2020 - ProceedingsSeptember (sep 2020), 10–18. https://doi.org/10.1109/CogInfoCom50765.2020.9237882Google Scholar
- Tim Bosch, Reinier Könemann, Hans De Cock, and Gu Van Rhijn. 2017. The effects of projected versus display instructions on productivity, quality and workload in a simulated assembly task. ACM International Conference Proceeding Series Part F1285 (2017), 412–415. https://doi.org/10.1145/3056540.3076189Google ScholarDigital Library
- Yuval Cohen, Hussein Naseraldin, Atanu Chaudhuri, and Francesco Pilati. 2019. Assembly systems in Industry 4.0 era: a road map to understand Assembly 4.0. International Journal of Advanced Manufacturing Technology 105, 9(2019), 4037–4054. https://doi.org/10.1007/s00170-019-04203-1Google ScholarCross Ref
- Luís Fernando de Souza Cardoso, Flávia Cristina Martins Queiroz Mariano, and Ezequiel Roberto Zorzal. 2020. A survey of industrial augmented reality. Computers & Industrial Engineering 139, November 2019 (jan 2020), 106159. https://doi.org/10.1016/j.cie.2019.106159Google ScholarDigital Library
- Arindam Dey, Mark Billinghurst, Robert W Lindeman, and J. Edward Swan. 2018. A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014. Frontiers in Robotics and AI 5, April (apr 2018). https://doi.org/10.3389/frobt.2018.00037Google Scholar
- Johannes Egger and Tariq Masood. 2020. Augmented reality in support of intelligent manufacturing – A systematic literature review. Computers & Industrial Engineering 140, February 2020 (feb 2020), 106195. https://doi.org/10.1016/j.cie.2019.106195Google ScholarDigital Library
- James Foley D., Andries vad Dam, Steven Feiner K., and John Hughes F.2004. Computer Graphics: Principles and Practice. https://books.google.fr/books?id=-4ngT05gmAQC&printsec=frontcover&redir_esc=y#v=onepage&q&f=falseGoogle Scholar
- Markus Funk, Thomas Kosch, and Albrecht Schmidt. 2016. Interactive worker assistance: Comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous ComputingJuly 2018 (2016), 934–939. https://doi.org/10.1145/2971648.2971706Google ScholarDigital Library
- Florian Jasche, Sven Hofmann, and Thomas Ludwig. 2021. Comparison of diferent types of augmented reality visualizations for instructions. In Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery. https://doi.org/10.1145/3411764.3445724Google ScholarDigital Library
- Gun A. Lee and Gerard J. Kim. 2009. Immersive authoring of Tangible Augmented Reality content: A user study. Journal of Visual Languages and Computing 20, 2 (2009), 61–79. https://doi.org/10.1016/j.jvlc.2008.07.001Google ScholarDigital Library
- Gun A Lee, Gerard J Kim, and Mark Billinghurst. 2005. Immersive authoring: What You eXperience Is What You Get (WYXIWYG). Commun. ACM 48, 7 (2005), 76–81. http://portal.acm.org/citation.cfm?doid=1070838.1070840Google ScholarDigital Library
- Carl Fredrik Lindberg, Sieting Tan, Jinyue Yan, and Fredrik Starfelt. 2015. Key Performance Indicators Improve Industrial Performance. Energy Procedia 75 (aug 2015), 1785–1790. https://doi.org/10.1016/J.EGYPRO.2015.07.474Google Scholar
- Mario Lorenz, Sebastian Knopp, and Philipp Klimant. 2018. Industrial Augmented Reality: Requirements for an Augmented Reality Maintenance Worker Support System. Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018(2018), 151–153. https://doi.org/10.1109/ISMAR-Adjunct.2018.00055Google ScholarCross Ref
- Alberto Martinetti, Henrique Costa Marques, Sarbjeet Singh, and Leo van Dongen. 2019. Reflections on the Limited Pervasiveness of Augmented Reality in Industrial Sectors. Applied Sciences 9, 16 (aug 2019), 3382. https://doi.org/10.3390/app9163382Google ScholarCross Ref
- Tariq Masood and Johannes Egger. 2019. Augmented reality in support of Industry 4.0—Implementation challenges and success factors. Robotics and Computer-Integrated Manufacturing 58, March(2019), 181–195. https://doi.org/10.1016/j.rcim.2019.02.003Google ScholarDigital Library
- Leonel Merino, Magdalena Schwarzl, Matthias Kraus, Michael Sedlmair, Dieter Schmalstieg, and Daniel Weiskopf. 2020. Evaluating Mixed and Augmented Reality: A Systematic Literature Review (2009-2019). (oct 2020). https://doi.org/10.1109/ISMAR50242.2020.00069 arxiv:2010.05988Google Scholar
- Riccardo Palmarini, John Ahmet Erkoyuncu, Rajkumar Roy, and Hosein Torabmostaedi. 2018. A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing 49, March 2017 (feb 2018), 215–228. https://doi.org/10.1016/j.rcim.2017.06.002Google ScholarCross Ref
- Paul Schneider. 2018. Managerial challenges of Industry 4.0: an empirically backed research agenda for a nascent field. Vol. 12. Springer Berlin Heidelberg. 803–848 pages. https://doi.org/10.1007/s11846-018-0283-2Google Scholar
- Keishi Tainaka. 2020. Guideline and Tool for Designing an Assembly Task Support System Using Augmented Reality. (2020), 654–665. https://doi.org/10.1109/ISMAR50242.2020.00077Google Scholar
Index Terms
- Industrial Use-Case : AR for Manual Assembly in Industry
Recommendations
Augmented Reality Training for Industrial Assembly Work - Are Projection-based AR Assistive Systems an Appropriate Tool for Assembly Training?
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsAugmented Reality (AR) systems are on their way to industrial application, e.g. projection-based AR is used to enhance assembly work. Previous studies showed advantages of the systems in permanent-use scenarios, such as faster assembly times. In this ...
An Industry-Adapted AR Training Method for Manual Assembly Operations
HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial IntelligenceAbstractThe adoption of Augmented Reality (AR) in the industry is in early stages, mainly due to technological and organizational limitations. This research work, carried out in a manufacturing factory, aims at providing an effective AR training method ...
Evaluating the effectiveness of augmented reality displays for a manual assembly task
The focus of this research was to examine how effectively augmented reality displays, generated with a wearable computer, could be used for aiding an operator performing a manual assembly task. Fifteen subjects were asked to assemble a computer ...
Comments