Abstract
Augmented Reality (AR) is used in various industrial contexts like on-site maintenance and can further provide the basis for remote maintenance and remote support applications. This work presents a novel coupled AR-VR approach that supports all common remote-service interactions without transmitting a live camera feed. Instead of that, the expert is using a VR headset and only sees the virtual 3D representation of the machinery. Both can interact with an avatar of each other in AR or VR respectively. A prototype has been implemented using the Microsoft HoloLens 2 AR HMD and the HP Reverb VR headset. Participants connect to a central server component that provides static assets, like the required 3D models, and a second server for real-time collaboration and synchronization of movements, voice, and annotations. By design, this application does not transfer camera data unless especially requested and allowed by the technician.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Daniel F, Abawi R, Haller M (2005) Efficient mixed reality: training applications development. In: Proceedings of TESI (training, education & simulation international), [Digest] // Institution of Electrical Engineers, p 289–294. IEE
Agrawal M, Eloot K, Mancini M, Patel A (2020) Industry 4.0: Reimagining manufacturing operations after covid-19
Azuma RT (1997) A survey of augmented reality. Presence Teleoper Virtual Environ 6(4):355–385
Berkemeier L, Zobel B, Werning S, Ickerott I, Thomas O (2019) Engineering of augmented reality-based information systems. Bus Inf Syst Eng 61(1):67–89
Rokka Chhetri S, Faezi S, Rashid N, Al Faruque MA (2017) Manufacturing supply chain and product lifecycle security in the era of industry 4.0. J Hardw Syst Secur 2(1):51–68
Denning T, Dehlawi Z, Kohno T (2014) In situ with bystanders of augmented reality glasses. In: Proceedings of the SIGCHI conference on human factors in computing systems
Fite-Georgel P (2011) Is there a reality in industrial augmented reality? In: International symposium on mixed and augmented reality, science and technology proceedings. IEEE
Langfinger M, Schneider M, Stricker D, Schotten HD (2017) Addressing security challenges in industrial augmented reality systems. In: 2017 IEEE 15th international conference on industrial informatics (INDIN)
Liagkou V, Salmas D (2018) Chrysostmos Stylios. Realizing virtual reality learning environment for industry 4.0. Procedia CIRP 79:712–717
Masoni R et al (2017) Supporting remote maintenance in industry 4.0 through augmented reality. Procedia Manuf 11:1296–1302
Milgram P, Kushino F (1994) A taxonomy of mixed reality visual displays. IEICE Trans Inf. Syst E77-D(12):1–15
Quandt M, Knoke B, Gorldt C, Freitag M, Thoben K-D (2018) General requirements for industrial augmented reality applications. Procedia CIRP 72:1130–1135
Roesner F, Franziska Roesner K, Kohno T, Molnar D (2014) Security and privacy for augmented reality systems. Commun ACM, 57(4):88–96
Röltgen D, Dumitrescu R (2020) Classification of industrial augmented reality use cases. Procedia CIRP 91:93–100
Fernando de Souza Cardoso L, Cristina Martins Queiroz Mariano F, Roberto Zorzal E (2019) A survey of industrial augmented reality. Comput Ind Eng 139:106159
Varghese A, et al (2015) Smart: secure mobile augmented reality for tele-assistance. In: 2015 Asia Pacific conference on multimedia and broadcasting
Vorraber W, Gasser J, Webb H, Neubacher D, Url P (2020) Assessing augmented reality in production: remote-assisted maintenance with hololens. Procedia CIRP 88:139–144
Acknowledgements
The authors thank ...[redacted]... for their prototyping and implementation work without which this contribution would not have been possible.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Siewert, J.L., Wolf, M., Gerhard, D. (2023). A Privacy Preserving Mixed Reality Approach for Industrial Remote Maintenance Applications. In: Auer, M.E., El-Seoud, S.A., Karam, O.H. (eds) Artificial Intelligence and Online Engineering. REV 2022. Lecture Notes in Networks and Systems, vol 524. Springer, Cham. https://doi.org/10.1007/978-3-031-17091-1_60
Download citation
DOI: https://doi.org/10.1007/978-3-031-17091-1_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-17090-4
Online ISBN: 978-3-031-17091-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)