skip to main content
10.1145/3340764.3340780acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmundcConference Proceedingsconference-collections
research-article

Remote Guidance for Machine Maintenance Supported by Physical LEDs and Virtual Reality

Published: 08 September 2019 Publication History

Abstract

Machines that are used in industry often require dedicated technicians to fix them in case of defects. This involves travel expenses and certain amount of time, both of which may be significantly reduced by installing small extensions on a machine as we describe in this paper. The goal is that an authorized local worker, guided by a remote expert, can fix the problem on the real machine himself. Our approach is to equip a machine with multiple inexpensive LEDs (light-emitting diodes) and a simple micro controller, which is connected to the internet, to remotely light up certain LEDs, that are close to machine parts of interest. The blinking of an LED can be induced on a virtual 3D model (digital twin) of the machine by a remote expert using a virtual reality application to draw the local worker's attention to certain areas. We conducted an initial user study on this concept with 36 participants and found significantly shorter completion times and less errors for our approach compared to only voice guidance with no visual LED feedback.

References

[1]
Ronald T. Azuma. 1997. A survey of augmented realty. Presence: Teleoperators and Virtual Environments 6, 355--385.
[2]
Mark Billinghurst and Hirokazu Kato. 2002. Collaborative augmented reality. Commun. ACM 45, 7.
[3]
Sébastien Bottecchia, Jean-Marc Cieutat, and Jean-Pierre Jessel. 2010. T.A.C: Augmented Reality System for Collaborative Tele-assistance in the Field of Maintenance Through Internet. In Proceedings of the 1st Augmented Human International Conference (AH '10). ACM, Article 14.
[4]
William A. S. Buxton. 1992. Telepresence: Integrating Shared Task and Person Spaces. Proceedings of the Conference on Graphics Interface (GI'92), 123--129.
[5]
Eric Ourcell (ep_jhu) on Flickr 2019. Farecard Machine Maintenance. Retrieved April 15, 2019 from https://www.flickr.com/photos/ep_jhu/8294215082 License: https://creativecommons.org/licenses/by-nc/2.0/legalcode - Changes: Image are cropped, cap of the man changed to a helmet and text removed from blue, yellow and green label.
[6]
ESSERT GmbH 2019. ESSERT Augmented Automation. Retrieved April 05, 2019 from https://www.youtube.com/watch?v=FGLndpaqsXU
[7]
Pavel Gurevich, Joel Lanir, and Benjamin Cohen. 2015. Design and Implementation of TeleAdvisor: a Projection-Based Augmented Reality System for Remote Collaboration. Computer Supported Cooperative Work: CSCW: An International Journal 24, 6, 527--562.
[8]
Juho Hamari, Jonna Koivisto, and Harri Sarsa. 2014. Does Gamification Work? - A Literature Review of Empirical Studies on Gamification. Proceedings of the Annual Hawaii International Conference on System Sciences, 3025--3034.
[9]
Julie Heiser, Barbara Tversky, and Mia Silverman. 2004. Sketches for and from collaboration. Visual and Spatial Reasoning in Design III, 69--78.
[10]
Steven Henderson and Steven Feiner. 2007. Augmented Reality for Maintenance and Repair (ARMAR). Defence Technical Information Center. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.149.4991&rep=rep1&type=pdf
[11]
Steven J. Henderson and Steven Feiner. 2009. Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. Science and Technology Proceedings - IEEE 2009 International Symposium on Mixed and Augmented Reality, ISMAR 2009, 135--144.
[12]
Philipp Ladwig and Christian Geiger. 2019. A Literature Review on Collaboration in Mixed Reality. In Smart Industry & Smart Education, Michael E. Auer and Reinhard Langmann (Eds.). Springer International Publishing, 591--600.
[13]
Joel Lanir, Ran Stone, Benjamin Cohen, and Pavel Gurevich. 2013. Ownership and control of point of view in remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems -CHI '13. ACM Press.
[14]
Paul Milgram and Kishino Fumio. 1994. A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems.
[15]
NXBase 2019. Unsere Assisted Reality LÃűsungen digitalisieren Ihre Prozesse nachhaltig. Retrieved April 05, 2019 from https://nxtbase.io/
[16]
Ohan Oda, Carmine Elvezio, Mengu Sukan, Steven Feiner, and Barbara Tversky. 2015. Virtual Replicas for Remote Assistance in Virtual and Augmented Reality. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15. ACM Press, 405--415.
[17]
Judith S. Olson and Gary M. Olson. 2014. How to make distance work work. interactions 21, 2, 28--35.
[18]
R. Pausch, M. A. Shackelford, and D. Proffitt. 1993. A user study comparing head-mounted and stationary displays. In Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium. 41--45.
[19]
RE'FLEKT GmbH 2019. RE'FLEKT - Augmented, Mixed und Virtual Reality Plattformen. Retrieved April 05, 2019 from https://www.re-flekt.com/de/
[20]
Paolo Sangregorio, Alberto Luigi Cologni, Franklin Caleb Owen, and Fabio Previdi. 2015. An integrated system for supporting remote maintenance services. IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2015-October, 1--4.
[21]
Matthew Tait and Mark Billinghurst. 2015. The Effect of View Independence in a Collaborative AR System. Computer Supported Cooperative Work: CSCW: An International Journal 24, 6, 563--589.
[22]
TeamViewer GmbH 2019. Augmented Reality Support with TeamViewer Pilot. Retrieved April 15, 2019 from https://www.teamviewer.com/de/loesungen/augmented-reality/#gref
[23]
Valve Corporation 2019. Keep Talking and Nobody Explodes. Retrieved April 06, 2019 from https://store.steampowered.com/app/341800/Keep_Talking_and_Nobody_Explodes/
[24]
Colin Ware, Kevin Arthur, and Kellogg S. Booth. 1993. Fish Tank Virtual Reality. In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 37--42.

Cited By

View all
  • (2024)Communication Models for Remote GuidanceComputer‐Supported Collaboration10.1002/9781119719830.ch2(7-40)Online publication date: 24-May-2024
  • (2023)The Value of Extended Reality Techniques to Improve Remote Collaborative Maintenance Operations: A User StudyCONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality10.36253/979-12-215-0289-3.03(23-33)Online publication date: 2023
  • (2023)The Value of Extended Reality Techniques to Improve Remote Collaborative Maintenance Operations: A User StudyCONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality10.36253/10.36253/979-12-215-0289-3.03(23-33)Online publication date: 2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MuC '19: Proceedings of Mensch und Computer 2019
September 2019
863 pages
ISBN:9781450371988
DOI:10.1145/3340764
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Collaboration
  2. Industry 4.0
  3. LED
  4. light emitting diodes
  5. remote machine maintenance
  6. virtual reality

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

MuC'19
MuC'19: Mensch-und-Computer
September 8 - 11, 2019
Hamburg, Germany

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)1
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Communication Models for Remote GuidanceComputer‐Supported Collaboration10.1002/9781119719830.ch2(7-40)Online publication date: 24-May-2024
  • (2023)The Value of Extended Reality Techniques to Improve Remote Collaborative Maintenance Operations: A User StudyCONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality10.36253/979-12-215-0289-3.03(23-33)Online publication date: 2023
  • (2023)The Value of Extended Reality Techniques to Improve Remote Collaborative Maintenance Operations: A User StudyCONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality10.36253/10.36253/979-12-215-0289-3.03(23-33)Online publication date: 2023
  • (2023)A Survey of Computer-Supported Remote Collaboration on Physical ObjectsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42286-7_19(346-368)Online publication date: 25-Aug-2023
  • (2022)HCI and Digital Twins – A Critical LookProceedings of the 25th International Academic Mindtrek Conference10.1145/3569219.3569376(75-88)Online publication date: 16-Nov-2022
  • (2022)Immersive Virtual Reality for Virtual and Digital Twins: A Literature Review to Identify State Of The Art and Perspectives2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00035(114-115)Online publication date: Mar-2022
  • (2021)Tabletop Games in the Age of Remote Collaboration: Design Opportunities for a Socially Connected Game ExperienceProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445512(1-14)Online publication date: 6-May-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media