Skip to main content
SpringerLink
Log in

Mixed Reality HMI for Collaborative Robots

  • Conference paper
  • First Online:
Computer Aided Systems Theory – EUROCAST 2022 (EUROCAST 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13789))

Included in the following conference series:

  • 747 Accesses

Abstract

Flexible production systems rely on simple reprogramming solution for the machines on the shop floor. Collaborative Robots play a crucial role in such manufacturing environments showing increasing potential for automation. Using digital twins for bidirectional communication show potential for improving the work between cobot and human. Therefore the development of a Mixed Reality HMI with a Microsoft HoloLens 2 for an ABB GoFa and to evaluate the benefits from such an application was the goal of this project. It was investigated which interfaces are shared by the robot and the HoloLens 2, which data from the robot can be displayed in which form in a mixed reality application and whether it is possible to control the robot with the HoloLens 2. The results show that it is possible to display data from the robot in near real-time and to control the robot with the gesture control of the glasses.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhong, R.Y., Xu, X., Klotz, E., Newman, S.T.: Intelligent manufacturing in the context of Industry 4.0: a review. Engineering 3, 616–630 (2017)

    Article  Google Scholar 

  2. Azuma, R.: A survey of augmented reality. Presence Teleop. Virtual Environ. 6, 355–385 (1997)

    Article  Google Scholar 

  3. Grieves, M.: Digital twin: manufacturing excellence through virtual factory replication (2014)

    Google Scholar 

  4. Gadre, S.Y., Rosen, E., Chien, G., Phillips, E., Tellex, S., Konidaris, G.: End-user robot programming using mixed reality. In: International Conference on Robotics and Automation (ICRA 2019), pp. 2707–2713 (2019)

    Google Scholar 

  5. Puljiz, D., Stöhr, E., Riesterer, K.S., Hein, B., Kröger, T.: Sensorless hand guidance using Microsoft Hololens. In: 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 632–633 (2019)

    Google Scholar 

  6. Chacko, S.M., Armando, G., Vikram, K.: An augmented reality framework for robotic tool-path teaching. Procedia CIRP 93, 1218–1223 (2020). 53rd CIRP Conference on Manufacturing Systems 2020

    Article  Google Scholar 

  7. Stadler, S., Kain, K., Giuliani, M., Mirnig, N., Stollnberger, G., Tscheligi, M.: Augmented reality for industrial robot programmers: workload analysis for task-based, augmented reality-supported robot control. In: 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 179–184 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Division Robotics, ABB AG, Zürich, Switzerland

    Jakob Hörbst

  2. University of Applied Sciences Technikum Wien, Vienna, Austria

    Horst Orsolits

Authors
  1. Jakob Hörbst
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Horst Orsolits
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jakob Hörbst .

Editor information

Editors and Affiliations

  1. University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain

    Roberto Moreno-Díaz

  2. Johannes Kepler University, Linz, Oberösterreich, Austria

    Franz Pichler

  3. Department of Computer Science and Institute of Cybernetics, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain

    Alexis Quesada-Arencibia

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hörbst, J., Orsolits, H. (2022). Mixed Reality HMI for Collaborative Robots. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2022. EUROCAST 2022. Lecture Notes in Computer Science, vol 13789. Springer, Cham. https://doi.org/10.1007/978-3-031-25312-6_63

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-25312-6_63

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-25311-9

  • Online ISBN: 978-3-031-25312-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation