Abstract
Augmented Reality provides more possibilities for industrial manufacturing to solve the current problems. However, previous researches have been focused on virtual scene visualization and robot trajectory prediction. The investigation of robotic real-time teleoperation using AR is limited, which is still facing great challenges. In this research, a novel method is presented for human-robot interaction for industrial applications based on AR, like assembly. Users can intuitively teleoperate a 6-DOFs industry robot to recognize and locate entities by multi-channel operation via HoloLens2. Augmented reality, as a medium, bridges human zones and robot zones. The system can transform user instructions from virtual multi-channel user interface to robots by communication module in AR environment. The above approaches and related devices are elaborated in this paper. An industrial case is presented to implement and validate the feasibility of the AR-based human-robot interactive system. The results provide evidence to support that AR is one of the efficient methods to realize multi-channel human-robot interaction.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Wang, X.V., et al.: Closed-loop augmented reality towards accurate human-robot collaboration. CIRP Ann. 69(1), 425–428 (2020)
Guo, J., et al.: Real-time Object Detection with Deep Learning for Robot Vision on Mixed Reality Device. IEEE (2021)
Kästner, L., Lambrecht, J.: Augmented-Reality-Based Visualization of Navigation Data of Mobile Robots on the Microsoft Hololens - Possibilities and Limitations (2019)
Huang, J.: A non-contact measurement method based on HoloLens. Int. J. Performabil. Eng. 14, 144 (2018)
Krupke, D., et al.: Comparison of Multimodal Heading and Pointing Gestures for Co-Located Mixed Reality Human-Robot Interaction. IEEE (2018)
Guhl, J., Nguyen, S.T., Kruger, J.: concept and architecture for programming industrial robots using augmented reality with mobile devices like Microsoft HoloLens. Institute of Electrical and Electronics Engineers Inc., Limassol, Cyprus (2017)
Perzanowski, D., et al.: Building a multimodal human-robot interface. IEEE Intell. Syst. App. 16(1), 16–21 (2001)
Vahrenkamp, N., et al.: Workspace analysis for planning human-robot interaction tasks. IEEE Computer Society, Cancun, Mexico (2016)
Muhammad, F., et al.: Creating a Shared Reality with Robots. IEEE Computer Society, Daegu, Republic of Korea (2019)
Hietanen, A., et al.: AR-based interaction for human-robot collaborative manufacturing. Robot. Comput.-Integr. Manuf. 63, 101891 (2022)
Stone, K.A., et al.: Augmented Reality Interface for Industrial Robot Controllers. Institute of Electrical and Electronics Engineers Inc., Orem, UT, United States (2020)
Guhl, J., Hügle, J., Krüger, J.: Enabling human-robot-interaction via virtual and augmented reality in distributed control systems. Procedia CIRP. 76, 167–170 (2018)
Xue, C., Qiao, Y., Murray, N.: Enabling Human-Robot-Interaction for Remote Robotic Operation via Augmented Reality. Virtual Institute of Electrical and Electronics Engineers Inc., Cork, Ireland (2020)
Liang, C., et al.: Robot Teleoperation System Based on Mixed Reality. Osaka Institute of Electrical and Electronics Engineers Inc., Japan (2019)
Azuma, R.T.M.: Augmented Reality A Reality. San Francisco OSA - The Optical Society CA, United States (2017)
Microsoft HoloLens | Mixed Reality Technology for Business. https://www.microsoft.com/en-us/hololens. Accessed 28 Jan 2022
AUBO Collaborative Robot. https://www.aubo-cobot.com/public/. Accessed 28 Jan 2022
Meng, Y., Zhuang, H.Q.: Autonomous robot calibration using vision technology. Robot. Comput. Integr. Manuf. 23(4), 436–446 (2007)
Fan, L., et al.: Using AR and Unity 3D to Support Geographical Phenomena Simu-lations. Institute of Electrical and Electronics Engineers Inc. Virtual, Nanjing, China (2020)
Furlan, R.: The future of augmented reality: Hololens - Microsoft’s AR headset shines despite rough edges [resources-tools and toys]. IEEE Spectr. 53(6), 21 (2016)
Wang, J., et al.: Research on automatic target detection and recognition based on deep learning. J. Visual Commun. Image Represent. 60, 44–50 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Fang, H., Wen, J., Yang, X., Wang, P., Li, Y. (2022). Assisted Human-Robot Interaction for Industry Application Based Augmented Reality. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry. HCII 2022. Lecture Notes in Computer Science, vol 13318. Springer, Cham. https://doi.org/10.1007/978-3-031-06015-1_20
Download citation
DOI: https://doi.org/10.1007/978-3-031-06015-1_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06014-4
Online ISBN: 978-3-031-06015-1
eBook Packages: Computer ScienceComputer Science (R0)