Abstract
The paper deals with the utilisation of augmented reality on the operator control panel of a teleoperated mobile robot. The work is a continuation of the previous research, which resulted in the creation and successful practical implementation of a virtual operator station based on the virtual reality head-mounted display (HMD) Oculus Rift. The new approach suggests using the new Microsoft Hololens augmented reality headset to add the virtual control elements directly to the real world, which has some very important benefits – especially the fact that the operator is not visually isolated from his surroundings. The device is introduced in the beginning of the article and then follows the description of all tasks required to create the augmented reality operator station. Mentioned are also other possible ways of using augmented reality to assist the operator of a mobile robot.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cybernet: Operator Control Unit. http://www.cybernet.com/products/robotics.html
Orpheus Robotic System Project. http://www.orpheus-project.cz/
Fong, T., Thorpe, C.: Vehicle teleoperation interfaces. Auton. Robots. 11, 9–18 (2001). ISSN 0929-5593
Wikipedia: Head-mounted Display. http://en.wikipedia.org/wiki/Head-mounted_display
Oculus VR: Oculus Rift. http://www.oculusvr.com/rift/
HTC: Vive. https://www.vive.com/us/
Sony: PlayStation VR. https://www.playstation.com/cs-cz/explore/playstation-vr/
Františ, P., Hodický, J.: Human machine interface in command and control system. In: Proceedings of 2010 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems, VECIMS 2010, pp. 38–41 (2010). Art. no. 5609345
Františ, P., Hodický, J.: Virtual reality in presentation layer of C3I system. In: Proceedings of International Congress on Modelling and Simulation: Advances and Applications for Management and Decision Making, MODSIM 2005, pp. 3045–3050 (2005)
Chen, G.S., Chen, J.P.: Applying virtual reality to remote control of mobile robot. In: Proceedings of the 2nd International Conference on Intelligent Technologies and Engineering Systems (ICITES 2013), pp. 383–390 (2013)
Benaoumeur, I., Zoubir, A., Reda, H.E.A.: Remote control of mobile robot using the virtual reality. Int. J. Electr. Comput. Eng. (IJECE) 5(5), 1062–1074 (2015)
Kot, T., Novák, P.: Utilization of the Oculus Rift HMD in mobile robot teleoperation. Appl. Mech. Mater. 555, 199–208 (2014). ISBN 978-3-03835-111-5
Kot, T., Novák, P., Babjak, J.: Virtual operator station for teleoperated mobile robots. In: International Workshop on Modelling and Simulation for Autonomous Systems, MESAS 2015, Prague, Czech Republic, 29–30 April 2015, pp. 144–153 (2015). ISBN 978-3-319-22383-4
CAFR. http://www.cafr.cz/
Oculus Support Centre: My Oculus Rift Headset isn’t Connecting. https://support.oculus.com/526448734199646
Wikipedia: Virtual Reality. https://en.wikipedia.org/wiki/Virtual_reality
Wikipedia: Augmented Reality. https://en.wikipedia.org/wiki/Augmented_reality
CNET: Augmented Reality comes to Mobile Phones. https://www.cnet.com/news/augmented-reality-comes-to-mobile-phones/
Vuzix: AR3000 Series of Smart Glasses. https://www.vuzix.com/Products/Series-3000-Smart-Glasses
Sony: SmartEyeglass Developer Edition. https://developer.sonymobile.com/products/smarteyeglass/
Epson: Moverio BT-200. https://www.epson.cz/products/see-through-mobile-viewer/moverio-bt-200
Meta: Meta 2 AR. http://www.metavision.com/
Microsoft: Microsoft HoloLens. http://www.metavision.com/
Department of Robotics: Mobile Robot Hercules. http://robot.vsb.cz/mobile-robots/hercules/
Microsoft: HoloLens Hardware Details. https://developer.microsoft.com/en-us/windows/mixed-reality/hololens_hardware_details
Unity: Unity Game Engine. https://unity3d.com/
Aguiar, J., Pinto, A.M., Cruz, N.A., Matos, A.C.: The impact of convergence cameras in a stereoscopic system for AUVs. In: International Conference Image Analysis and Recognition, pp. 521–529 (2016). ISBN 978-3-319-41500-0
Hayes, J.: Is Augmented Reality a Breakthrough for Field Service Teams. http://www.engineering.com/DesignSoftware/DesignSoftwareArticles/ArticleID/12434/
Acknowledgements
This article has been elaborated in the framework of the research project “Augmented Reality Lab” under the programme “Support of Science and Research in the Moravian-Silesian Region 2016” (RCC/08/2016) and supported by the specific research project HS3541602 in cooperation with VOP CZ s. p. The article was also supported by the project “Research Centre of Advanced Mechatronic Systems” (Ministry of Education, Youth and Sports of the Czech Republic).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Kot, T., Novák, P., Babjak, J. (2018). Application of Augmented Reality in Mobile Robot Teleoperation. In: Mazal, J. (eds) Modelling and Simulation for Autonomous Systems. MESAS 2017. Lecture Notes in Computer Science(), vol 10756. Springer, Cham. https://doi.org/10.1007/978-3-319-76072-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-76072-8_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-76071-1
Online ISBN: 978-3-319-76072-8
eBook Packages: Computer ScienceComputer Science (R0)