Abstract
Significant effort has been allocated recently by the research community for enabling seamless co-existence and communication between human operators and robots. In that context, the adoption of Augmented Reality (AR) has gained major attention towards supporting the operator's interaction with the robots. This paper aims towards enabling human-robot interaction (HRI) and robot control of mobile manipulators through the development of an AR application providing simple, customisable, and user-friendly interfaces. Robot data such as real-time status and planned pathways are projected to the operator’s augmented environment enhancing their safety awareness. Additionally, interaction tools designed to enable robot control functionalities and holographic indications are tailored to provide real-time information to the operators, following User Experience (UX) design principles. The designed augmented environment is easily interacted with, utilising voice commands and virtual buttons. The implemented functionalities are realised through online communication and data exchange between the AR application and the ROS framework. The proposed application is validated through an industrial scenario from the elevators’ manufacturing industry focusing on the elevator’s electrical panel assembly.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Makris, S.: Cooperating Robots for Flexible Manufacturing. Springer International Publishing, Cham (2021)
Chryssolouris, G.: Manufacturing Systems: Theory and Practice, 2nd edn (2006)
Michalos, G., Makris, S., Spiliotopoulos, J., Misios, I., Tsarouchi, P., Chryssolouris, G.: Robo-partner: seamless human-robot cooperation for intelligent, flexible and safe operations in the assembly factories of the future. Procedia CIRP 23, 71–76 (2014)
Green, S.A., Chen, X.Q., Billinghurst, M., Chase, J.G.: Collaborating with a mobile robot: an augmented reality multimodal interface. IFAC Proc. Vol. 41, 15595–15600 (2008)
Kousi, N., Gkournelos, C., Aivaliotis, S., Giannoulis, C., Michalos, G., Makris, S.: Digital twin for adaptation of robots’ behavior in flexible robotic assembly lines. Procedia Manuf. 28, 121–126 (2019)
Nee, A.Y.C., Ong, S.K., Chryssolouris, G., Mourtzis, D.: Augmented reality applications in design and manufacturing. CIRP Ann. 61, 657–679 (2012)
Lotsaris, K., Gkournelos, C., Fousekis, N., Kousi, N., Makris, S.: AR based robot programming using teaching by demonstration techniques. Procedia CIRP 97, 459–463 (2021)
Acknowledgement
This research has been partially funded by the MASTERLY project, which received funding from the European Union’s research and innovation programme Horizon Europe under the grant agreement 101091800.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Dimosthenopoulos, D., Mountzouridis, G., Michalos, G., Makris, S. (2024). Towards Enabling Intuitive Interaction and Control of Mobile Robots Utilising Augmented Reality Techniques. In: Secchi, C., Marconi, L. (eds) European Robotics Forum 2024. ERF 2024. Springer Proceedings in Advanced Robotics, vol 33. Springer, Cham. https://doi.org/10.1007/978-3-031-76428-8_57
Download citation
DOI: https://doi.org/10.1007/978-3-031-76428-8_57
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-76427-1
Online ISBN: 978-3-031-76428-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)