Abstract
In disaster sites, workers may not be allowed entry due to the risk of secondary disasters. Remote operation of construction machines is then necessary for emergency disaster recovery work. For remote operation of construction machines, a third-person view is effective. External cameras, such as mobile camera vehicles or fixed cameras, are commonly used to display the third-person view in remote construction sites. However, if mobile camera vehicles or external cameras can not be installed on-site, displaying a third-person view is not possible. To solve this problem, in this paper, using a 3D range sensor and fisheye cameras mounted onboard the remotely operated construction machine, we measure the positions and poses of other construction machines and display their 3D models inside a bird’s-eye view which is a reconstructed 3D view. This allows the remote operator to recognize the relative position and pose and easily operate the machine.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chayama, K., et al.: Technology of unmanned construction system in Japan. J. Rob. Mechatron. 26(4), 403–417 (2014)
Sato, R., Kamezaki, M., Sugano, S., Iwata, H.: Gaze pattern analysis in multidisplay systems for teleoperated disaster response robots. In: Proceedings of the 2016 IEEE International Conference on Systems, Man and Cybernetics, pp. 3534–3539 (2016)
Kamezaki, M., Yang, J., Iwata, H., Sugano, S.: Visibility enhancement using autonomous multicamera controls with situational role assignment for teleoperated work machines. J. Field Rob. 33(6), 802–824 (2016)
Sun, W., Iwataki, S., Komatsu, R., Fujii, H., Yamashita, A., Asama, H.: Simultaneous tele-visualization of construction machine and environment using body mounted cameras. In: Proceedings of the 2016 IEEE International Conference on Robotics and Biomimetics, pp. 382–387 (2016)
Komatsu, R., Fujii, H., Tamura, Y., Yamashita, A., Asama, H.: Free viewpoint image generation system using fisheye cameras and a laser rangefinder for indoor robot teleoperation. ROBOMECH J. 7(15), 1–10 (2020)
Olson, E.: AprilTag: a robust and flexible visual fiducial system. In: Proceedings of the 2011 IEEE International Conference on Robotics and Automation, pp. 3400–3407 (2011)
Wang, J., Olson, E.: AprilTag 2: efficient and robust fiducial detection. In: Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4193–4198 (2016)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, pp. 145–152 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sugasawa, Y. et al. (2022). Visualization of Dump Truck and Excavator in Bird’s-eye View by Fisheye Cameras and 3D Range Sensor. In: Ang Jr, M.H., Asama, H., Lin, W., Foong, S. (eds) Intelligent Autonomous Systems 16. IAS 2021. Lecture Notes in Networks and Systems, vol 412. Springer, Cham. https://doi.org/10.1007/978-3-030-95892-3_47
Download citation
DOI: https://doi.org/10.1007/978-3-030-95892-3_47
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95891-6
Online ISBN: 978-3-030-95892-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)