Changchun Ma
ABSTRACT
For the harsh environment and uneven ground during excavator slope repair operations, and to solve the problem of restricted vision of the driver during manual operation, a slope information perception method based on binocular cameras and auxiliary lines along the lower edge of the slope is proposed. The slope and the surrounding environment are matched in three dimensions by the binocular camera and the point cloud is reconstructed, and the auxiliary line point cloud is extracted by point cloud segmentation according to the difference in colour of the point cloud, and fitted to a spatial straight line as the position where the bucket stops working. For the typical working conditions of excavator slope repair construction, the most influential factors were selected for comparison experiments, and it was verified that the perception error of slope-related information by this method is within 4cm. The method can provide accurate information on the distance and coordinates of the slope and the auxiliary line, which improves the disadvantages of manual operation and provides information support for the autonomous slope repair of excavators.
- Zhang L, Zhao J, Long P, An autonomous excavator system for material loading tasks [J]. Science Robotics, 2021, 6(55): eabc3164.Google Scholar
Cross Ref
- Lee, C.S., Bae, J. & Hong, D. Contour control for leveling work with robotic excavator. Int. J. Precis. Eng. Manuf. 14, 2055–2060, 2013.Google Scholar
- T. Tomatsu, K. Nonaka, K. Sekiguchi and K. Suzuki, "Model predictive trajectory tracking control for hydraulic excavator on digging operation," 2015 IEEE Conference on Control Applications (CCA), 2015, pp. 1136-1141.Google Scholar
- Soltani M M, Zhu Z, Hammad A. Framework for location data fusion and pose estimation of excavators using stereo vision [J]. Journal of Computing in Civil Engineering, 2018, 32(6): 04018045.Google ScholarCross Ref
- jiahong Mao, xiaoping Lou, weican Li, yang Zhao, Binocular 3D volume measurement system based on line structured light [J]. optical technology, 2016, 42(01): 10-15.Google Scholar
- Longhua Wang, guohua Zeng, huafeng Hu. Optimal design of binocular vision system for accurate 3D data measurement [J]. Electronic measurement technique, 2022, 45(07): 99-109. DOI:10.19651/j.cnki.emt.2108219.Google Scholar
- X. Mei, X. Sun, M. Zhou, S. Jiao, H. Wang and Xiaopeng Zhang, "On building an accurate stereo matching system on graphics hardware," 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2011, pp. 467-474, doi: 10.1109/ICCVW.2011.6130280.Google Scholar
- Zexiao Xie, Wenjuan Lu. Binocular matching algorithm based on image similar geometric features [J] .China laser, 2014, 41(05): 177-183.Google Scholar
Recommendations
Stereo vision guided telerobotics system for autonomous pick and place operations
AIR '15: Proceedings of the 2015 Conference on Advances In RoboticsIn this work, we manipulate an industrial robot from a remote place through a Local Area Network using a force feedback enabled Phantom haptic device as a master, and a stereo vision system for viewing as well as for depth estimation. We propose and ...
Binocular vision-based 3-D trajectory following for autonomous robotic manipulation
Robotic manipulators that have interacted with uncalibrated environments typically have limited positioning and tracking capabilities, if control tasks cannot be appropriately encoded using available features in the environments. Specifically, to ...
Binocular vision-based robot control with active hand-eye coordination
ECAL'07: Proceedings of the 9th European conference on Advances in artificial lifeTraditional eye-in-hand robotic systems are capable of performing versatile manipulation, but generally they can only observe a restricted workspace. As regards eye-to-hand configurations, tasks can be controlled within the field of view of the vision ...
Comments