Abstract
A localization method based on distance function of projected features is presented to solve the accuracy reduction or failure problem due to occlusion and blurring caused by smog, when dealing with vision based localization for target oil and gas wellhead (OGWH). Firstly, the target OGWH is modeled as a cylinder with marker, and a vector with redundant parameter is used to describe its pose. Secondly, the explicit mapping relationship between the pose vector with redundant parameter and projected features is derived. Then, a 2D-point-to-feature distance function is proposed, as well as its derivative. Finally, based on this distance function and its derivative, an algorithm is proposed to estimate the pose of target OGWH directly according to the 2D image information, and the validity of the method is verified by both synthetic data and real image experiments. The results show that this method is able to accomplish the localization in the case of occlusion and blurring, and its anti-noise ability is good especially with noise ratio of less than 70%.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
J. H. Su, H. Qiao, Z. C. Ou, Z. Y. Liu. Vision-based caging grasps of polyhedron-like workpieces with a binary industrial gripper. IEEE Transactions on Automation Science and Engineering, vol. 12, no. 3, pp. 1033–1046, 2015.
F. Zhou, W. Zheng, Z. F. Wang. Adaptive noise identification in vision-assisted motion estimation for unmanned aerial vehicles. International Journal of Automation and Computing, vol. 12, no. 4, pp. 413–420, 2015.
C. L. Wang, T. M. Wang, J. H. Liang, Y. C. Zhang, Y. Zhou. Bearing-only visual SLAM for small unmanned aerial vehicles in GPS-denied environments. International Journal of Automation and Computing, vol. 10, no. 5, pp. 387–396, 2013.
L. Wang, J. F. Cao, C. Z. Han. Superquadrics modelbased 3D object localization algorithm. Robot, vol. 35, no. 4, pp. 439–448, 2013. (in Chinese)
M. Y. Liu, O. Tuzel, A. Veeraraghavan, Y. Taguchi, T. K. Marks, R. Chellappa. Fast object localization and pose estimation in heavy clutter for robotic bin picking. The International Journal of Robotics Research, vol. 31, no. 8, pp. 951–973, 2012.
R. Safaee-Rad, I. Tchoukanov, K. C. Smith, B. Benhabib. Three-dimensional location estimation of circular features for machine vision. IEEE Transactions on Robotics and Automation, vol. 8, no. 5, pp. 624–640, 1992.
Z. Chen, J. B. Huang. A vision-based method for the circle pose determination with a direct geometric interpretation. IEEE Transactions on Robotics and Automation, vol. 15, no. 6, pp. 1135–1140, 1999.
W. F. Xu, Q. Xue, H. D. Liu, X. D. Du, B. Liang. A pose measurement method of a non-cooperative GEO spacecraft based on stereo vision. In Proceedings of the 12th International Conference on Control Automation Robotics & Vision, IEEE, Guangzhou, China, pp. 966–971, 2012.
Z. Z. Wei, G. J. Zhang. Distortion error model of image of ellipse center in 3D visual inspection. Journal of Beijing University of Aeronautics and Astronautics, vol. 29, no. 2, pp. 140–143, 2003. (in Chinese)
Y. C. Shiu, C. Huang. Pose determination of circular cylinders using elliptical and side projections. In Proceedings of IEEE International Conference on Systems Engineering, IEEE, Dayton, USA, pp. 265–268, 1991.
C. Doignon, M. de Mathelin. A degenerate conic-based method for a direct fitting and 3D pose of cylinders with a single perspective view. In Proceedings of International Conference on Robotics and Automation, IEEE, Roma, Italy, pp. 4220–4225, 2007.
Z. X. Wang, Z. Q. Wu, X. J. Zhen, R. D. Yang, J. T. Xi. Iteration-based direct ellipse-specific algebraic fitting method of incomplete spots for onsite threedimensional measurement. Optical Engineering, vol. 54, no. 1, pp. 013109, 2015.
S. P. Fu, J. B. Zhao, R. B. Xia, W. J. Liu. Annular mirror based extrinsic camera automatic calibration. Robot, vol. 37, no. 3, pp. 277–285, 2015.
C. Liu, W. D. Hu. Relative pose estimation for cylindershaped spacecrafts using single image. IEEE Transactions on Aerospace and Electronic Systems, vol. 50, no. 4, pp. 3036–3056, 2014.
L. M. Zhu, Z. H. Xiong, H. Ding, Y. L. Xiong. A distance function based approach for localization and profile error evaluation of complex surface. Journal of Manufacturing Science and Engineering, vol. 126, no. 3, pp. 542–554, 2004.
R. Hartley, A. Zisserman. Multiple View Geometry in Computer Vision, Cambridge, UK: Cambridge University Press, pp. 322, 2003.
F. Bergamasco, L. Cosmo, A. Albarelli, A. Torsello. A robust multi-camera 3D ellipse fitting for contactless measurements. In Proceedings of the 2nd International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, IEEE, Zurich, Switzerland, pp. 168–175, 2012.
G. Taubin. Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 11, pp. 1115–1138, 1991.
D. W. Marquardt. An algorithm for least-squares estimation of nonlinear parameters. Journal of the Society for Industrial and Applied Mathematics, vol. 11, no. 2, pp. 431–441, 1963.
M. A. Fischler, R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, vol. 24, no. 6, pp. 381–395, 1981.
Acknowledgement
The authors would like to thank Gang Rao and Dan Huang of Tsinghua University for their help in the real image experiment.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by National Natural Science Foundation of China (No. 61403226), and the State Key Laboratory of Tribology of China (No. SKLT09A03).
Recommended by Associate Editor De Xu
Ying Xie received the B. Sc. degree in mechanical engineering from Shanghai Jiao Tong University, China in 2010. He is currently a Ph. D. degree candidate in the Department of Mechanical Engineering, Tsinghua University, China.
His research interests include robot vision, robot localization, and robot calibration.
ORCID iD: 0000-0002-2812-9311
Xiang-Dong Yang received the B. Sc., M. Sc. and Ph.D. degree degrees in mechanical engineering from Tsinghua University, China in 1989, 1990 and 1995, respectively. Currently, he is an associate professor in the Department of Mechanical Engineering at Tsinghua University, China. He is a senior member of Chinese Mechanical Engineering Society (CMES).
His research interests include robotics and automatic control system.
ORCID iD: 0000-0002-9976-8591
Zhi Liu received the B. Sc. degree in mechanical engineering from Central South University, China in 2010. He is currently a Ph.D. degree candidate in mechanical engineering of Department of Mechanical Engineering, Tsinghua University, China.
His research interests include robot assembly, robot control, and robot vision.
Shu-Nan Ren received the B. Sc. degree in mechanical engineering from Harbin Institute of Technology, China in 2011. He is currently a Ph. D. degree candidate in mechanical engineering of Department of Mechanical Engineering, Tsinghua University, China.
His research interests include robot painting, robot control and planning.
Ken Chen received the B. Sc. degree in mechanical engineering from Sichuan University, China in 1981, the M. Sc. and Ph.D. degrees in mechanical engineering from Zhejiang University, China in 1984 and 1987, respectively. Currently, he is a professor in the Department of Mechanical Engineering at Tsinghua University, China. He has published over 200 journal and conference papers. He is a member of ASME and IEEE, senior member of Chinese Mechanical Engineering Society (CMES), and member of Life-electronic Sciences Committee and National Mechanical Higher education Direction Committee.
His research interests include robotics and bionics, special manipulating and mobile robots, humanoid robots and bio-robots, integration and automation for mechatronic system.
Rights and permissions
About this article
Cite this article
Xie, Y., Yang, XD., Liu, Z. et al. Method for visual localization of oil and gas wellhead based on distance function of projected features. Int. J. Autom. Comput. 14, 147–158 (2017). https://doi.org/10.1007/s11633-017-1063-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11633-017-1063-1