Skip to main content
SpringerLink
Log in

Seam tracking and visual control for robotic arc welding based on structured light stereovision

  • Published:
International Journal of Automation and Computing Aims and scope Submit manuscript

Abstract

A real-time arc welding robot visual control system based on a local network with a multi-level hierarchy is developed in this paper. It consists of an intelligence and human-machine interface level, a motion planning level, a motion control level and a servo control level. The last three levels form a local real-time open robot controller, which realizes motion planning and motion control of a robot. A camera calibration method based on the relative movement of the end-effector connected to a robot is proposed and a method for tracking weld seam based on the structured light stereovision is provided. Combining the parameters of the cameras and laser plane, three groups of position values in Cartesian space are obtained for each feature point in a stripe projected on the weld seam. The accurate three-dimensional position of the edge points in the weld seam can be calculated from the obtained parameters with an information fusion algorithm. By calculating the weld seam parameter from position and image data, the movement parameters of the robot used for tracking can be determined. A swing welding experiment of type V groove weld is successfully conducted, the results of which show that the system has high resolution seam tracking in real-time, and works stably and efficiently.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. G. Bolmsjo, M. Olsson, P. Cederberg, Robotic arc welding-trends and developments for higher autonomy, The Industrial Robot, vol. 29, no. 2, pp: 98–104, 2002.

    Article  Google Scholar 

  2. G.D. Hager, S. Hutchinson, P. I. Corke, A tutorial on visual servo control, IEEE Trans. Robotics and Automation, vol. 12, no. 5, pp: 651–670, 1996.

    Article  Google Scholar 

  3. E. Malis, F. Chaumette, S. Boudet, 2D 1/2 visual servoing, IEEE Transaction on Robotics and Automation, vol. 15, no. 2, pp: 234–246, 1999.

    Google Scholar 

  4. Billibon H. Yoshimi, Peter K. Allen, Active uncalibrated visual servoing, IEEE International Conference on Robotic & Automation, vol. 4, pp: 156–161, San Diego, 1994.

    Google Scholar 

  5. E. Cervera, F. Berry, P. Martinet, Image-based stereo visual servoing: 2D vs. 3D features, 15th Triennial World Congress, Barcelona, Spain, IFAC 2002.

    Google Scholar 

  6. P. I. Corke, M. C. Good, Controller design for high-performance visual servoing, Proceedings 12th World Congress International Federation of Automatic Control, Sydney, vol. 9, pp: 395–398, July 1993.

    Google Scholar 

  7. P. I. Corke, M. C. Good, Dynamic effects in visual closed-loop systems, IEEE Trans. Robotics and Automation, vol. 12, no. 5, pp: 671–683, 1996.

    Article  Google Scholar 

  8. F. Chaumette, E. Malis, 2 1/2 D visual servoing: a possible solution to improve image-based and position-based visual servoings, IEEE International Conference on Robotics and Automation, San Francisco, vol. 1, pp: 630–635, 2000.

    Google Scholar 

  9. E. Malis, F. Chaumette, S. Boudet, Positioning a coarse-calibrated camera with respect to an unknown object by 2D 1/2 visual servoing, IEEE International Conference on Robotics and Automation, Leuven, vol. 2, pp: 1352–1359, 1998.

    Google Scholar 

  10. G. C. Bakos, N. F. Tsagas, J. N. Lygouras, J. Lucas, Long distance non-contact high precision measurements, International Journal of Electronics, vol. 75, no. 6, pp: 1269–1279, 1993.

    Google Scholar 

  11. H. C. Kuo, L. J. Wu, An image tracking system for welded seams using fuzzy logic, Journal of Materials Processing Technology, vol. 120, no. 1–3, pp: 169–185, 2002.

    Article  Google Scholar 

  12. J. S. Kim, Y. T. Son, H. S. Cho, Robust method for vision-based seam tracking in robotic arc welding, Proceedings of the 10th IEEE International Symposium on Intelligent Control, pp: 363–368, 1995.

  13. J. Y. Yu, S. J. Na, Study on vision sensors for seam tracking of height-varying weldment, Part 1: mathematical model, Mechatronics, vol. 7, no. 7, pp: 599–612, 1997.

    Article  Google Scholar 

  14. Jianxin Zhang, Alexandar Djordjevich, Study on laser stripe sensor, Sensors and Actuators A: Physical, vol. 72, pp: 224–228, 1999.

    Article  Google Scholar 

  15. Fengshui Jing, Research on Robot Visual Servo Control and Realization, Ph.D. dissertation, Institute of Automation, Chinese Academy of Sciences, 2001.

  16. O.D. Faugeras, G. Toscani, The calibration problem for stereo, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp: 15–20, 1986.

  17. S D. Ma, A self-calibration technique for active vision system, IEEE Transaction on Robotics and Automation, vol. 12, no. 1, pp: 114–120, 1996.

    Article  Google Scholar 

  18. A. Basu, Active calibration: alternative strategy and analysis, Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, pp: 495–500, 1993.

  19. F. Du, M. Brady, Self-calibration of the intrinsic parameters of camera for active vision system, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp: 477–482, 1993.

  20. R. Hartley, Self-calibration of stationary cameras, International Journal of Computer Vision, vol. 229, no. 1, pp: 2–5, 1997.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory of Complex Systems and Intelligence Science, Institute of Automation, Chinese Academy of Sciences, Beijing, 100080, PRC

    De Xu, Min Tan, Xiaoguang Zhao & Zhiguo Tu

Authors
  1. De Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaoguang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhiguo Tu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to De Xu.

Additional information

This work was supported by the National High Technology Research and Development Program of China under Grant 2002AA422160, and by the National Key Fundamental Research and the Development Project of China (973) under Grant 2002CB312200.

De Xu graduated from Shandong University of Technology (SUT), China, in 1985. He received a Masters degree from SUT in 1990 and a Ph.D. degree from Zhejiang University, China, in 2001. He has been with Institute of Automation, Chinese Academy of Sciences (IACAS) since 2001. He is an associate professor with the Laboratory of Complex Systems and Intelligence Science, IACAS. His research interests include robotics and automation, especially the control of robots such as visual control and intelligent control.

Min Tan graduated from Tsing Hua University, China, in 1986. He received a Ph.D. degree in 1990 from IACAS. He has been with IACAS since then. He is a professor with the Laboratory of Complex Systems and Intelligence Science, IACAS. His research interests include robotics and complex system theory.

Xiaoguang Zhao graduated from Shenyang University of Technology, China, in 1992. She received a Masters degree and Ph.D. degree from Shenyang Institute of Automation, Chinese Academy of Sciences in 1998 and 2001 respectively. She is a post doctoral fellow with IACAS. Her research interests include robot control and machine vision.

Zhiguo Tu graduated from Central South University, China, in 2000. He is a postgraduate with IACAS. His research interests include robot control and remote control.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xu, D., Tan, M., Zhao, X. et al. Seam tracking and visual control for robotic arc welding based on structured light stereovision. Int J Automat Comput 1, 63–75 (2004). https://doi.org/10.1007/s11633-004-0063-0

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11633-004-0063-0

Keywords

Search

Navigation