Hybrid offline programming method for robotic welding systems

https://doi.org/10.1016/j.rcim.2021.102238Get rights and content

Highlights

  • Current automatic programming approaches for robotic manufacturing systems have been reviewed.

  • A hybrid offline programming method that combines CAD-based and vision-based offline approaches is proposed.

  • The vision-based and CAD-based activities of the proposed programming method with the support techniques are presented.

  • Vision & CAD interactive activities are proposed to identify the workplace, detect the deviation, and compensated the path.

Abstract

Offline programming is an intuitive and automatic programming generation technique that does not use real robotic systems, thus greatly decreasing the downtime required for system programming, and resulting in enormous savings in terms of labor costs. Currently, offline programming can be generally categorized into computer-aided-design-based (CAD-based) and vision-based approaches; these two types of offline programming approaches have been widely applied in robotic welding systems. However, owing to the highly complex and diverse workpieces needed in the shipbuilding industry, neither of the aforementioned offline programming approaches can fully support the automatic generation of welding programs.

In this paper, a hybrid offline programming method systematically combining CAD-based, vision-based, and vision & CAD interactive activities is proposed to overcome the limitations of current automatic program generation methods for robotic welding systems. In the vision-based activities, the positions of the workpieces are obtained by using geometrical features gathered from the workpieces’ images, whereas in the CAD-based activities, the welding tasks are assigned to different mobile components of the welding torch; then, their welding paths are planned according to the workpieces’ CAD models. The vision & CAD interactive activities enable the mapping between the point cloud of a workpiece and its CAD model, so that the deviations caused by assembly errors can be detected and path compensation data can be determined. The effectiveness of the proposed hybrid offline programming method is demonstrated by integrating it into a subassembly welding robotic system. The experimental results indicate that this method can significantly improve the efficiency, accuracy, and flexibility of the robotic welding system.

Introduction

Robotic welding systems have played an increasingly important role in shipbuilding enterprises, owing to their higher production efficiency, better welding quality, and longer working hours. However, programming for robotic welding systems has long been considered as a challenging task, as it requires specific engineering expertise [1]. To overcome this challenge, two different programming modes (online and offline) have been developed to achieve automatic programming, and are implemented in most current robotic welding systems [2]. Online programming is typically realized using a teaching programming method [3]. Such a methods is always time-consuming, as the robotic system must be manually controlled by an operator to achieve a series of required motions. Moreover, a completely new program must be written if a new workpiece is being processed. As a result, the online programming mode becomes no longer suitable for the current shipbuilding industry, as the ships’ diverse workpieces, often with small batch sizes, can lead to critical losses in programming efficiency.

Offline programming is an automatic programming generation technique that does not require operations in real robotic systems [4], thereby greatly decreasing the downtime required for system programming, and resulting in enormous savings in labor costs [5]. Currently, the offline programming mode can be generally categorized into two types: computer-aided-design-based (CAD-based) offline programming approaches and vision-based offline programming approaches [6]. However, owing to the diverse workpieces with high complexity levels needed in the shipbuilding industry, neither type of offline programming approach can fully support automatic welding program generation. Although a CAD-based offline programming approach can provide the complete geometrical features of workpieces to automatically generate a program, the deviations between the workpieces and CAD model are not considered; therefore, the welding accuracy cannot be guaranteed. With regard to the vision-based programming approach, the welding seams are ideally selected from numerous lines in the image captured by the vision sensor; this is a time-consuming task that largely limits the welding efficiency, especially for workpieces with complex structures.

In this study, a hybrid offline programming method systematically combining CAD-based and vision-based offline approaches is proposed, aiming to overcome the limitations of current automatic program generation methods for robotic welding systems. The remainder of this paper is organized as follows. Section 2 presents a literature review of current programming approaches for robotic manufacturing systems. Section 3 introduces the proposed hybrid offline programming method. The effectiveness of the proposed programming method is demonstrated by integrating it into a subassembly welding robotic system, as described in Section 4. A detailed discussion of the proposed hybrid offline programming method is provided in Section 5, and conclusions are presented in Section 6.

Section snippets

Literature review

In manufacturing enterprises, the operators of a robotic manufacturing system are always considered as the best people for programming certain manufacturing tasks, as they are more familiar with the required manufacturing processes. However, owing to a lack of expertise in programming, the traditional programming methods, by which a program is manually formulated based on code rules, are challenging for operators. As a result, there is a growing demand to make programming easier for robotic

Hybrid offline programming method

In this study, CAD-based and vision-based offline programming approaches are integrated into a hybrid offline programming method to overcome the limitations of current automatic program generation techniques. Fig. 1 illustrates the activities of the proposed hybrid offline programming approach using a UML (Unified Modeling Language) activity diagram. The hybrid offline programming approach can be generally divided into three types of activities: vision-based activities, CAD-based activities,

Brief introduction of robotic welding system

The effectiveness of the hybrid offline programming method proposed in this study was demonstrated by integrating it into a robotic subassembly welding system. Fig. 11 presents the prototype of the architecture for the hybrid offline programming platform, in which the layered application design principle [52] was used to provide users with a modular architecture and allow for future expansion. The human machine interface (HMI) was implemented based on C#, providing users with a graphical

Discussion

In this study, a hybrid offline programming method (along with supported techniques) is introduced in detail. The advantages of the proposed method over the traditional CAD-based offline programming approaches or vision-based offline programming approaches are discussed below, in the context of a comparative experiment.

The authors’ research team adopted a CAD-based offline programming approach in the robotic welding system. In such a programming approach, the positions of the workpieces in the

Conclusions

To help users overcome the limitations of traditional automatic program generation methods, this paper presents a novel offline programming method that systematically combines CAD-based and vision-based offline approaches. The proposed offline programming method can be generally divided into three types of activities: vision-based activities, CAD-based activities, and vision & CAD interactive activities. In the vision-based activities, the positions of the workpieces are obtained by using

Author Statement

Chen Zheng: Conceptualization, Methodology, Writing

Yush An: Software, Writing- Original draft preparation

Zhanxi Wang: Resources, Investigation

Haoyu Wu: Data curation, Visualization

Xiansheng Qin: Supervision

Benoît Eynard: Investigation, Writing- Reviewing and Editing

Yicha Zhang: Formal analysis, Validation

CRediT authorship contribution statement

Chen Zheng: Conceptualization, Methodology, Writing – original draft. Yushu An: Software, Writing – original draft. Zhanxi Wang: Resources, Investigation. Haoyu Wu: Data curation, Visualization. Xiansheng Qin: Supervision. Benoît Eynard: Investigation, Writing – review & editing. Yicha Zhang: Formal analysis, Validation.

Declaration of Competing Interest

The authors declare that there is no conflict of interest regarding the publication of this article.

Acknowledgements

This project is supported by the National Science Foundation of China (Grant No. 51805437), the Natural Science Foundation of Shaanxi Province (Grant No. 2020JQ-187), the Fundamental Research Funds for the Central Universities (Grant No. 31020210506005) and the National Defense Basic Scientific Research Program of China (Grant No. JCKY2018607C004).

References (54)

  • W. Shen et al.

    A welding task data model for intelligent process planning of robotic welding

    Robot. Comput. Integr. Manuf.

    (2020)
  • C. Kohrt et al.

    An online robot trajectory planning and programming support system for industrial use

    Robot. Comput. Integr. Manuf.

    (2013)
  • S. Zivanovic et al.

    An approach for applying STEP-NC in robot machining

    Robot. Comput. Integr. Manuf.

    (2018)
  • D. Ding et al.

    Towards an automated robotic arc-welding-based additive manufacturing system from CAD to finished part

    Comput. Des. Des.

    (2016)
  • T. Lu et al.

    An on-line relative position and orientation error calibration methodology for workcell robot operations

    Robot. Comput. Integr. Manuf.

    (1997)
  • L. Yang et al.

    A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot

    Robot. Comput. Integr. Manuf.

    (2020)
  • A. Lipowski et al.

    Roulette-wheel selection via stochastic acceptance

    Phys. A Stat. Mech. Its Appl.

    (2012)
  • E. Francalanza et al.

    A knowledge-based tool for designing cyber physical production systems

    Comput. Ind.

    (2017)
  • A. Rout et al.

    Advances in weld seam tracking techniques for robotic welding: a review

    Robot. Comput. Integr. Manuf.

    (2019)
  • M. Lanzetta et al.

    On-line control of robotized Gas Metal Arc Welding

    CIRP Ann.

    (2001)
  • M.P. Deisenroth et al.

    On-line programming

    Handb. Ind. Robot.

    (1999)
  • V.S. Bottazzi et al.

    Off-Line robot programming framework

  • P. Božek

    Robot path optimization for spot welding applications in automotive industry

    Teh. Vjesn. Gaz.

    (2013)
  • G. Du et al.

    Online robot teaching with natural human-robot interaction

    IEEE Trans. Ind. Electron.

    (2018)
  • C.Y. Weng et al.

    A telemanipulation-based human–robot collaboration method to teach aerospace masking skills

    IEEE Trans. Ind. Inform.

    (2019)
  • L.A. Hormaza et al.

    On-line training and monitoring of robot tasks through virtual reality

  • K. Krot et al.

    Intuitive methods of industrial robot programming in advanced manufacturing systems

  • Cited by (0)

    View full text