Abstract.
A new approach to reconstructing and inspecting the deformation of industrial parts, especially sheetmetal parts based on CAD-designed data and hybrid point-line bundle adjustment with image sequence, is proposed. Nonmetric image sequence and CAD-designed data of parts are used as the source of information. The strategy of our approach is to reconstruct and inspect deformations of parts automatically with image points and line segments extracted from the images. Basic error equation of line photogrammetry and its modified form are addressed in detail. It is shown that when a certain proper weight is selected, adjustment by condition equations and adjustment by observation equations are equivalent for line photogrammetry. A novel hybrid point-line bundle adjustment algorithm is used to reconstruct industrial parts. The proposed hybrid adjustment model can be used in various 3D reconstruction applications of objects mainly composed of points and lines. The developed inspection system is tested with true image data acquired by a CCD camera, and the results are very satisfying.
Similar content being viewed by others
References
Baillard C, Schmid C, Zisserman A(1999) Automatic line matching and 3D reconstruction of buildings from multiple views. Int Arch Photogramm Remote Sens 32:69-80, Part 3-2W5
Debevec PE (1996) Modelling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proceedings of SIGGRAPH
Gruen A (1985) Adaptive least square correlation: a powerful image matching technique. South Afr J Photogramm Remote Sens 14(3):175-187
Kosmopoulos D, Varvarigou T (2001) Automated Inspection of gaps on the automobile production line through stereo vision and specular reflection. Comput Ind 46(1):49-63
Kraus K (1993) Photogrammetry, vol 1: Fundamentals and standard processes. Dümmlers, Bonn
Li D, Zhou G (1994) CAD-based line photogrammetry for automatic measurement and reconstruction of industrial objects. Int Arch Photogramm Remote Sens 30(5):231-240
Moganti M, Ercal F, Dagli Ch(1996) Automatic PCB inspection algorithms: a survey. Comput Vision Image Understand 63(2):287-313
Sablatnig R (1996) Flexible automatic visual inspection based on the separation of detection and analysis. In: Proceedings of ICPR
Schenk T (1999) Digital photogrammetry. TerraScience, Laurelville, OH
Streilein A, Hirschberg U (1995) Integration of digital photogrammetry and CAAD: constraint-based modelling and semi-automatic measurement. In: Proceedings of the CAAD Futures ‘95 international conference, Singapore
van den Heuvel FA (1999) A line-photogrammetry mathematical model for the reconstruction of polyhedral objects. Proc SPIE 3641:60-71
Vosselman G (2001) Semi-automatic CAD based reconstruction of industrial installations. Künstliche Intelligenz 4:23-27
Wang Z (1990) Principles of photogrammetry. Publishing House of Surveying and Mapping, Beijing, PR China
Zhang Y, Zhang Z (2003) Camera calibration technique with planar scenes. In: Proceedings of the 11th conference on machine vision applications in industrial inspection at IS&T/SPIE Electronic Imaging, Santa Clara, CA, 20-24 January 2003, 5011:291-296
Zhang Y, Zhang Z, Zhang J (2003) Multi-view 3D city model generation with image sequences. In: Proceedings of the 6th AGILE conference on geographic information science, Lyon, France, pp 697-701
Author information
Authors and Affiliations
Corresponding author
Additional information
Received: 27 May 2002, Accepted: 18 September 2003, Published online: 8 June 2004
Rights and permissions
About this article
Cite this article
Zhang, Y., Zhang, Z. & Zhang, J. Deformation visual inspection of industrial parts with image sequence. Machine Vision and Applications 15, 115–120 (2004). https://doi.org/10.1007/s00138-004-0136-7
Issue Date:
DOI: https://doi.org/10.1007/s00138-004-0136-7