Elsevier

Pattern Recognition

Volume 43, Issue 8, August 2010, Pages 2666-2680
Pattern Recognition

A state of the art in structured light patterns for surface profilometry

https://doi.org/10.1016/j.patcog.2010.03.004Get rights and content

Abstract

Shape reconstruction using coded structured light is considered one of the most reliable techniques to recover object surfaces. Having a calibrated projector–camera pair, a light pattern is projected onto the scene and imaged by the camera. Correspondences between projected and recovered patterns are found and used to extract 3D surface information. This paper presents an up-to-date review and a new classification of the existing techniques. Some of these techniques have been implemented and compared, obtaining both qualitative and quantitative results. The advantages and drawbacks of the different patterns and their potentials are discussed.

Introduction

Three-dimensional measurement constitutes an important topic in computer vision, having different applications such as range sensoring, industrial inspection of manufactured parts, reverse engineering (digitization of complex, free-form surfaces), object recognition, 3D map building, biometrics, clothing design and others. The developed solutions are traditionally categorized into contact and non-contact techniques. Contact measurement techniques have been used for a long time in reverse engineering and industrial inspections. The main problems of contact techniques are their slow performance and the high cost of using mechanically calibrated passive arms [1]. Besides, the fact of touching the object is not feasible for many applications. Non-contact techniques were developed to cope with these problems, and have been widely studied. Non-contact techniques can be classified into two different categories: active and passive. In passive approaches, the scene is first imaged by video cameras from two or more points of view and correspondences between the images are found. It is important to mention that the cameras have to be previously calibrated [2]. The main problem experimented when using this approach is a sparse reconstruction since density is directly related to the texture of the object. This complicates the process of finding correspondences in the presence of textureless surfaces [3]. Therefore, passive reconstruction is rather limited to reconstruct dense 3D surfaces, due to the problem of finding correspondences [4]. Methods based on structured light (active techniques) came to cope with this issue, creating correspondences and giving specific codewords to every unitary position in the image. In this approach one of the cameras is substituted by an active device (a projector), which projects a structured light pattern onto the scene. This active device is modeled as an inverse camera, being the calibration step a similar procedure to the one used in a classical stereo-vision system [5]. The projected pattern imposes the illusion of texture onto an object, increasing the number of correspondences [6]. Therefore, surface reconstruction is possible when looking for differences between projected and recorded patterns.

In this paper, an exhaustive analysis of the different coding strategies used in active structured light is done, focusing on the advancements presented in the last years. A new classification regarding the strategy used to create the pattern is proposed, comparing some common characteristics between them. Feasibility and accuracy are analysed, giving both qualitative and quantitative results for the implemented techniques. This paper is structured as follows: Section 2 presents a classification of the different techniques. Discrete pattern based codification is studied in Section 3, while Section 4 deals with the continuous ones. The results of implementing some of the most relevant techniques are showed in Section 5, comparing their pros and cons. Finally, Section 6 concludes with a discussion of the surveyed methods, pointing out advantages and disadvantages of the most relevant ones.

Section snippets

Classification

Coded structured light (CSL) systems are based on the projection of one pattern or a sequence of patterns that univocally determine the codeword of a pixel within a non-periodic region. CSL has produced many works during the last decades and some recopilatory works can be found in the literature. This is the case of the surveys presented by Batlle et al. [4] and Salvi et al. [7] that analysed the different coded structured light techniques existing in temporal and spatial multiplexing domains

Discrete coding methods

Discrete coding comprises all the methods where the pattern presents a digital profile. These methods are based on spatial or temporal multiplexing. Spatial multiplexing techniques code the pattern using the surrounding of a given feature, while temporal multiplexing creates the codeword by the successive projection of patterns onto the object. In addition, some methods combine spatial and temporal information to take advantage of both techniques. Main contributions and latest proposals of both

Continuous coding methods

This group of methods is constituted by the set of patterns showing continuous variations on intensity or color throughout one or two axis. Among these methods, the use of periodic and absolute patterns can be found. Periodic patterns are used in time multiplexing phase shifting methods (PS) and in frequency multiplexing. Besides, absolute patterns are based on spatial grading.

Experimental results

In order to test the effectiveness of the different strategies proposed in the literature a set of six representative techniques of Table 1 have been implemented and compared. These methods are presented in Table 2.

Three discrete coding and three continuous coding techniques have been chosen and implemented. It is important to mention that all the methods presented here have been implemented directly from the corresponding papers (original code was not available), and the parameters have been

Discussion

A new classification of the different CSL techniques has been proposed embracing and updating the spatial, temporal and frequency multiplexing strategies existing in the literature. Common attributes to all the techniques have been analysed and compared. Moreover, an update of the contributions done during the last years has been performed. Two main groups have been distinguished depending on the discrete or continuous nature of the projected pattern.

Discrete coding is created using stripes or

Conclusion

In this survey, an up-to-date review and a new classification of the different techniques existing in structured light has been proposed. The classification has been done regarding the continuous or discrete nature of the projected pattern, and group together the three different coding/decoding approaches used in CSL. A selection and implementation of representative techniques of every group has been done, and qualitative and quantitative comparisons have been performed extracting advantages

Acknowledgments

This work is supported by the research CICYT Project DPI2007-66796-C03-02 of the Spanish Ministry of Education and Science. S. Fernandez-ii is supported by the Spanish government scholarship FPU.

About the Author—JOAQUIM SALVI graduated in Computer Science at the Technical University of Catalonia in 1993, received the DEA (M.Sc.) in Computer Science in July 1996 and the Ph.D. in Industrial Engineering in 1998 both at the University of Girona, Spain. He is currently an associate professor at the Computer Architecture and Technology Department and a researcher at the Computer Vision and Robotics Group, University of Girona. He is involved in some governmental projects and technology

References (63)

  • C. Chen et al.

    Range data acquisition using color structured lighting and stereo vision

    Image and Vision Computing

    (1997)
  • V. Gushov et al.

    Automatic processing of fringe patterns in integer interferometers

    Optics and Lasers in Engineering

    (1991)
  • E. Hu et al.

    Surface profile measurement of moving objects by using an improved π phase-shifting Fourier transform profilometry

    Optics and Lasers in Engineering

    (2009)
  • W. Chen et al.

    Study on Fourier transforms profilometry based on bi-color projecting

    Optics and Laser Technology

    (2007)
  • H. Yue et al.

    Fourier transform profilometry based on composite structured light pattern

    Optics and Laser Technology

    (2007)
  • W. Chen et al.

    Method for eliminating zero spectrum in Fourier transform profilometry

    Optics and Lasers in Engineering

    (2005)
  • A. Baldi et al.

    On the performance of some unwrapping algorithms

    Optics and Lasers in Engineering

    (2002)
  • M. Gdeisat et al.

    Eliminating the zero spectrum in Fourier transform profilometry using a two-dimensional continuous wavelet transform

    Optics Communications

    (2006)
  • G. Spagnolo et al.

    Contouring of artwork surface by fringe projection and FFT analysis

    Optics and Lasers in Engineering

    (2000)
  • B. Carrihill et al.

    Experiments with the intensity ratio depth sensor

    Computer Vision, Graphics, and Image Processing

    (1985)
  • H. Kawasaki, R. Furukawa, R. Sagawa, Y. Yagi, Dynamic scene shape reconstruction using a single structured light...
  • S. Zhang et al.

    Novel method for structured light system calibration

    Optical Engineering

    (2006)
  • H. Fredricksen

    A survey of full length nonlinear shift register cycle algorithms

    SIAM Review

    (1982)
  • K. Boyer et al.

    Color-encoded structured light for rapid active ranging

    IEEE Transactions on Pattern Analysis and Machine Intelligence

    (1987)
  • T. Monks, J. Carter, C. Shadle, Colour-encoded structured light for digitisation of real-time 3D data, in: Proceedings...
  • J. Pages, J. Salvi, J. Forest, A new optimised de bruijn coding strategy for structured light patterns, in: 17th...
  • J. Pages, J. Salvi, C. Collewet, J. Forest, Optimised De Bruijn patterns for one-shot shape acquisition 23 (2005)...
  • F. Forster

    A high-resolution and high accuracy real-time 3D sensor based on structured light

  • P. Fechteler et al.

    Adaptive color classification for structured light systems

  • M. Tehrani, A. Saghaeian, O. Mohajerani, A new approach to 3D modeling using structured light pattern, in: 3rd...
  • M. Maruyama et al.

    Range sensing by projecting multiple slits with random cuts

    IEEE Transactions on Pattern Analysis and Machine Intelligence

    (1993)
  • Cited by (757)

    • A point cloud optimization method for accurate line-scan 3-D measurement in motion with dynamic disturbance

      2024, Measurement: Journal of the International Measurement Confederation
    • High-speed 360° 3D shape measurement based on visual stereo phase unwrapping method

      2023, Measurement: Journal of the International Measurement Confederation
    View all citing articles on Scopus

    About the Author—JOAQUIM SALVI graduated in Computer Science at the Technical University of Catalonia in 1993, received the DEA (M.Sc.) in Computer Science in July 1996 and the Ph.D. in Industrial Engineering in 1998 both at the University of Girona, Spain. He is currently an associate professor at the Computer Architecture and Technology Department and a researcher at the Computer Vision and Robotics Group, University of Girona. He is involved in some governmental projects and technology transfer contracts to industry. His current interests are in the field of computer vision and mobile robotics, focused on visual SLAM, structured light, stereovision, and camera calibration. He is the leader of the 3D Perception Lab and charter member of the spinoffs AQSense and BonesNotes. Dr. Salvi received the Best Thesis Award in engineering for his Ph.D.

    About the Author—SERGIO FERNANDEZ obtained a B.Sc/M.Sc. in Telecommunication Engineering in Spain, at the University of Sevilla in 2007. He did a stage in image processing at the CSIC research centre (Spain). In 2009 he finished an European M.Sc. in Artificial Vision and Robotics, held in Heriot-Watt University (UK) Universitat de Girona (Spain) and Université de Bourgogne (France). He is currently completing his Ph.D. in 3D surface reconstruction at the Computer Vision and Robotics Group at the University of Girona.

    About the Author—TOMISLAV PRIBANIC received the Dipl.-Eng., M.Sc., and Ph.D. degrees in electrical engineering from the Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia in 1996, 2001, and 2005, respectively. His postgraduate thesis was awarded with Silver medal “Josip Loncar”, award given for an outstanding thesis. In 2004 he spent three months as a visiting researcher at INRIA Rhône-Alpes, France and also, in 2006, 6 months at Fraunhofer Institute for Computer Graphics (IGD) in Darmstadt, Germany. He collaborates actively with Biomechanical laboratory of Peharec Polyclinic in Pula, Croatia, and has been taking a part in the development of a number of SW packages/protocols for human motion analyses, many of which are implemented in the commercials systems. Dr. Pribanic is employed as an Assistant at the Faculty of Electrical Engineering and Computing, University of Zagreb. Also, he is a research collaborator under scientific project granted by Ministry of Science and Technology, Republic of Croatia and some other R&D projects. His research interests are human motion analysis, computer vision, electronic instrumentation and measurements, and biomedical engineering. In 2006 he has founded “Biomechanical seed group” for Croatia, under the supervision of International society of biomechanics (ISB). In 2006 he has won “Vera Johanides”, the award of the Croatian Academy of Engineering to the Young Scientists for an outstanding research performance (an emphasis on the applicability) in the last five years. He is a happily married father of two daughters and a son.

    About the Author—Dr. XAVIER LLADO received the B.Sc. degree in Computer Science from the University of Girona in 1999 before joining the Computer Vision and Robotics Group. He also received the Ph.D. in Computer Engineering from the University of Girona. From 2004 until 2006, he was working as a Post-doctoral Research Assistant in the Department of Computer Science at the Queen Mary, University of London. Currently, he is a lecturer in the Computer Vision and Robotics Group at the University of Girona. His research interests are in the fields of Image Processing, Pattern Recognition and Computer Vision. He is a member of the IEEE.

    View full text