Elsevier

Neurocomputing

Volume 151, Part 1, 3 March 2015, Pages 354-363
Neurocomputing

An efficient registration algorithm based on spin image for LiDAR 3D point cloud models

https://doi.org/10.1016/j.neucom.2014.09.029Get rights and content

Abstract

Spin image is a good point feature descriptor of the 3D surface and has been used in model registration for many applications from medical image processing to cooperation of multiple robots. However, researches show that current Spin-Image based Registration (SIR) algorithms present disadvantages in computational efficiency and robustness. Thus in this paper, aiming at 3D model acquired from LiDAR sensor, a new SIR algorithm is proposed to solve these problems. The new algorithm is on the basis of a new-constructed three-dimensional feature space, which, composed of the curvature, the Tsallis entropy of spin image, and the reflection intensity of laser sensor, is combined with the concept of KD-tree to firstly realize the primary key point matching, i.e., to find the Corresponding Point Candidate Set (CPCS). After that, spin-image based corresponding point searching is conducted with respect to each CPCS to precisely obtain the final corresponding points. The most absorbing advantages of the proposed method are as the following two aspects: on one hand, due to the introduction of the extra features, the fault corresponding relation introduced by spin image based method can be effectively reduced and thus the registration precision and robustness can be improved greatly; on the other hand, the CPCS obtained using low-dimensional feature space and KD-tree reduces extraordinarily the computational burden due to spin-image based correspondence searching. This greatly improves the computational efficiency of the proposed algorithm. Finally, in order to verify the feasibility and validity of the proposed algorithm, experiments are conducted and the results are analyzed.

Introduction

Registration of 3D model is of great importance in many applications in which the final information is gained from the combination of various data sources, such as, medical image processing [1], remote sensing [2], environment mapping in autonomous robotics [3], [4], and so on.

In general, 3D model registration can be implemented through solving two sub-problems1: one is feature description and detection, the other is feature matching. The feature often refers to the distinctive and easily detectable local descriptor of 3D models, and it is usually used to denote a piece of information which is relevant for solving the computational task related to a certain applications. Typical feature description and detection methods include “Point Signature”[5], “Principle Curvature”[6] and “Point Feature Histogram”[7], etc. Actually, the feature often determines the basic performance which the whole registration algorithm can finally achieve. While during the procedure of feature matching, the correspondences between the detected features in different models are established, and then transformation map is constructed based on the correspondences if necessary. In order to implementing feature matching, there should be some methods or operators to quantitatively evaluate the difference and similarity of any two features, based on which, searching or optimization algorithms, such as “Iterative closest point”[8], “Chen”[9] and “GA algorithm”[10], are used to find the best “correspondence”.

Most recently, the rapid development of the 3D model registration technique results in its more extensive applications. Nevertheless, applications of the existing 3D model registration algorithms have also encountered some problems, such as algorithm robustness. Here the robustness means that the performance of registration algorithms should be ensured in different conditions (e.g., observing point of view and scale) and insensitive to the uncertain factors (e.g., measurement noises).

As far as the robustness is concerned, spin-image based registration (SIR) algorithms have shown great priority compared to the other existing registration algorithms since it is robust with respect to the data noise, as well as the observing point of view and scale [11]. For example, in reference [12], SIR is used in unstructured 3D point clouds acquired from photos to recognize objects. The experimental results show that it is robust with respect to the scene Gaussian noise. In reference [13], the authors use SIR to register different 3D CT images with large pose differences. Also, the experimental results show the acceptable performance in the aspect of accuracy and robustness. While in reference [14], SIR algorithm is used to test the geometric tolerances in manufacturing processes. Most recently, in reference [15], it is utilized in heavily vegetated environments to realize the relative localization between an air robot and a ground robot.

Spin-image is actually a feature descriptor denoted as a grid based image. Its main idea is to map a 3D model into a 2D plane to describe the local shape of the 3D objects. In order to ensure the robustness, the dimension of the spin image (i.e., the number of the grid) should generally be selected large enough. This, unfortunately, will make the process of constructing a spin-image and similarity evaluating of two spin-images very time consuming (the time complexity linearly relates to the dimension of spin image). Aiming at this problem, there also appear some researches recently. For example, in reference [16], PCA method is used to reduce the dimension of the spin-image feature, so that the total computation requirement can be cut down. In reference [17], Dinh and Kropac propose to use multiple resolution method to reduce the computational burden of spin image based registration algorithm. While in reference [18], SIFT operator is used to reduce the key-point that needs to be considered, and thus the computational burden of the registration can be decreased greatly. Generally, the computational burden of SIR algorithm highly relates to its robustness and the accuracy, and most of the preceding algorithms improve the time efficiency at the cost of robustness and accuracy. That means, problem on how to design new efficient spin-image based registration with ensured robustness and accuracy is still an important and open problem in the related fields.

Thus, in this paper, a new efficient SIR algorithm is proposed. The main ideas of this paper are as follows: Firstly, multiple different feature descriptors (including a simplified spin-image descriptor) are utilized to construct a low-dimensional feature space. In this paper, the curvature, the Tsallis entropy of the spin image feature, and reflection of the LiDAR sensor are considered. Then, the 3D model is resampled and reconstructed using KD-tree structure in the low dimension space. Subsequently, coarse matching is conducted in the low-dimensional space through searching the KD-tree to obtain a so-called candidate correspondence key point set (CCKS). Finally, in the obtained CCKS, fine matching searching is done based on the spin-image feature descriptor. Since the candidate corresponding point set after the coarse matching can be reduced, the computational burden due to spin-image searching can be decreased greatly and the time efficiency of the proposed algorithm can be improved. What׳s more, due to the introduction of the extra features, the fault corresponding relation introduced by spin image based method can also be effectively avoided and thus the registration robustness and precision can be improved obviously.

Section snippets

Related work

In this section, the basic concept of “spin image” and the SIR algorithm are introduced.

The new proposed registration algorithm

In order to reduce the huge computational burden of the TSIR algorithm, a new method, called Low dimensional Feature Space enhanced Spin-Image Registration (LFS-SIR) algorithm, is proposed in this section. The main idea here can be explained as the following three points: 1) some easy-to-be-computed features are used to form a low-dimensional feature space; 2) coarse feature matching is firstly conducted in the new space firstly to obtain a corresponding key point set candidate set; 3)

Experiments and results analysis

In order to verify the feasibility and performance improvement of the new proposed registration algorithm, surrounding map registration experiments are conducted and the test bed is shown as Fig. 5. The test bed is composed of a HOKUYO LiDAR, a PTU-D47 rotating stage which can rotate from 0° to 180°, and a movable holder, which can be moved freely on the ground and the LiDAR pose can be regulated along (so that we can obtain the surrounding map from different position and different point of

Conclusion

In this paper, a new spin image based map registration algorithm is proposed for 3D point cloud model acquired from LiDAR sensor. In the new proposed algorithm, a low-dimensional feature space, composed of the curvature, the Tsallis of spin image, and laser reflection intensity, is firstly constructed; then, a coarse matching researching is conducted in the new constructed feature space using KD-tree scheme; finally, spin-image based fine matching is done in a much smaller searching region to

Yuqing He is an Associate Professor at the State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences. He obtained the bachelor degree at North-eastern University at Qinhuangdao in 2002. Subsequently, he entered into the Shenyang Institute of Automation and obtained the Ph.D. degree in the year of 2008 and then worked that until now. In 2012, he was a visiting researcher at Institute for automatic control theory in Technique University of Dresden. Currently,

References (27)

  • R.B. Rusu

    Semantic 3D object maps for everyday manipulation in human living environments

    KI-Künstliche Intelligenz

    (2010)
  • P.J. Besl et al.

    Method for registration of 3-D shape

    IEEE T. Pattern Anal.

    (1992)
  • C. Yang et al.

    Object modelling by registration of multiple range images

    Image Vision Comput.

    (1992)
  • Cited by (19)

    • An efficient and compact 3D local descriptor based on the weighted height image

      2020, Information Sciences
      Citation Excerpt :

      Similar to the features extracted from the 2D images that have been widely applied in image recognition [20,47] and image retrieval [19,46], 3D features have also been extensively used in 3D object recognition [4,13,15] and 3D object retrieval [1,14,35]. Moreover, they are the key technologies for point cloud registration [16,18,30] and 3D reconstruction [29,33,38,49]. However, obtaining an effective and compact 3D local descriptor is still a challenging task, which faces three major problems.

    • Multi-attribute statistics histograms for accurate and robust pairwise registration of range images

      2017, Neurocomputing
      Citation Excerpt :

      The development of numerous low-cost 3D sensors, e.g., Microsoft Kinect and Intel RealSense, has further promoted such trend in recent years. Pairwise registration of range images is a fundamental and crucial step in many 3D vision tasks, such as 3D object recognition [1], surface registration [2], 3D modeling [3], cultural heritage [4] and robotics [5]. Given two range images, namely a source one and a target one, the aim of pairwise range image registration is to transform the coordinate of the source to that of the target.

    • Point cloud registration method based on supervoxel bidirectional nearest neighbor distance ratio

      2022, Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition)
    View all citing articles on Scopus

    Yuqing He is an Associate Professor at the State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences. He obtained the bachelor degree at North-eastern University at Qinhuangdao in 2002. Subsequently, he entered into the Shenyang Institute of Automation and obtained the Ph.D. degree in the year of 2008 and then worked that until now. In 2012, he was a visiting researcher at Institute for automatic control theory in Technique University of Dresden. Currently, his researches focus on the Nonlinear Estimation and Control for mobile robot sytems, especially set- and statistics- based filter, acceleration feedback control and nonlinear predictive control.

    Yuangang Mei received his bachelor degree in Automation from the University of Science and Technology of China (USTC) and the Master degree in Control Engineering from the the state key laboratory of robotics, Shenyang Institude of Automation, Chinese Academy of Sciences in the year of 2011 and 2014, respectively. He is now an algorithm engineer at ArcSoft, HangZhou, China, and his current research interests include image processing and robotics (point cloud registration, panorama, robotic navigation).

    This work is partially supported by National Natural Science Foundation of China Grant # 61035005 and # 61473282.

    View full text