Skip to main content
SpringerLink
Log in

A cylindrical shape descriptor for registration of unstructured point clouds from real-time 3D sensors

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

To deal with data sets from real-time 3D sensors of RGB-D or TOF cameras, this paper presents a method for registration of unstructured point clouds. We firstly derive intrinsic shape context descriptors for 3D data organization. To replace the Fast-Marching method, a vertex-oriented triangle propagation method is applied to calculate the ’angle’ and ’radius’ in descriptor charting, so that the matching accuracy at the twisting and folding area is significantly improved. Then, a 3D cylindrical shape descriptor is proposed for registration of unstructured point clouds. The chosen points are projected into the cylindrical coordinate system to construct the descriptors. The projection parameters are respectively determined by the distances from the chosen points to the reference normal vector, and the distances from the chosen points to the reference tangent plane and the projection angle. Furthermore, Fourier transform is adopted to deal with orientation ambiguity in descriptor matching. Practical experiments demonstrate a satisfactory result in point cloud registration and notable improvement on standard benchmarks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Agarwal, S., Bhowmick, B.: 3d point cloud registration with shape constraint. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 2199–2203 (2017)

  2. Aubry, M., Schlickewei, U., Cremers, D.: The wave kernel signature: a quantum mechanical approach to shape analysis. In: 2011 IEEE international conference on computer vision workshops (ICCV workshops), pp. 1626–1633 (2011)

  3. Bogo, F., Romero, J., Loper, M., Black, M.J.: Faust: dataset and evaluation for 3d mesh registration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3794–3801 (2014)

  4. Bronstein, M.M., Kokkinos, I.: Scale-invariant heat kernel signatures for non-rigid shape recognition. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1704–1711 (2010)

  5. Chen, Y., Medioni, G.G.: Object modeling by registration of multiple range images. Image Vis. Comput. 10(3), 145–155 (1992)

    Article  Google Scholar 

  6. Elad, A., Kimmel, R.: On bending invariant signatures for surfaces. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1285–1295 (2003)

    Article  Google Scholar 

  7. Frome, A., Huber, D., Kolluri, R., Bülow, T., Malik, J.: Recognizing objects in range data using regional point descriptors. In: European conference on computer vision, pp. 224–237. Springer, New York (2004)

  8. Gozdzik, M., Slot, K.: Object representation using geodesic levels. In: 2007 International Symposium on Information Technology Convergence (ISITC 2007), pp. 222–226. IEEE (2007)

  9. Grundmann, M., Meier, F., Essa, I.: 3d shape context and distance transform for action recognition. In: 2008 19th International Conference on Pattern Recognition, pp. 1–4 (2008)

  10. He, Y., Chen, S.: Advances in sensing and processing methods for three-dimensional robot vision. Int. J. Adv. Rob. Syst. 15(2), 1729881418760623 (2018)

    Google Scholar 

  11. He, Y., Chen, S.: Recent advances in 3d data acquisition and processing by time-of-flight camera. IEEE Access 7, 12495–12510 (2019)

    Article  Google Scholar 

  12. Hu, W., Qu, Y.: 3d reconstruction from multi-view point cloud based on particle system. In: 2009 IITA International Conference on Control, Automation and Systems Engineering (case 2009), pp. 500–503. IEEE (2009)

  13. Jiao, Z., Liu, R., Yi, P., Zhou, D.: A point cloud registration algorithm based on 3d-sift. In: Transactions on Edutainment XV, pp. 24–31. Springer, New York (2019)

  14. Johnson, A.E., Hebert, M.: Using spin images for efficient object recognition in cluttered 3d scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 433–449 (1999)

    Article  Google Scholar 

  15. Kleppe, A.L., Egeland, O.: A curvature-based descriptor for point cloud alignment using conformal geometric algebra. Adv. Appl. Clifford Algebras 28(2), 50 (2018)

    Article  MathSciNet  Google Scholar 

  16. Kokkinos, I., Bronstein, M.M., Litman, R., Bronstein, A.M.: Intrinsic shape context descriptors for deformable shapes. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 159–166. IEEE (2012)

  17. Qi, C.R., Su, H., Mo, K., Guibas, L.J.: Pointnet: Deep learning on point sets for 3d classification and segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 652–660 (2017)

  18. Qin, Y., Han, X., Yu, H., Yu, Y., Zhang, J.: Fast and exact discrete geodesic computation based on triangle-oriented wavefront propagation. ACM Trans. Graph. (TOG) 35(4), 1–13 (2016)

    Article  Google Scholar 

  19. Shi, Y., Thompson, P.M., de Zubicaray, G.I., Rose, S.E., Tu, Z., Dinov, I., Toga, A.W.: Direct mapping of hippocampal surfaces with intrinsic shape context. NeuroImage 37(3), 792–807 (2007)

    Article  Google Scholar 

  20. Sun, J., Ovsjanikov, M., Guibas, L.: A concise and provably informative multi-scale signature based on heat diffusion. In: Computer graphics forum, vol. 28, pp. 1383–1392. Wiley Online Library (2009)

  21. Wang, G., Wang, Y.: Multi-scale heat kernel based volumetric morphology signature. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 751–759, Springer, New York (2015)

  22. Wang, Z., Liu, S., Zhang, J., Chen, S., Guan, Q.: A spatio-temporal crf for human interaction understanding. IEEE Trans. Circ. Syst. Video Technol. 27(8), 1647–1660 (2017)

    Article  Google Scholar 

  23. Yang, J., Cao, Z., Zhang, Q.: A fast and robust local descriptor for 3d point cloud registration. Inf. Sci. 346, 163–179 (2016)

    Article  Google Scholar 

  24. Zhang, J., Chen, S., Liu, S., Guan, Q.: Normalized weighted shape context and its application in feature-based matching. Opt. Eng. 47(9), 097201 (2008)

    Article  Google Scholar 

  25. Zhang, Z.: Microsoft kinect sensor and its effect. IEEE Multimed. 19(2), 4–10 (2012)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Key R&D Program of China (2018YFB1305200), National Natural Science Foundation of China (62020106004) and EUH2020 RISE project-AniAge (691215).

Author information

Authors and Affiliations

  1. Department of Computer Science, Tsinghua University, Beijing, 100084, China

    Yu He

  2. School of Computer Science and Engineering, Tianjin University of Technology, Tianjin, 300384, China

    Shengyong Chen

  3. National Centre for Computer Animation, Bournemouth University, Poole, BH12 5BB, UK

    Hongchuan Yu

  4. Department of Electrical Engineering and Computer Science, Embry-Riddle Aeronautical University, Daytona Beach, Florida, 32114, USA

    Thomas Yang

Authors
  1. Yu He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shengyong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hongchuan Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thomas Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shengyong Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, Y., Chen, S., Yu, H. et al. A cylindrical shape descriptor for registration of unstructured point clouds from real-time 3D sensors. J Real-Time Image Proc 18, 261–269 (2021). https://doi.org/10.1007/s11554-020-01033-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-020-01033-3

Keywords

Search

Navigation