Skip to main content
SpringerLink
Log in

A robust non-rigid point set registration method based on inhomogeneous Gaussian mixture models

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we propose a novel robust non-rigid point set registration method adopting a new probability model called inhomogeneous Gaussian mixture models (IGMM), where we regard one point set as the centroids of a Gaussian mixture model and the other point set as the data. The IGMM is defined by applying local features and Gaussian mixture models. Considering the local relationship among neighboring points is stable, a neighborhood structural descriptor, named as local shape context, is first presented. On the basis of local descriptors, we can obtain a measure of compatibility between local features in the point sets. Then, the similarity of the local structure of point neighborhoods can be calculated on the basis of the matching scores. Each Gaussian mixture component is assigned a different weight depending on the feature similarity, which differs from the traditional Gaussian mixture model where each Gaussian mixture component has the same weight. The proposed IGMM makes point pairs with more similar features have bigger probability to formulate a match, while in algorithms based on GMMs, all point pairs have the same probability to construct correspondence points. Finally, we support our claims through regularization theory and formulate registration as a likelihood maximization problem, which is solved by updating transformation parameters and outlier ratios using the expectation maximization algorithm. Extensive comparison and evaluation experiments on synthetic point-sets datasets demonstrate that the proposed approach is robust and achieves superior performance in the presence of non-rigid deformation, noise, outliers and occlusion. In addition, a number of experiments on real images reveal that our proposed algorithm is more applicable than state-of-the-art algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Kybic, J., Vnucko, I.: Approximate all nearest neighbor search for high Dimensional entropy estimation for image registration. Signal Process. 92, 1302–1316 (2012)

    Article  Google Scholar 

  2. Wong, A., Fieguth, P.: Fast phase-based registration of multimodal Image data. Signal Process. 89, 724–737 (2009)

    Article  MATH  Google Scholar 

  3. Fitzgibbon, A.W.: Robust registration of 2D and 3D point sets. Image Vis. Comput. 21, 1145–1153 (2003)

    Article  Google Scholar 

  4. Sfikas, K., Theoharis, T.: Non-rigid 3D object retrieval using topological information guided by conformal factors. The Vis. Comput. 28(9), 943–955 (2012)

    Article  Google Scholar 

  5. Leordeanu, M., Hebert, M.: A spectral technique for correspondence problems using pairwise constraints. In: International conference on computer vision (2005)

  6. Jain, A.K., Lee, J., Jin, R.N.: Content-based image retrieval: An application to tattoo images. In: The 16th IEEE international conference on image processing (ICIP), pp. 2745–2748 (2009)

  7. Ma, J., Zhou, H., Zhao, J., Gao, Y., Jiang, J., Tian, J.: Robust feature matching for remote sensing image registration via locally linear transforming. IEEE Trans. Geosci. Remote Sens. 53(12), 6469–6481 (2015)

    Article  Google Scholar 

  8. Tao, W., Sun, K.: Robust point sets matching by fusing feature and spatial information using nonuniform Gaussian mixture models. IEEE Trans. Image Proces. 24(11), 3754–3767 (2015). doi:10.1109/TIP.2015.2449559

  9. Sun, K., Li, P., Tao, W., Tang, Y.: Feature guided biased Gaussian mixture model for image matching. Inf. Sci. 295, 322–336 (2015)

    Article  MathSciNet  Google Scholar 

  10. Tao, W., Sun, K.: Asymmetrical Gauss mixture models for point sets matching. In: IEEE conference on compute vision and pattern recognition, pp. 2977–2984 (2014)

  11. Basdogan, C., Oztireli, C.A.: A new feature-based method for robust and efficient rigid-body registration of overlapping point clouds. Vis. Comput. 24(9), 679–688 (2008)

    Article  Google Scholar 

  12. Chen, J., Ma, J., Yang, C., Zheng, S.: Non-rigid point set registration via coherent spatial mapping. Signal Process. 106, 62–72 (2015)

    Article  Google Scholar 

  13. Besel, J.P., Mckay, H.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  14. Chui, H., Rangarajan, A.: A new point matching algorithm for non-rigid registration. Comput. Vis. Image Underst. 89(2), 114–141 (2003)

    Article  MATH  Google Scholar 

  15. Tsin, Y., Kanade, T.: A correlation-based approach to robust point set registration. In: The European conference on computer vision, pp. 558–569 (2004)

  16. Jian, B., Vemuri, B.C.: Robust point set registration using Gaussian mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1633–1645 (2011)

    Article  Google Scholar 

  17. Kato, T., Omachi, S., Aso, H.: Asymmetric Gaussian and its application to pattern recognition. In: Proceedings of the joint IAPR international workshop on structural, synactic, and statistical pattern recognition, pp. 505–413 (2002)

  18. Wang, G., Wang, Z., Chen, Y., Zhao, W.: A robust non-rigid point set registration method based on asymmetric Gaussian representation. Comput. Vis. Image Underst. 141, 1077–3142 (2015)

    Article  Google Scholar 

  19. Wang, G., Wang, Z., Zhao, W., Zhou, Q.: Robust point matching using mixture of asymmetric Gaussians for nonrigid transformation. In: Asian conference on computer vision, pp. 433–444 (2015)

  20. Yuille, A.L., Tu, Z.: Robust point matching via vector field consensus. IEEE Trans. Image Process. 23(4), 1706–1721 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  21. Zhao, J., Ma, J., Tian, J., Ma, J., Zhang, D.: A robust method for vector field learning with application to mismatch removing. In: Proceedings IEEE conference computer visual pattern recognition, pp. 2977–2984 (2011)

  22. Myronenko, A., Song, X.: Point set registration: coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 32(12), 2262–2275 (2010)

    Article  Google Scholar 

  23. Gao, Y., Ma, J., Zhao, J., Tian, J., Zhang, D.: A robust and outlier-adaptive method for non-rigid point registration. Pattern Anal. Appl. (2014). doi:10.1007/s10044-013-0324-z

  24. Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 509–522 (2002)

    Article  Google Scholar 

  25. Zheng, Y., Doermann, D.: Robust point matching for nonrigid shapes by preserving local neighborhood structures. IEEE Trans. Pattern Anal. Mach. Intell. 28(4), 643–649 (2006)

    Article  Google Scholar 

  26. Lee, J.H., Won, C.H.: Topology preserving relaxation labeling for non-rigid point matching. IEEE Trans. Pattern Anal. Match. Intell. 33(2), 427–432 (2011)

    Article  Google Scholar 

  27. Yan, X., Wang, W., Zhao, J., Hu, J., Zhang, J., Wan, J.: Relaxation labeling for non-rigid point matching under neighbor preserving. J. Cent. South Univ. 20, 3077–3084 (2013)

    Article  Google Scholar 

  28. Zhao, J., Sun J., Zhou, S., Li, Z.: Inexact point pattern matching algorithm based on relative shape context and probabilistic relaxation labelling. In: The 3rd IEEE international conference on computer research and development (ICCRD), pp. 508–512 (2011)

  29. Deng, W., Zou, H., Guo, F., Lei, L., Zhou, S.: Point pattern matching based on point pair local topology and probabilistic relaxation labeling. Vis. Comput. pp. 1–11 (2016). doi:10.1007/s00371-016-1311-3

  30. Torresani, L., Kolmogorov, V., Rother, C.: Feature correspondence via graph matching: models and global optimization. In: European conference on computer vision (ECCV), pp. 596–609 (2008)

  31. Ma, J., Zhao, J., Tian, J., Tu, Z., Yuille, A.: Robust estimation of nonrigid transformation for point set registration. In Proceedings IEEE conference 810 computer visual pattern recognition, pp. 2147–2154 (2013)

  32. Ma, J., Qiu, W., Zhao, J., Ma, Y., Yuille, A.L., Tu, Z.: Robust \(({L_2}E)\) estimation of transformation for non-rigid registration. IEEE Trans. Signal Process. 63(5), 1115–1129 (2015)

    Article  MathSciNet  Google Scholar 

  33. Wang, G., Wang, Z., Chen, Y., Zhou Q., Zhao, W.: Context-aware Gaussian fields for non-rigid point set registration. In: IEEE conference on compute vision and pattern recognition (CVPR), pp. 5811–5819 (2016)

  34. Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)

    Article  Google Scholar 

  35. Vedaldi, A., Fulkerson, B.: An open and portable library of computer vision algorithms. In: Proceedings of the international conference on multimedia. ACM, pp. 1469–1472 (2010)

  36. Lowe, D.G.: Distinctive image features from scale-invariant key points. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  37. Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

We would like to express our gratitude to the associate editor and the reviewers for their time spending and the helpful suggestions, which improve the paper greatly.

Author information

Authors and Affiliations

  1. National University of Defense Technology, No.109, Deya Road, Yanwachi Street, Kaifu District, Changsha, 410073, Hunan, China

    Wanxia Deng, Huanxin Zou, Fang Guo, Lin Lei, Shilin Zhou & Tiancheng Luo

Authors
  1. Wanxia Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huanxin Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fang Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lin Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shilin Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tiancheng Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huanxin Zou.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Deng, W., Zou, H., Guo, F. et al. A robust non-rigid point set registration method based on inhomogeneous Gaussian mixture models. Vis Comput 34, 1399–1414 (2018). https://doi.org/10.1007/s00371-017-1444-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-017-1444-z

Keywords

Search

Navigation