Abstract
In this paper, we propose a novel robust non-rigid point set registration method adopting a new probability model called inhomogeneous Gaussian mixture models (IGMM), where we regard one point set as the centroids of a Gaussian mixture model and the other point set as the data. The IGMM is defined by applying local features and Gaussian mixture models. Considering the local relationship among neighboring points is stable, a neighborhood structural descriptor, named as local shape context, is first presented. On the basis of local descriptors, we can obtain a measure of compatibility between local features in the point sets. Then, the similarity of the local structure of point neighborhoods can be calculated on the basis of the matching scores. Each Gaussian mixture component is assigned a different weight depending on the feature similarity, which differs from the traditional Gaussian mixture model where each Gaussian mixture component has the same weight. The proposed IGMM makes point pairs with more similar features have bigger probability to formulate a match, while in algorithms based on GMMs, all point pairs have the same probability to construct correspondence points. Finally, we support our claims through regularization theory and formulate registration as a likelihood maximization problem, which is solved by updating transformation parameters and outlier ratios using the expectation maximization algorithm. Extensive comparison and evaluation experiments on synthetic point-sets datasets demonstrate that the proposed approach is robust and achieves superior performance in the presence of non-rigid deformation, noise, outliers and occlusion. In addition, a number of experiments on real images reveal that our proposed algorithm is more applicable than state-of-the-art algorithms.









Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Kybic, J., Vnucko, I.: Approximate all nearest neighbor search for high Dimensional entropy estimation for image registration. Signal Process. 92, 1302–1316 (2012)
Wong, A., Fieguth, P.: Fast phase-based registration of multimodal Image data. Signal Process. 89, 724–737 (2009)
Fitzgibbon, A.W.: Robust registration of 2D and 3D point sets. Image Vis. Comput. 21, 1145–1153 (2003)
Sfikas, K., Theoharis, T.: Non-rigid 3D object retrieval using topological information guided by conformal factors. The Vis. Comput. 28(9), 943–955 (2012)
Leordeanu, M., Hebert, M.: A spectral technique for correspondence problems using pairwise constraints. In: International conference on computer vision (2005)
Jain, A.K., Lee, J., Jin, R.N.: Content-based image retrieval: An application to tattoo images. In: The 16th IEEE international conference on image processing (ICIP), pp. 2745–2748 (2009)
Ma, J., Zhou, H., Zhao, J., Gao, Y., Jiang, J., Tian, J.: Robust feature matching for remote sensing image registration via locally linear transforming. IEEE Trans. Geosci. Remote Sens. 53(12), 6469–6481 (2015)
Tao, W., Sun, K.: Robust point sets matching by fusing feature and spatial information using nonuniform Gaussian mixture models. IEEE Trans. Image Proces. 24(11), 3754–3767 (2015). doi:10.1109/TIP.2015.2449559
Sun, K., Li, P., Tao, W., Tang, Y.: Feature guided biased Gaussian mixture model for image matching. Inf. Sci. 295, 322–336 (2015)
Tao, W., Sun, K.: Asymmetrical Gauss mixture models for point sets matching. In: IEEE conference on compute vision and pattern recognition, pp. 2977–2984 (2014)
Basdogan, C., Oztireli, C.A.: A new feature-based method for robust and efficient rigid-body registration of overlapping point clouds. Vis. Comput. 24(9), 679–688 (2008)
Chen, J., Ma, J., Yang, C., Zheng, S.: Non-rigid point set registration via coherent spatial mapping. Signal Process. 106, 62–72 (2015)
Besel, J.P., Mckay, H.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Chui, H., Rangarajan, A.: A new point matching algorithm for non-rigid registration. Comput. Vis. Image Underst. 89(2), 114–141 (2003)
Tsin, Y., Kanade, T.: A correlation-based approach to robust point set registration. In: The European conference on computer vision, pp. 558–569 (2004)
Jian, B., Vemuri, B.C.: Robust point set registration using Gaussian mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1633–1645 (2011)
Kato, T., Omachi, S., Aso, H.: Asymmetric Gaussian and its application to pattern recognition. In: Proceedings of the joint IAPR international workshop on structural, synactic, and statistical pattern recognition, pp. 505–413 (2002)
Wang, G., Wang, Z., Chen, Y., Zhao, W.: A robust non-rigid point set registration method based on asymmetric Gaussian representation. Comput. Vis. Image Underst. 141, 1077–3142 (2015)
Wang, G., Wang, Z., Zhao, W., Zhou, Q.: Robust point matching using mixture of asymmetric Gaussians for nonrigid transformation. In: Asian conference on computer vision, pp. 433–444 (2015)
Yuille, A.L., Tu, Z.: Robust point matching via vector field consensus. IEEE Trans. Image Process. 23(4), 1706–1721 (2014)
Zhao, J., Ma, J., Tian, J., Ma, J., Zhang, D.: A robust method for vector field learning with application to mismatch removing. In: Proceedings IEEE conference computer visual pattern recognition, pp. 2977–2984 (2011)
Myronenko, A., Song, X.: Point set registration: coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 32(12), 2262–2275 (2010)
Gao, Y., Ma, J., Zhao, J., Tian, J., Zhang, D.: A robust and outlier-adaptive method for non-rigid point registration. Pattern Anal. Appl. (2014). doi:10.1007/s10044-013-0324-z
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 509–522 (2002)
Zheng, Y., Doermann, D.: Robust point matching for nonrigid shapes by preserving local neighborhood structures. IEEE Trans. Pattern Anal. Mach. Intell. 28(4), 643–649 (2006)
Lee, J.H., Won, C.H.: Topology preserving relaxation labeling for non-rigid point matching. IEEE Trans. Pattern Anal. Match. Intell. 33(2), 427–432 (2011)
Yan, X., Wang, W., Zhao, J., Hu, J., Zhang, J., Wan, J.: Relaxation labeling for non-rigid point matching under neighbor preserving. J. Cent. South Univ. 20, 3077–3084 (2013)
Zhao, J., Sun J., Zhou, S., Li, Z.: Inexact point pattern matching algorithm based on relative shape context and probabilistic relaxation labelling. In: The 3rd IEEE international conference on computer research and development (ICCRD), pp. 508–512 (2011)
Deng, W., Zou, H., Guo, F., Lei, L., Zhou, S.: Point pattern matching based on point pair local topology and probabilistic relaxation labeling. Vis. Comput. pp. 1–11 (2016). doi:10.1007/s00371-016-1311-3
Torresani, L., Kolmogorov, V., Rother, C.: Feature correspondence via graph matching: models and global optimization. In: European conference on computer vision (ECCV), pp. 596–609 (2008)
Ma, J., Zhao, J., Tian, J., Tu, Z., Yuille, A.: Robust estimation of nonrigid transformation for point set registration. In Proceedings IEEE conference 810 computer visual pattern recognition, pp. 2147–2154 (2013)
Ma, J., Qiu, W., Zhao, J., Ma, Y., Yuille, A.L., Tu, Z.: Robust \(({L_2}E)\) estimation of transformation for non-rigid registration. IEEE Trans. Signal Process. 63(5), 1115–1129 (2015)
Wang, G., Wang, Z., Chen, Y., Zhou Q., Zhao, W.: Context-aware Gaussian fields for non-rigid point set registration. In: IEEE conference on compute vision and pattern recognition (CVPR), pp. 5811–5819 (2016)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)
Vedaldi, A., Fulkerson, B.: An open and portable library of computer vision algorithms. In: Proceedings of the international conference on multimedia. ACM, pp. 1469–1472 (2010)
Lowe, D.G.: Distinctive image features from scale-invariant key points. Int. J. Comput. Vis. 60, 91–110 (2004)
Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Acknowledgements
We would like to express our gratitude to the associate editor and the reviewers for their time spending and the helpful suggestions, which improve the paper greatly.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Deng, W., Zou, H., Guo, F. et al. A robust non-rigid point set registration method based on inhomogeneous Gaussian mixture models. Vis Comput 34, 1399–1414 (2018). https://doi.org/10.1007/s00371-017-1444-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-017-1444-z