Abstract
A new approach using the Beltrami representation of a shape for topology-preserving image segmentation is proposed in this paper. Using the proposed model, the target object can be segmented from the input image by a region of user-prescribed topology. Given a target image I, a template image J is constructed and then deformed with respect to the Beltrami representation. The deformation on J is designed such that the topology of the segmented region is preserved as which the object is interior in J. The topology-preserving property of the deformation is guaranteed by imposing only one constraint on the Beltrami representation, which is easy to be handled. Introducing the Beltrami representation also allows large deformations on the topological prior J, so that it can be a very simple image, such as an image of disks, torus, disjoint disks. Hence, prior shape information of I is unnecessary for the proposed model. Additionally, the proposed model can be easily incorporated with selective segmentation, in which landmark constraints can be imposed interactively to meet any practical need (e.g., medical imaging). High accuracy and stability of the proposed model to deal with different segmentation tasks are validated by numerical experiments on both artificial and real images.
Similar content being viewed by others
References
Chan, T.F., Vese, L.A.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)
Chan, T.F., Sandberg, B.Y., Vese, L.A.: Active contours without edges for vector-valued images. J. Vis. Commun. Image Represent. 11(2), 130–141 (1999)
Chan, T.F., Sandberg, B.Y., Vese, L.A.: Active contours without edges for textured images. CAM Rep. 2, 02–39 (2002)
Chan, T.F., Esedoglu, S.: A multiscale algorithm for MumfordShah image segmentation. In: UCLA CAM Report, 03-77 (2003)
Chung, G., Vese, L.A.: Image segmentation using a multilayer level-set approach. Comput. Vis. Sci. 12(6), 267–285 (2009)
Lie, J., Lysaker, M., Tai, X.C.: A variant of the level set method and applications to image segmentation. Math. Comput. 75(255), 1155–1174 (2006)
Chan, T.F., Moelich, M., Sandberg, B.: Some recent developments in variational image segmentation. In: Tai, X.-C., Lie, K.-A., Chan, T.F., Osher, S. (eds.) Image Processing Based on Partial Differential Equations. Springer, Berlin, pp 175-210 (2007)
Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vis. 1(4), 321–331 (1988)
Li, B., Acton, S.T.: Active contour external force using vector field convolution for image segmentation. IEEE Trans. Image Process. 16(8), 2096–2106 (2007)
Zhang, K., Song, H., Zhang, L.: Active contours driven by local image fitting energy. Pattern Recognit. 43(4), 1199–1206 (2010)
McHenry, K., Ponce, J.: A geodesic active contour framework for finding glass. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR06), Vol. 1. IEEE (2006)
Huang, C., Zeng, L.: An active contour model for the segmentation of images with intensity inhomogeneities and bias field estimation. PLoS ONE 10(4), e0120399 (2015)
Chan, T.F., Zhu, W.: Level set based shape prior segmentation. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR05), Vol. 2. IEEE (2005)
Thiruvenkadam, Sheshadri, R., Chan, T.F., Hong, B.W.: Segmentation under occlusions using selective shape prior. In: International Conference on Scale Space and Variational Methods in Computer Vision. Springer, Berlin (2007)
Veksler, O.: Star shape prior for graph-cut image segmentation. In: European Conference on Computer Vision. Springer, Berlin (2008)
Vu, N., Manjunath, B.S.: Shape prior segmentation of multiple objects with graph cuts. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR08). IEEE (2008)
Zitova, B., Flusser, J.: Image registration methods: a survey. Image Vis. Comput. 21(11), 977–1000 (2003)
Glocker, B., Komodakis, N., Tziritas, G., Navab, N., Paragios, N.: Dense image registration through MRFs and efficient linear programming. Med. Image Anal. 12(6), 731–741 (2008)
Glocker, B., Komodakis, N., Paragios, N., Navab, N.: Approximated curvature penalty in nonrigid registration using pairwise MRFs. In: International Symposium on Visual Computing. Springer, Berlin (2009)
Glocker, B., Komodakis, N., Paragios, N., Tziritas, G., Navab, N.: Inter and intra-modal deformable registration: continuous deformations meet efficient optimal linear programming. In: Biennial International Conference on Information Processing in Medical Imaging. Springer, Berlin (2007)
Thirion, J.P.: Image matching as a diffusion process an analogy with Maxwells demons. Med. Image Anal. 2(3), 243–260 (1998)
Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: efficient nonparametric image registration. NeuroImage 45(1), S61–S72 (2009)
Chanwimaluang, T., Fan, G.: Hybrid retinal image registration. IEEE Trans. Inform. Technol. Biomed. 10(1), 129–142 (2006)
Johnson, H.J., Christensen, G.E.: Consistent landmark and intensity-based image registration. IEEE Trans. Med. Imaging 21(5), 450–461 (2002)
Huang, X., Sun, Y., Metaxas, D., Sauer, F., Xu, C.: Hybrid image registration based on configural matching of scale-invariant salient region features. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshop (CVPRW04), vol. 11, pp. 167–174 (2004)
Lam, K.C., Lui, L.M.: Landmark-and intensity-based registration with large deformations via quasi-conformal maps. SIAM J. Imaging Sci. 7(4), 2364–2392 (2014)
Yezzi, A., Zollei, L., Kapur, T.: A variational framework for joint segmentation and registration. In: IEEE Workshop on Mathematical Methods in Biomedical Image Analysis 2001 (MMBIA 2001). IEEE (2001)
Guyader, C.L., Vese, L.A.: A combined segmentation and registration framework with a nonlinear elasticity smoother. Comput. Vis. Image Underst. 115(12), 1689–1709 (2011)
Chen, S., Cremers, D., Radke, R.J.: Image segmentation with one shape prior a template-based formulation. Image Vis. Comput. 30(12), 1032–1042 (2012)
Erdt, M., Steger, S., Sakas, G.: Regmentation: a new view of image segmentation and registration. J. Radiat. Oncol. Inform. 4(1), 1–23 (2012)
Gooya, A., et al.: GLISTR: glioma image segmentation and registration. IEEE Trans. Med. Imaging 31(10), 1941–1954 (2012)
Chan, H.L., Lui, L.M.: Detection of n-dimensional shape deformities using n-dimensional quasi-conformal maps. Geom. Imaging Comput. 1(4), 395–415 (2014)
Lui, L.M., Lam, K.C., Wong, T.W., Gu, X.: Texture map and video compression using Beltrami representation. SIAM J. Imaging Sci. 6(4), 1880–1902 (2013)
Lui, L.M., Zeng, W., Yau, S.T., Gu, X.: Shape analysis of planar multiply-connected objects using conformal welding. IEEE Trans. Pattern Anal. Mach. Intell. 36(7), 1384–1401 (2014)
Lui, L.M., Lam, K.C., Yau, S.T., Gu, X.: Teichmuller mapping (T-map) and its applications to landmark matching registration. SIAM J. Imaging Sci. 7(1), 391–426 (2014)
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of the Eighth IEEE International Conference on Computer Vision 2001 (ICCV 2001), Vol. 2. IEEE (2001)
Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898–916 (2011)
Acknowledgements
L. M. Lui is supported by RGC GRF (Project ID: 402413, 14304715). X. C. Tai is supported by Norwegian Research Council project through ISP-Matematikk (Project no. 239033/F20). The authors would like to thank Martin et al. [36] and P. Arbelaez et al. [37] for providing some of the images used as experimental subjects in this paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chan, HL., Yan, S., Lui, LM. et al. Topology-Preserving Image Segmentation by Beltrami Representation of Shapes. J Math Imaging Vis 60, 401–421 (2018). https://doi.org/10.1007/s10851-017-0767-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-017-0767-8