Skip to main content
Log in

Topology-Preserving Image Segmentation by Beltrami Representation of Shapes

  • Published:
Journal of Mathematical Imaging and Vision Aims and scope Submit manuscript

Abstract

A new approach using the Beltrami representation of a shape for topology-preserving image segmentation is proposed in this paper. Using the proposed model, the target object can be segmented from the input image by a region of user-prescribed topology. Given a target image I, a template image J is constructed and then deformed with respect to the Beltrami representation. The deformation on J is designed such that the topology of the segmented region is preserved as which the object is interior in J. The topology-preserving property of the deformation is guaranteed by imposing only one constraint on the Beltrami representation, which is easy to be handled. Introducing the Beltrami representation also allows large deformations on the topological prior J, so that it can be a very simple image, such as an image of disks, torus, disjoint disks. Hence, prior shape information of I is unnecessary for the proposed model. Additionally, the proposed model can be easily incorporated with selective segmentation, in which landmark constraints can be imposed interactively to meet any practical need (e.g., medical imaging). High accuracy and stability of the proposed model to deal with different segmentation tasks are validated by numerical experiments on both artificial and real images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Chan, T.F., Vese, L.A.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)

    Article  MATH  Google Scholar 

  2. Chan, T.F., Sandberg, B.Y., Vese, L.A.: Active contours without edges for vector-valued images. J. Vis. Commun. Image Represent. 11(2), 130–141 (1999)

    Article  Google Scholar 

  3. Chan, T.F., Sandberg, B.Y., Vese, L.A.: Active contours without edges for textured images. CAM Rep. 2, 02–39 (2002)

    Google Scholar 

  4. Chan, T.F., Esedoglu, S.: A multiscale algorithm for MumfordShah image segmentation. In: UCLA CAM Report, 03-77 (2003)

  5. Chung, G., Vese, L.A.: Image segmentation using a multilayer level-set approach. Comput. Vis. Sci. 12(6), 267–285 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  6. Lie, J., Lysaker, M., Tai, X.C.: A variant of the level set method and applications to image segmentation. Math. Comput. 75(255), 1155–1174 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  7. Chan, T.F., Moelich, M., Sandberg, B.: Some recent developments in variational image segmentation. In: Tai, X.-C., Lie, K.-A., Chan, T.F., Osher, S. (eds.) Image Processing Based on Partial Differential Equations. Springer, Berlin, pp 175-210 (2007)

  8. Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vis. 1(4), 321–331 (1988)

    Article  MATH  Google Scholar 

  9. Li, B., Acton, S.T.: Active contour external force using vector field convolution for image segmentation. IEEE Trans. Image Process. 16(8), 2096–2106 (2007)

    Article  MathSciNet  Google Scholar 

  10. Zhang, K., Song, H., Zhang, L.: Active contours driven by local image fitting energy. Pattern Recognit. 43(4), 1199–1206 (2010)

    Article  MATH  Google Scholar 

  11. McHenry, K., Ponce, J.: A geodesic active contour framework for finding glass. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR06), Vol. 1. IEEE (2006)

  12. Huang, C., Zeng, L.: An active contour model for the segmentation of images with intensity inhomogeneities and bias field estimation. PLoS ONE 10(4), e0120399 (2015)

    Article  Google Scholar 

  13. Chan, T.F., Zhu, W.: Level set based shape prior segmentation. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR05), Vol. 2. IEEE (2005)

  14. Thiruvenkadam, Sheshadri, R., Chan, T.F., Hong, B.W.: Segmentation under occlusions using selective shape prior. In: International Conference on Scale Space and Variational Methods in Computer Vision. Springer, Berlin (2007)

  15. Veksler, O.: Star shape prior for graph-cut image segmentation. In: European Conference on Computer Vision. Springer, Berlin (2008)

  16. Vu, N., Manjunath, B.S.: Shape prior segmentation of multiple objects with graph cuts. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR08). IEEE (2008)

  17. Zitova, B., Flusser, J.: Image registration methods: a survey. Image Vis. Comput. 21(11), 977–1000 (2003)

    Article  Google Scholar 

  18. Glocker, B., Komodakis, N., Tziritas, G., Navab, N., Paragios, N.: Dense image registration through MRFs and efficient linear programming. Med. Image Anal. 12(6), 731–741 (2008)

    Article  Google Scholar 

  19. Glocker, B., Komodakis, N., Paragios, N., Navab, N.: Approximated curvature penalty in nonrigid registration using pairwise MRFs. In: International Symposium on Visual Computing. Springer, Berlin (2009)

  20. Glocker, B., Komodakis, N., Paragios, N., Tziritas, G., Navab, N.: Inter and intra-modal deformable registration: continuous deformations meet efficient optimal linear programming. In: Biennial International Conference on Information Processing in Medical Imaging. Springer, Berlin (2007)

  21. Thirion, J.P.: Image matching as a diffusion process an analogy with Maxwells demons. Med. Image Anal. 2(3), 243–260 (1998)

    Article  Google Scholar 

  22. Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: efficient nonparametric image registration. NeuroImage 45(1), S61–S72 (2009)

    Article  Google Scholar 

  23. Chanwimaluang, T., Fan, G.: Hybrid retinal image registration. IEEE Trans. Inform. Technol. Biomed. 10(1), 129–142 (2006)

    Article  Google Scholar 

  24. Johnson, H.J., Christensen, G.E.: Consistent landmark and intensity-based image registration. IEEE Trans. Med. Imaging 21(5), 450–461 (2002)

    Article  Google Scholar 

  25. Huang, X., Sun, Y., Metaxas, D., Sauer, F., Xu, C.: Hybrid image registration based on configural matching of scale-invariant salient region features. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshop (CVPRW04), vol. 11, pp. 167–174 (2004)

  26. Lam, K.C., Lui, L.M.: Landmark-and intensity-based registration with large deformations via quasi-conformal maps. SIAM J. Imaging Sci. 7(4), 2364–2392 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  27. Yezzi, A., Zollei, L., Kapur, T.: A variational framework for joint segmentation and registration. In: IEEE Workshop on Mathematical Methods in Biomedical Image Analysis 2001 (MMBIA 2001). IEEE (2001)

  28. Guyader, C.L., Vese, L.A.: A combined segmentation and registration framework with a nonlinear elasticity smoother. Comput. Vis. Image Underst. 115(12), 1689–1709 (2011)

    Article  Google Scholar 

  29. Chen, S., Cremers, D., Radke, R.J.: Image segmentation with one shape prior a template-based formulation. Image Vis. Comput. 30(12), 1032–1042 (2012)

    Article  Google Scholar 

  30. Erdt, M., Steger, S., Sakas, G.: Regmentation: a new view of image segmentation and registration. J. Radiat. Oncol. Inform. 4(1), 1–23 (2012)

    Google Scholar 

  31. Gooya, A., et al.: GLISTR: glioma image segmentation and registration. IEEE Trans. Med. Imaging 31(10), 1941–1954 (2012)

    Article  Google Scholar 

  32. Chan, H.L., Lui, L.M.: Detection of n-dimensional shape deformities using n-dimensional quasi-conformal maps. Geom. Imaging Comput. 1(4), 395–415 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  33. Lui, L.M., Lam, K.C., Wong, T.W., Gu, X.: Texture map and video compression using Beltrami representation. SIAM J. Imaging Sci. 6(4), 1880–1902 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  34. Lui, L.M., Zeng, W., Yau, S.T., Gu, X.: Shape analysis of planar multiply-connected objects using conformal welding. IEEE Trans. Pattern Anal. Mach. Intell. 36(7), 1384–1401 (2014)

    Article  Google Scholar 

  35. Lui, L.M., Lam, K.C., Yau, S.T., Gu, X.: Teichmuller mapping (T-map) and its applications to landmark matching registration. SIAM J. Imaging Sci. 7(1), 391–426 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  36. Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of the Eighth IEEE International Conference on Computer Vision 2001 (ICCV 2001), Vol. 2. IEEE (2001)

  37. Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898–916 (2011)

    Article  Google Scholar 

Download references

Acknowledgements

L. M. Lui is supported by RGC GRF (Project ID: 402413, 14304715). X. C. Tai is supported by Norwegian Research Council project through ISP-Matematikk (Project no. 239033/F20). The authors would like to thank Martin et al. [36] and P. Arbelaez et al. [37] for providing some of the images used as experimental subjects in this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lok-Ming Lui.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chan, HL., Yan, S., Lui, LM. et al. Topology-Preserving Image Segmentation by Beltrami Representation of Shapes. J Math Imaging Vis 60, 401–421 (2018). https://doi.org/10.1007/s10851-017-0767-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10851-017-0767-8

Keywords

Navigation