Skip to main content

Optimal Level Curves and Global Minimizers of Cost Functionals in Image Segmentation

  • Published:
Journal of Mathematical Imaging and Vision Aims and scope Submit manuscript

Abstract

We propose a variational framework for determining global minimizers of rough energy functionals used in image segmentation. Segmentation is achieved by minimizing an energy model, which is comprised of two parts: the first part is the interaction between the observed data and the model, the second is a regularity term. The optimal boundaries are the curves that globally minimize the energy functional. Our motivation comes from the observation that energy functionals are traditionally complex, for which it is usually difficult to precise global minimizers corresponding to “best” segmentations. Therefore, we focus on basic energy models, which global minimizers can be characterized. None of the proposed segmentation models captures all the important scene variables but may be useful to get an insight into objects, surfaces or parts of objects in the scene. In this paper, we prove that the set of curves that minimizes the cost functionals is a subset of level lines, i.e. the boundaries of level sets of the image. For the completeness of the paper, we present a fast algorithm for computing partitions with connected components. It leads to a sound initialization-free algorithm without any hidden parameter to be tuned. We illustrate the performance of our algorithm with several examples on both 2D biomedical and aerial images, and synthetic images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. S.T. Acton and D.P. Mukherjee, “Scale space classification using area morphology,” IEEE Trans. Image Processing, Vol. 9, No. 4, pp. 623–635, 2000.

    Google Scholar 

  2. L. Alvarez, Y. Gousseau, and J.M. Morel, “cales in natural images and a consequence on their bounded variation,” in Int. Conf. on Scale-Space Theories Comp. Vis., Kerkyra, Greece, Sept. 1999, pp. 247–258.

  3. O. Amadieu, E. Debreuve, M. Barlaud, and G. Aubert, “Simultaneous inward and outward curve evolution,” in Int. Conf. on Image Processing, Kobe, Japan, 1999.

  4. J. Beaulieu and M. Goldberg, “Hierarchy in picture segmentation: Astepwise optimization approach,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 11, No. 2, pp. 150–163, 1989.

    Google Scholar 

  5. A. Blake and A. Zisserman, Visual Reconstruction, MIT Press: Cambridge, Mass, 1987.

    Google Scholar 

  6. V. Caselles, B. Coll, and J.M. Morel, “Topographic maps and local contrast changes in natural images,” Int. J. Computer Vision, Vol. 33, No. 1, pp. 5–27, 1999.

    Google Scholar 

  7. V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic active contours,” Int. J. Computer Vision, Vol. 22, No. 1, pp. 61–79, 1997.

    Google Scholar 

  8. T. Chan and L. Vese, “Active contour model without edges,” in Int. Conf. on Scale-Space Theories Comp. Vis., Kerkyra, Greece, Sept. 1999, pp. 141–151.

  9. C. Chang, K. Chen, J. Wang, and M. Althouse, “A relative entropy-based approach to image processing,” Pattern Recognition, Vol. 27, No. 9, pp. 1275–1289, 1994.

    Google Scholar 

  10. C. Chesnaud, P. Réfrégier, and V. Boulet, “Statistical region snake-based segmentation adapted to different physical models,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 21, No. 11, pp. 1145–1157, 2000.

    Google Scholar 

  11. L.D. Cohen. “On active contour models and balloons,” CVGIP: Image Understanding, Vol. 53, No. 2, pp. 211–218, 1991.

    Google Scholar 

  12. L.D. Cohen, “Deformable curves and surfaces in image analysis,” in Int. Conf. Curves and Surfaces, Chamonix, France, July 1996.

  13. T. Darrell and A. Pentland, “Cooperative robust estimation using layers of support,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 17, No. 5, pp. 474–487, 1995.

    Google Scholar 

  14. X. Descombes and F. Kruggel, “A markov pixon information approach for low-level image description,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 21, No. 6, pp. 482–494, 1999.

    Google Scholar 

  15. A. Desolneux, L. Moisan, and J.M. Morel, Maximal Meaningful Events and Applications to Image Analysis, preprint of CMLA, Cachan, France, 2000.

  16. M.A.T. Figueiredo, J.M.N. Leitao, and A.K. Jain, “Unsupervised contour representation and estimation using b-plines and mininim description length criterion,” IEEE Trans. Image Processing, Vol. 6, No. 9, pp. 1075–1087, 2000.

    Google Scholar 

  17. J. Froment, “Perceptible level lines and isoperimetric ratio,” in Int. Conf. on Image Processing, Vancouver, Canada, 2000.

  18. S. Geman and D. Geman, “Stochastic relaxation, gibbs distributions, and the bayesian restoration of images,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 6, No. 6, pp. 721–741, 1984.

    Google Scholar 

  19. U. Grenander and M.I. Miller, “Representations of knowledge in complex systems,” J. Royal Statistical Society, Series B, Vol. 56, No. 4, pp. 549–603, April 1994.

    Google Scholar 

  20. J. Istas, Statistics of Processes and Signal-Image Segmentation, University of Paris VII, 1997.

  21. I.H. Jermyn and H. Ishikawa, “Globally optimal regions and boundaries,” in Int. Conf. on Comp. Vis., Kerkyra, Greece, Sept. 1999, pp. 904–910.

  22. J.N. Kapur, P.K. Sahoo, and A.K.C. Wong, “A new method for gray-level picture thresholding using the entropy of the histogram,” Comp. Vis. Graphics and Image Proc., Vol. 29, pp. 273–285, 1985.

    Google Scholar 

  23. M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active contour models,” Int J. Computer Vision, Vol. 12, No. 1, pp. 321–331, 1987.

    Google Scholar 

  24. C. Kervrann and F. Heitz, “A hierarchical markov modeling approach for the segmentation and tracking of deformable shapes,” Graphical Models and Image Processing, Vol. 60, No. 3, pp. 173–195, 1998.

    Google Scholar 

  25. S. Kichenesamy, A. Kumar, P. Olver, and A. Yezz, “Conformal curvature flows: From transition to active contours,” Archive for Rational Mechanics and Anal., Vol. 134, pp. 275–301, 1996.

    Google Scholar 

  26. G. Koepfler, C. Lopez, and J.M. Morel, “A multiscale algorithm for image segmentation by variational method,” SIAM J. Numerical Analysis, Vol. 31, No. 1, pp. 282–299, 1994.

    Google Scholar 

  27. Y.G. Leclerc, “Constructing simple stable descriptions for image partitioning,” Int. J. Computer Vision, Vol. 3, pp. 73–102, 1989.

    Google Scholar 

  28. L.M. Lorigo, O.D. Faugeras, W.E.L. Grimson, R. Keriven, and R. Kikinis, “Segmentation of bone in clinical knee mri using texture-based geodesic active contours,” in Int. Conf. Medical Image Computing and Computer-Assisted Intervention, Cambridge MA, USA, Oct. 1998, pp. 1195–1204.

  29. G. Matheron, Random Sets and Integral Geometry, JohnWiley: New York, 1975.

    Google Scholar 

  30. T. McInerney and D. Terzopoulos, “T-snakes: Topology adaptive snakes,” Medical Image Analysis, Vol. 4, No. 2, pp. 123–1361, 2000.

    Google Scholar 

  31. J. Møller and R.P. Waagepertersen, “Markov connected component fields,” Adv. in Applied Probability, pp. 1–35, 1998.

  32. P. Monasse and F. Guichard, “Fast computation of a contrastinvariant image representation,” IEEE Trans. Image Processing, Vol. 9, No. 5, pp. 860–872, 2000.

    Google Scholar 

  33. J.M. Morel and S. Solimini, Variational Methods in Image Segmentation, Birkhauser, 1994.

  34. D. Mumford, “The bayesian rationale for energy functionals,” Geometry-Driven Diffusion in Computer Vision, Bart Romeny (Ed.), Kluwer Academic, 1994, pp. 141–153.

  35. D. Mumford and J. Shah, “Optimal approximations by piecewise smooth functions and variational problems,” Communication on Pure and Applied Mathematics, Vol. 42, No. 5, pp. 577–685, 1989.

    Google Scholar 

  36. S. Osher and J. Sethian, “Fronts propagating with curvature dependent speed: Algorithms based on the hamilton-jacobi formulation,” J. Computational Physics, Vol. 79, pp. 12–49, 1988.

    Google Scholar 

  37. F. O'sullivan and M. Qian, “A regularized contrast statistic for object boundary estimation—Implementation and statistical evaluation,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 16, No. 6, pp. 561–570, 1994.

    Google Scholar 

  38. N. Paragios and R. Deriche, “Coupled geodesic active regions for image segmentation: A level set approach,” in Euro. Conf. on Comp. Vis., Vol. 2, Dublin, Ireland, June 2000, pp. 224–240.

  39. T. Pavlidis and Y.T. Liow, “Integrating region growing and edge detection,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 12, pp. 225–233, 1990.

    Google Scholar 

  40. N. Rougon and F. Preteux, “Directional adaptive deformable models for segmentation,” J. Electronic Imaging, Vol. 7, No. 1, pp. 231–256, 1998.

    Google Scholar 

  41. P.K. Sahoo, C. Wilkins, and J. Yeager, “Threshold selection using Renyi's entropy,” Pattern Recognition,Vol. 30, No. 1, pp. 71–84, 1997.

    Google Scholar 

  42. P. Salembier and J. Serra, “Flat zones filtering, connected operators, and filters by reconstruction,” IEEE Trans. Image Processing, Vol. 4, No. 8, pp. 1153–1160, 1995.

    Google Scholar 

  43. C. Samson, L. Blanc-Féraud, G. Aubert, and J. Zerubia, “A level set model for image classification,” in Int. Conf. on Scale-Space Theories Comp. Vis., Kerkyra, Greece, Sept. 1999, pp. 306–317.

  44. C. Schnörr, “A study of a convex variational diffusion approach for image segmentation and feature extraction,” J. Math. Imaging and Vision, Vol. 3, No. 8, pp. 271–292, 1998.

    Google Scholar 

  45. J. Sethian, Level Sets Methods: Evolving Interfaces in Geometry, Fluid Mechanics, Computer Vision, and Material Science, Cambridges University Press: Cambridge, 1996.

    Google Scholar 

  46. L. Vincent and P. Soille, “Watershed in digital spaces: An effi-cient algorithm based on immersion simulations,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 13, No. 6, pp. 583–598, 1991.

    Google Scholar 

  47. J.P. Wang, “Stochastic relaxation on partitions with connected components and its application to image segmentation,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 20, No. 6, pp. 619–636, 1998.

    Google Scholar 

  48. A. Yezzi, A. Tsai, and A. Willsky, “A statistical approach to snakes for bimodal and trimodal imagery,” in Int. Conf. on Comp. Vis., Kerkyra, Greece, Sept. 1999, pp. 898–903.

  49. L. Younes, “Calibrating parameters of cost functionals,” in Euro. Conf. on Comp. Vis., Dublin, Ireland, June 2000.

  50. S.C. Zhu and A. Yuille, “Region competition: Unifying snakes, region growing, and bayes/mdl for multiband image segmentation,” IEEE Trans. Patt. Anal. and Mach. Int., Vol. 18, No. 9, pp. 884–900, 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kervrann, C., Trubuil, A. Optimal Level Curves and Global Minimizers of Cost Functionals in Image Segmentation. Journal of Mathematical Imaging and Vision 17, 153–174 (2002). https://doi.org/10.1023/A:1020685520659

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1020685520659