Skip to main content
SpringerLink
Log in

Isophotes Selection and Reaction-Diffusion Model for Object Boundaries Estimation

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

This paper investigates generic region-based segmentation schemes using area-minimization constraint and background modeling, and develops a computationally efficient framework based on level lines selection coupled with biased anisotropic diffusion. A common approach to image segmentation is to construct a cost function whose minima yield the segmented image. This is generally achieved by competition of two terms in the cost function, one that punishes deviations from the original image and another that acts as a regularization term. We propose a variational framework for characterizing global minimizers of a particular segmentation energy that can generates irregular object boundaries in image segmentation. Our motivation comes from the observation that energy functionals are traditionally complex, for which it is usually difficult to precise global minimizers corresponding to “best” segmentations. In this paper, we prove that the set of curves that minimizes the basic energy model under concern is a subset of level lines or isophotes, i.e. the boundaries of image level sets. The connections of our approach with region-growing techniques, snakes and geodesic active contours are also discussed. Moreover, it is absolutely necessary to regularize isophotes delimiting object boundaries and to determine piecewise smooth or constant approximations of the image data inside the objects boundaries for vizualization and pattern recognition purposes. Thus, we have constructed a reaction-diffusion process based on the Perona-Malik anisotropic diffusion equation. In particular, a reaction term has been added to force the solution to remain close to the data inside object boundaries and to be constant in non-informative regions, that is the background region. In the overall approach, diffusion requires the design of the background and foreground regions obtained by segmentation, and segmentation of the adaptively smoothed image is performed after each iteration of the diffusion process. From an application point of view, the sound initialization-free algorithm is shown to perform well in a variety of imaging contexts with variable texture, noise and lighting conditions, including optical imaging, medical imaging and meteorological imaging. Depending on the context, it yields either a reliable segmentation or a good pre-segmentation that can be used as initialization for more sophisticated, application-dependent segmentation models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Acton, S. and Mukherjee, D. 2000. Scale space classification using area morphology. IEEE Trans. Image Processing, 9(4):623–635.

    Google Scholar 

  • Alvarez, L. and Esclarin, J. 1997. Image quantization using reaction-diffusion equations. SIAM Journal of Applied Mathematics, 57(1):153–175.

    Google Scholar 

  • Alvarez, L., Gousseau, Y., and Morel, J. 1999. Scales in natural images and a consequence on their bounded variation. In Int. Conf. on Scale-Space Theories Comp. Vis., Kerkyra, Greece, pp. 247–258.

  • Alvarez, L., Guichard, F., Lions, P., and Morel, J. 1993. Axioms and fundamental equations in image processing. Arch. Rational Mech. Aanalysis, 16(9):200–257.

    Google Scholar 

  • Alvarez, L., Lions, P., and Morel, J. 1992. Image selective smoothing and edge detection by non-linear diffusion—2. SIAM J. Numerical Analysis, 29(3):845–866.

    Google Scholar 

  • Alvarez, L. and Mazorra, L. 1994. Signal and image restoration using shock filters and anisotropic diffusion. SIAM Journal of Numerical Analysis, 31(2):590–605.

    Google Scholar 

  • Amadieu, O., Debreuve, E., Barlaud, M., and Aubert, G. 1999. Simultaneous inward and outward curve evolution. In Int. Conf. on Image Processing, Kobe, Japan.

  • Beaulieu, J. and Goldberg, M. 1989. Hierarchy in picture segmentation: A stepwise optimization approach. IEEE Trans. Patt. Anal. and Mach. Int., 11(2):150–163.

    Google Scholar 

  • Black, M. and Rangarajan, A. 1996. On the unification of line processes, outlier rejection, and robust statistics with applications in early vision. Int. J. Computer Vision, 19(1):57–92.

    Google Scholar 

  • Black, M. and Sapiro, G. 1999. Edges as outliers: Smoothing using local image statistics. In Int. Conf. on Scale-Space Theories Comp. Vis., Kerkyra, Greece, pp. 259–270.

  • Black, M., Sapiro, G., Marimont, D., and Heeger, D. 1998. Robust anisotropic diffusion. IEEE Trans. Image Processing, 7(3):421–432.

    Google Scholar 

  • Blake, A. and Zisserman, A. 1987. Visual Reconstruction. MIT Press: Cambridge, Mass.

    Google Scholar 

  • Caselles, V., Coll, B., and Morel, J. 1999. Topographic maps and local contrast changes in natural images. Int J. Computer Vision, 33(1):5–27.

    Google Scholar 

  • Caselles, V., Kimmel, R., and Sapiro, G. 1997. Geodesic active contours. Int J. Computer Vision, 22(1):61–79.

    Google Scholar 

  • Caselles, V., Morel, J., Sapiro, G., and Tannenbaum, A. 1998. Special issue on partial differential equations and geometry-driven diffusion in image processing and analysis. IEEE Trans. Image Processing, 7(3):269–473.

    Google Scholar 

  • Catte, F., Lions, P., Morel, J., and, T., C. 1992. Image selective smoothing and edge detection by non-linear diffusion. SIAM J. Numerical Analysis, 29(1):182–193.

    Google Scholar 

  • Chan, T. and Vese, L. 1999. Active contour model without edges. In Int. Conf. on Scale-Space Theories Comp. Vis., Kerkyra, Greece, pp. 141–151.

  • Charbonnier, P., Blanc-Feraud, L., Aubert, G., and Barlaud, M. 1997. Deterministic edge-preserving regularization in computed imaging. IEEE Trans. Image Processing, 6(2):298–311.

    Google Scholar 

  • Chesnaud, C., Réfrégier, P., and Boulet, V. 2000. Statistical region snake-based segmentation adapted to different physical models. IEEE Trans. Patt. Anal. and Mach. Int., 21(11):1145–1157.

    Google Scholar 

  • Chu, C. and Agarwal, J. 1993. The integration of image segmentation maps using region and edge information. IEEE Trans. Patt. Anal. and Mach. Int., 15:1242–1252.

    Google Scholar 

  • Cohen, L. 1991. On active contour models and balloons. CVGIP: Image Understanding, 53(2):211–218.

    Google Scholar 

  • Cohen, L. 1996. Deformable curves and surfaces in image analysis. In Int. Conf. Curves and Surfaces, Chamonix, France.

  • Darrell, T. and Pentland, A. 1995. Cooperative robust estimation using layers of support. IEEE Trans. Patt. Anal. and Mach. Int., 17(5):474–487.

    Google Scholar 

  • Deriche, R. 1987. Using canny's criteria to derive a recursively implemented optimal edge detector. Int J. Computer Vision, 2(1):167–187.

    Google Scholar 

  • Figueiredo, M., Leitao, J., and Jain, A. 2000. Unsupervised contour representation and estimation using b-plines and mininim description length criterion. IEEE Trans. Image Processing, 6(9):1075–1087.

    Google Scholar 

  • Froment, J. 2000. Perceptible level lines and isoperimetric ratio. In Int. Conf. on Image Processing, Vancouver, Canada.

  • Geiger, D. and Yuille, A. 1991. A common framework for image segmentation. Int. J. Computer Vision, 6(3):1186–1191.

    Google Scholar 

  • Geman, S. and Geman, D. 1984. Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Trans. Patt. Anal. and Mach. Int., 6(6):721–741.

    Google Scholar 

  • Grenander, U. and Miller, M. 1994. Representations of knowledge in complex systems. J. Royal Statistical Society, Series B, 56(4):549–603.

    Google Scholar 

  • Ishikawa, H. and Geiger, D. 1998. Segmentation by grouping junc-tions. In Comp. Vis. and Patt. Rec., Santa Barbara, CA.

  • Istas, J. 1997. Statistics of Processes and Signal-Image Segmentation. University of Paris VII.

  • Jermyn, I. and Ishikawa, H. 1999. Globally optimal regions and boundaries. In Int. Conf. on Comp. Vis., Kerkyra, Greece, pp. 904–910.

  • Kass, M., Witkin, A., and Terzopoulos, D. 1987. Snakes: Active contour models. Int. J. Computer Vision, 12(1):321–331.

    Google Scholar 

  • Kichenesamy, S., Kumar, A., Olver, P., and Yezzi, A. 1996. Conformal curvature flows: From transition to active contours. Archive for Rational Mechanics and Anal., 134:275–301.

    Google Scholar 

  • Koepfler, G., Lopez, C., and Morel, J. 1994. A multiscale algorithm for image segmentation by variational method. SIAM J. Numerical Analysis, 31(1):282–299.

    Google Scholar 

  • Kornprobst, P., Deriche, R., and Aubert, G. 1997. Image coupling, restoration and enhancement via pde's. In Int. Conf. on Image Processing, Santa Barbara, USA, pp. 458–461.

  • Leclerc, Y. 1989. Constructing simple stable descriptions for image partitioning. Int. J. Computer Vision, 3:73–102.

    Google Scholar 

  • Malladi, M. and Sethian, J. 1996. Image processing: Flows under min/max curvature and mean curvature. Graphical Models and Image Processing, 58(2):127–141.

    Google Scholar 

  • Matheron, G. 1975. Random Sets and Integral Geometry. John Wiley: New York.

    Google Scholar 

  • Merriman, B., Bebce, J., and Osher, S. 1994. Motion of multiple junctions: A level set approach. J. Comput. Physics, 112(2):334–363.

    Google Scholar 

  • Monasse, P. and Guichard, F. 2000. Fast computation of a contrast-invariant image representation. IEEE Trans. Image Processing, 9(5):860–872.

    Google Scholar 

  • Morel, J. and Solimini, S. 1994. Variational Methods in Image Segmentation. Birkhauser.

  • Mumford, D. 1994. The bayesian rationale for energy functionals. In Geometry-Driven Diffusion in Computer Vision, Bart Romeny (Ed.). Kluwer Academic: Dordrecht, pp. 141–153.

    Google Scholar 

  • Mumford, D. and Shah, J. 1989. Optimal approximations by piecewise smooth functions and variational problems. Com. on Pure and applied Mathematics, 42(5):577–685.

    Google Scholar 

  • Nitzberg, N. and Mumford, D. 1990. The 2.1d sketch. In Int. Conf. on Comp. Vis., Osaka, Japan, pp. 138–144.

  • Nordström, K. 1990. Biased anisotropic diffusion: A unified regularization and diffusion approach to edge detection. Image and Vision Computing, 8(4):318–327.

    Google Scholar 

  • Olsen, O. 1996. Multi-scale segmentation of grey-scale images. In Technical Report DIKU Nr. 96/30, ISSN 0107-8283, Department of Computer Science, University of Copenhagen.

  • Osher, S. and Sethian, J. 1988. Fronts propagating with curvature dependent speed: Algorithms based on the hamilton-jacobi formulation. J. Computational Physics, 79:12–49.

    Google Scholar 

  • Paragios, N. and Deriche, R. 2000. Coupled geodesic active regions for image segmentation: A level set approach. In Euro. Conf. on Comp. Vis., Dublin, Ireland.

  • Pavlidis, T. and Liow, Y. 1990. Integrating region growing and edge detection. IEEE Trans. Patt. Anal. and Mach. Int., 12:225–233.

    Google Scholar 

  • Perona, P. and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Patt. Anal. and Mach. Int., 12(7):629–639.

    Google Scholar 

  • Rougon, N. and Preteux, F. 1995. Controlled anisotropic diffusion. In Proc. SPIE Conf. on Nonlinear Image Processing VI, San Jose, CA, vol. 2424, pp. 329–340.

    Google Scholar 

  • Rougon, N. and Preteux, F. 1998. Directional adaptive deformable models for segmentation. J. of Electronic Imaging, 7(1):231–256.

    Google Scholar 

  • Rousseeuw, P. and Leroy, A. 1987. Robust Regression and Outlier Detection. Wiley Series in Probability and Mathematical Statistics, Wiley.

    Google Scholar 

  • Salembier, P. and Serra, J. 1995. Flat zones filtering, connected operators, and filters by reconstruction. IEEE Trans. Image Processing, 4(8):1153–1160.

    Google Scholar 

  • Samson, C., Blanc-Féraud, L., Aubert, G., and Zerubia, J. 1999. A level set model for image classification. In Int. Conf. on Scale-Space Theories Comp. Vis., Kerkyra, Greece, pp. 306–317.

  • Schnörr, C. 1998. A study of a convex variational diffusion approach for image segmentation and feature extraction. J. Math. Imaging and Vision, 3(8):271–292.

    Google Scholar 

  • Sethian, J. 1996. Level Sets Methods: Evolving Interfaces in Geometry, Fluid Mechanics, Computer Vision, and Material Science. Cambridges University Press: Cambridge.

    Google Scholar 

  • Ter Haar Romeny, B. 1994. Geometry-Driven Diffusion in Computer Vision. Kluwer Academic Publishers: Dordrecht, The Netherlands.

    Google Scholar 

  • Vincent, L. and Soille, P. 1991. Watershed in digital spaces: An efficient algorithm based on immersion simulations. IEEE Trans. Patt. Anal. and Mach. Int., 13(6):583–598.

    Google Scholar 

  • Wang, J. 1998. Stochastic relaxation on partitions with connected components and its application to image segmentation. IEEE Trans. Patt. Anal. and Mach. Int., 20(6):619–636.

    Google Scholar 

  • Weickert, J. 1998a. Anisotropic Diffusion in Image Processing. Teubner-Verlag: Stuttgart, Germany.

    Google Scholar 

  • Weickert, J. 1998b. Fast segmentation methods based on partial differential equations and the watershed transformation. In Mustererkennung 1998, P. Levi, R.-J. Ahlers, F. May, and M. Schwanz (Eds.). Springer: Berlin, pp. 93–100.

    Google Scholar 

  • Yezzi, A., Tsai, A., and Willsky, A. 1999. A statistical approach to snakes for bimodal and trimodal imagery. In Int. Conf. on Comp. Vis., Kerkyra, Greece, pp. 898–903.

  • You, Y., Xu, W., Tannenbaum, A., and Kaveh, M. 1996. Behavioral analysis of anisotropic diffusion in image processing. IEEE Trans. Image Processing, 5:1539–1553.

    Google Scholar 

  • Younes, L. 2000. Calibrating parameters of cost functionals. In Euro. Conf. on Comp. Vis., Dublin, Ireland.

  • Zhu, S. and Mumford, D. 1997. Prior learning and gibbs reaction-diffusion. IEEE Trans. Patt. Anal. and Mach. Int., 19(11):1236–1250.

    Google Scholar 

  • Zhu, S. and Yuille, A. 1996. Region competition: Unifying snakes, region growing, and bayes/mdl for multiband image segmentation. IEEE Trans. Patt. Anal. and Mach. Int., 18(9):884–900.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. INRA—Biométrie, Domaine de Vilvert, 78352, Jouy-en-Josas, France

    Charles Kervrann, Mark Hoebeke & Alain Trubuil

Authors
  1. Charles Kervrann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mark Hoebeke
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alain Trubuil
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kervrann, C., Hoebeke, M. & Trubuil, A. Isophotes Selection and Reaction-Diffusion Model for Object Boundaries Estimation. International Journal of Computer Vision 50, 63–94 (2002). https://doi.org/10.1023/A:1020276319925

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1020276319925

Search

Navigation