Skip to main content
Log in

A novel image segmentation model with an edge weighting function

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

A variational model for image segmentation consists of a data term and a regularization term. Usually, the data term is chosen as squared \(\text{ L }_{2}\) norm, and the regularization term is determined by the prior assumption. In this paper, we present a novel model in the framework of MAP (maximum a posteriori). A new iteratively reweighted \(\text{ L }_{2}\) norm is used in the data term, which shares the advantages of \(\text{ L }_{2}\) and mixed \(\text{ L }_{21}\) norm. An edge weighting function is addressed in the regularization term, which enforces the ability to reduce the outlier effects and preserve edges. An improved region-based graph cuts algorithm is proposed to solve this model efficiently. Numerical experiments show our method can get better segmentation results, especially in terms of removing outliers and preserving edges.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://www.biomecardio.com/matlab/medfilt3.html

Abbreviations

\(P\) :

Set of image pixels

\({{\varvec{I}}}(p)\) :

The feature vector of pixel \(p\)

\(I\) :

Feature matrix composed of the feature vectors of all pixels

\(l_p\) :

The label of pixel \(p\)

\(l\) :

Labeling function of the image

\({{\varvec{f}}}(i)\) :

The feature vector of the subregion in which all pixels are labeled with \(i\)

\(F=\{{{\varvec{f}}}(i),\quad i=1,2,\ldots ,n\}\) :

Union of the region features

\(\Pr \) :

Probability

\(\omega _p\) :

The weight of pixel \(p\) in the weighted \(\text{ L }_{2}\) norm used in the date term

\(W_{p,q}\) :

The penalty weight between pixel \(p\) and its neighboring pixel \(q\) in the regularization term

\(E_\mathrm{d}\) :

Energy functional corresponding to the data term and \(E_\mathrm{r}\) is that corresponding to the regularization term

\(\text{ num }_i\) :

Number of pixels within the subregion in which all pixels are labeled with \(i\)

\(I_L (p)\) :

Lightness of pixel \(p\)

\(I^\mathrm{CHF}\) :

Output of the first-order band-pass filter circular harmonic function (CHF) when \(I\) is applied as the input

\(\beta \) :

Threshold to distinguish whether a point is an edge point

\(\alpha \) :

Threshold to distinguish whether the neighborhood of a pixel contains edge points

\(\varphi _{pq}\) :

Direction of clique \(({p,q})\)

\(\arg (I^\mathrm{CHF})\) :

Argument of the complex value \(I^\mathrm{CHF}\)

\(v_m ({m=1,2,\ldots ,L})\) :

Small regions after the initial segmentation to the image, where \(L\) is the total number of the small regions

\(V=\{{v_{m,h} }|m\in \{{1,2,\ldots ,L}\}, h\in \{ {1,2,\ldots ,n-1}\}\}\cup \{ s\}\cup \{ t \}\) :

Set of nodes of the graph

\(n\) :

Number of subregions the image is to be partitioned into

\(s\) :

Source of the graph and \(t\) is the sink

\(\varvec{\varepsilon }\) :

Set of the edges of the graph

\(\varvec{\varepsilon }_D\) :

Set of the edges corresponding to the data term and \(\varvec{\varepsilon }_R \) corresponds to the regularization term

\(({a,b})\) :

Edge between the nodes \(a\) and \(b\)

\(c({a,b})\) :

Weight on the edge \(({a,b})\)

\(\text{ Num }_m\) :

Number of pixels in the small region \(v_m\)

\(M\cdot N\) :

Size of the original image

References

  1. Kass, M., Witkin, A., Tetzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vis. 1(4), 321–331 (1988)

    Article  Google Scholar 

  2. Caselles, V., Kimmel, R., Sapiro, G.: Geodesic active contours. Int. J. Comput. Vis. 22(1), 61–79 (1997)

    Article  MATH  Google Scholar 

  3. Mumford, D., Shah, J.: Optimal approximation by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42(5), 577–685 (1989)

    Article  MATH  MathSciNet  Google Scholar 

  4. Vese, L.A., Chan, T.F.: A multiphase level set framework for image segmentation using the mumford and shah model. Int. J. Comput. Vis. 50(3), 271–293 (2002)

    Article  MATH  Google Scholar 

  5. Chan, T.F., Vese, L.A.: Active contour without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)

    Article  MATH  Google Scholar 

  6. Chan, T.F., Sandberg, B., Vese, L.: Active contours without edges for vector-valued images. J. Vis. Commun. Image Represent. 11(2), 130–141 (2000)

    Article  Google Scholar 

  7. Zhu, S.C., Yuille, A.: Region competition: unifying snakes, region growing, and bayes/mdl for multiband image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 18(9), 884–900 (1996)

    Article  Google Scholar 

  8. Chen, S.F., Cao, L.L., Wang, Y.M., Liu, J.Z., Tang, X.O.: Image segmentation by MAP-ML estimations. IEEE Trans. Image Process. 19(9), 2254–2264 (2010)

    Article  MathSciNet  Google Scholar 

  9. Nikolova, M.: Minimizers of cost-functions involving nonsmooth data-fidelity terms: application to the processing of outliers. SIAM J. Numer. Anal. 40(3), 965–994 (2003)

    Article  MathSciNet  Google Scholar 

  10. Daubechies, I., DeVore, R., Fornasier, M., Güntürk, C.S.: Iteratively re-weighted least squares minimization for sparse recovery. Commun. Pure Appl. Math. 63(1), 1–38 (2010)

    Article  MATH  Google Scholar 

  11. Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)

    Article  Google Scholar 

  12. Tu, Z., Zhu, S.C.: Image segmentation by data-driven Markov chain Monte Carlo. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 657–673 (2002)

    Article  Google Scholar 

  13. Tu, Z.: An integrated framework for image segmentation and perceptual grouping. In: Proceedings of the 10th International Conference on Computer Vision, Beijing, China, Oct. 17–21, pp. 670–677 (2005)

  14. Kolmogorov, V., Zabih, R.: What energy functions can be minimized via graph cuts? IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 147–159 (2004)

    Article  Google Scholar 

  15. Komodakis, N., Tziritas, G., Paragios, N.: Fast, approximately optimal solutions for single and dynamic MRFs. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, June 17–22, pp. 1–8 (2007)

  16. Boykov, Y., Kolmogorov, V.: Computing geodesics and minimal surfaces via graph cuts. In: Proceedings of the 9th IEEE International Conference on Computer Vision, Nice, France, Oct. 13–16, pp. 26–33 (2003)

  17. Boykov, Y., Kolmogorov, V., Cremers, D., Delong, A.: An integral solution to surface evolution PDEs via geo-cuts. In: Proceedings of the 3rd European conference on Computer Vision, vol. 3953, no. 3, pp. 409–422 (2006)

  18. Darbon, J., Sigelle, M.: Image restoration with discrete constrained total variation part I: fast and exact optimization. J. Math. Imaging Vis. 26(3), 261–276 (2006)

    Article  MathSciNet  Google Scholar 

  19. Carson, C., Belongie, S., Greenspan, H., Malik, J.: Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24(8), 1026–1038 (2002)

    Google Scholar 

  20. Förstner, W: A framework for low level feature extraction. In: Proceedings of the 3rd European Conference on Computer Vision, Stockholm, Sweden, May 2–6, Vol. II, pp. 383–394 (1994)

  21. Gårding, J., Lindeberg, T.: Direct computation of shape cues using scale-adapted spatial derivative operators. Int. J. Comput. Vis. 17(2), 163–191 (1996)

    Article  Google Scholar 

  22. Bae, E., Tai, X.C.: Graph cut optimization for the piecewise constant level set method applied to multiphase image segmentation. In: Proceedings of the 2nd International Conference on Scale Space and Variational Methods in Computer Vision, Voss, Norway, Jun. 1–5, pp. 1–13 (2009)

  23. Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)

    Article  Google Scholar 

  24. Unnikrishnan, R., Pantofaru, C., Hebert, M.: Toward objective evaluation of image segmentation algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 929–944 (2007)

    Article  Google Scholar 

Download references

Acknowledgments

This paper is supported by the National Natural Science Foundation of China (61271294), National Natural Science Foundation of China (60872138), National Youth Science Foundation of China (61105011), and National Natural Science Foundation of China (11101292).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wen Juan Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, W.J., Feng, X.C. & Han, Y. A novel image segmentation model with an edge weighting function. SIViP 8, 121–132 (2014). https://doi.org/10.1007/s11760-013-0495-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-013-0495-5

Keywords

Navigation