Abstract
In this paper, we propose a new variational framework to solve the Gaussian mixture model (GMM) based methods for image segmentation by employing the convex relaxation approach. After relaxing the indicator function in GMM, flexible spatial regularization can be adopted and efficient segmentation can be achieved. To demonstrate the superiority of the proposed framework, the global, local intensity information and the spatial smoothness are integrated into a new model, and it can work well on images with inhomogeneous intensity and noise. Compared to classical GMM, numerical experiments have demonstrated that our algorithm can achieve promising segmentation performance for images degraded by intensity inhomogeneity and noise.
Similar content being viewed by others
References
Bishop, C.: Neural Networks for Pattern Recognition. Oxford Univ. Press, London (1995)
McLachlan, G., Peel, D.: Finite Mixture Models. Wiley, New York (2000)
Roberts, S., Husmeier, D., Rezek, I., Penny, W.: Bayesian approaches to Gaussian mixture modeling. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1133–1142 (1998)
Figueiredo, M., Jain, A.: Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 381–396 (2002)
Ashburner, J., Friston, K.: Unified segmentation. NeuroImage 26(3), 839–851 (2005)
McLachlan, G., Krishnan, T.: The EM Algorithm and Extensions. Wiley, New York (2007)
Held, K., Kops, E., Krause, B., Wells, W., Kikinis, R., Muller-Gartner, H.: Markov random field segmentation of brain MR images. IEEE Trans. Med. Imaging 16(6), 878–886 (1997)
Zhang, Y., Brady, M., Smith, S.: Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans. Med. Imaging 20(1), 45–57 (2001)
Dempster, A., Laird, N., Rubin, D.: Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Stat. Soc. B 39, 1–38 (1977)
Bresson, X., Esedoglu, S., Vandergheynst, P., Thiran, J., Osher, S.: Fast global minimization of the active contour/snake model. J. Math. Imaging Vis. 28, 151–167 (2007)
Bae, E., Yuan, J., Tai, X.: Global minimization for continuous multiphase partitioning problems using a dual approach. Int. J. Comput. Vis. 92(1), 112–129 (2010)
Brinkmann, B., Manduca, A., Robb, R.: Optimized homomorphic unsharp masking for MR grayscale inhomogeneity correction. IEEE Trans. Med. Imaging 17, 161–171 (1998)
Wells, W., Grimson, W., Kikinis, R., Jolesz, F.: Adaptive segmentation of MRI data. IEEE Trans. Med. Imaging 15, 429–442 (1996)
Ahmed, M., Yamany, S., Mohamed, N., Farag, A., Moriarty, T.: A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data. IEEE Trans. Med. Imaging 21, 193–198 (2002)
Xiao, G., Brady, M., Noble, J., Zhang, Y.: Segmentation of ultrasound B-mode images with intensity inhomogeneity correction. IEEE Trans. Med. Imaging 21(1), 48–57 (2002)
Mumford, D., Shah, J.: Optimal approximation by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42, 577–685 (1989)
Chan, T., Vese, L.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)
Lie, J., Lysaker, M., Tai, X.: A binary level set model and some applications to Mumford-Shah image segmentation. IEEE Trans. Image Process. 15(5), 1171–1181 (2006)
Joshi, N., Brady, M.: Non-parametric mixture model based evolution of level sets and application to medical images. Int. J. Comput. Vis. 88(1), 52–68 (2010)
Bertelli, L., Chandrasekaran, S., Gibou, F., Manjunath, B.: On the length and area regularization for multiphase level set segmentation. Int. J. Comput. Vis. 90(3), 267–282 (2010)
Goldstein, T., Bresson, X., Osher, S.: Geometric applications of the split Bregman method: segmentation and surface reconstruction. SIAM J. Sci. Comput. 45, 272–293 (2010)
Li, C., Xu, C., Gui, C., Fox, M.: Level set evolution without re-initialization: a new variational formulation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 430–436 (2005)
Estellers, V., Zosso, D., Lai, R., Thiran, J., Osher, S., Bresson, X.: Efficient algorithm for level set method preserving distance function. UCLA CAM Report 11-58 (2011)
Vese, L., Chan, T.: A multiphase level set framework for image segmentation using the Mumford and Shah model. Int. J. Comput. Vis. 50, 271–293 (2002)
Brox, T., Weickert, J.: Level set segmentation with multiple regions. IEEE Trans. Image Process. 15(10), 3213–3218 (2006)
Cremers, D., Pock, T., Kolev, K., Chambolle, A.: Convex relaxation techniques for segmentation, stereo and multiview reconstruction. In: Advances in Markov Random Fields for Vision and Image Processing. MIT Press, Cambridge (2011)
Li, C., Kao, C., Gore, J., Ding, Z.: Minimization of region-scalable fitting energy for image segmentation. IEEE Trans. Image Process. 17(10), 1940–1949 (2008)
Li, C., Gatenby, C., Wang, L., Gore, J.: A robust parametric method for bias field estimation and segmentation of MR images. In: CVPR2009, pp. 218–223 (2009)
Redner, R., Walker, H.: Mixture densities, maximum likelihood and the EM algorithm. SIAM Rev. 26(2), 195–239 (1984)
Rockafellar, R.: Convex Analysis. Princeton University Press, Princeton (1970)
Wang, Y., Yang, J., Yin, W., Zhang, Y.: A new alternating minimization algorithm for total variation image reconstruction. SIAM J. Imaging Sci. 1(3), 248–272 (2008)
Tai, X., Wu, C.: Augmented Lagrangian method, dual methods and split Bregman iteration for ROF model. UCLA CAM Report 09-05 (2009)
Goldstein, T., Osher, S.: The split Bregman method for L1-regularized problems. SIAM J. Imaging Sci. 2, 323–343 (2009)
Setzer, S.: Operator splittings, Bregman methods and frame shrinkage in image processing. Int. J. Comput. Vis. 92, 265–280 (2011)
Chan, T., Golub, G., Mulet, P.: A nonlinear primal-dual method for total variation-based image restoration. SIAM J. Sci. Comput. 20, 1964–1977 (1999)
Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20, 89–97 (2004)
Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40, 120–145 (2011)
Potts, R.: Some generalized order-disorder transformations. Proc. Camb. Philos. Soc. 48, 106–109 (1952)
Pham, D.: Spatial models for fuzzy clustering. Comput. Vis. Image Underst. 84, 285–297 (2001)
Wang, J., Ju, L., Wang, X.: An edge-weighted centroidal Voronoi tessellation model for image segmentation. IEEE Trans. Image Process. 18(8), 1844–1858 (2009)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1–18 (2001)
Chambolle, A.: Total variation minimization and a class of binary MRF models. In: EMMCVPR 2005. LNCS, vol. 3757, pp. 136–152. Springer, Berlin (2005)
Chan, T., Esedoglu, S., Nikolova, M.: Algorithms for finding global minimizers of image segmentation and denoising models. SIAM J. Appl. Math. 66(5), 1632–1648 (2006)
Kolmogorov, V., Zabih, R.: What energy functions can be minimized via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 147–159 (2004)
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China (No. 11071023, No. 11201032).
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix A: Proof of Lemma 1
Let \(\mathcal{E}(\mathbf{u})=\sum_{k=1}^{K}(\mathcal{B}_{k}-\log\mathcal {A}_{k})u_{k}+\sum_{k=1}^{K}u_{k}\log u_{k}\). We use Lagrange multiplier method to calculate the minimal value of \(\mathcal{E}\). Denote Lagrange functional \(L(\mathbf{u})=\mathcal{E}(\mathbf {u})+\lambda(\sum_{k=1}^{K}u_{k}-1)\), then
By setting \(\frac{\delta L}{\delta u_{k}}=0\), and one can get a stationary point u ∗ with component function
Please note u ∗∈Δ, we sum up k from 1 to K in the both sides of (17) and thus we obtain
Equations (17) and (18) produce
It is easy to check that u ∗ is a minimizer of \(\mathcal{E}\). Substituting Eq. (19) into \(\mathcal{E}\) and one can finally get
which completes the proof.
Appendix B: Proof of Proposition 1
According to the first formulation of iteration scheme (4) and Lemma 1, we have
On the other hand, the two equations in (4) can provide
and thus \(-\mathcal{L}(\varTheta^{\nu+1})\leq -\mathcal{L}(\varTheta^{\nu})\).
Appendix C: Proof of Proposition 2
We use distribution function to show this.
Thus \(p_{\mathfrak{Z}}(z)=\sum_{k=1}^{K}\frac{\gamma_{k}}{\sqrt{2\pi}\sigma_{k}\beta(x)}\exp \{-\frac{ [z-c_{k}\beta (x) ]^{2}}{2\sigma_{k}^{2}\beta^{2}(x)} \}\).
Appendix D: Proof of Proposition 3
The proof is motivated by [40]. We first give a schematic diagram in Fig. 9. Sine we suppose ω is relative small and Γ is smooth enough, then we can regard the curve AB as a line segment. As a result, one can get h=ωcosθ,S shadow=θω 2−ω 2sinθcosθ. For a sufficient small ω, the intersections of more that two boundary curves can be ignored compared to the total length of Γ. According to all the suppositions, then we have
Appendix E: The derivation of Eq. (12)
This derivation is very similar to the proof of Lemma 1. The Lagrangian function L for problem (10) is given by
where d is the Lagrangian multiplier. Then
By setting \(\frac{\delta L}{\delta u_{k}}=0\) and with simplification, it becomes
exp{−1−d(x)} in (20) can be obtained by summing up k from 1 to K in the both sides of this equation and using the fact \(\sum_{k=1}^{K}u_{k}(x)=1\). With the notations used in Sect. 3.3, we have
Substituting it back to (20), this immediately leads to the updating Eq. (12).
Appendix F: The derivation of Eq. (13)
We only give the details of calculating the last equation in (13), others can be obtained in the same manner. Since
we get
By setting \(\frac{\delta\mathcal{J}}{\delta\beta}=0\), then it becomes
It is easy to get \(\beta(y)=\frac{-s^{\nu +1}(y)+\sqrt{ [s^{\nu+1}(y) ]^{2}+4t^{\nu+1}(y)}}{2}\) is a positive root since we assume β(y)>0.
Rights and permissions
About this article
Cite this article
Liu, J., Zhang, H. Image Segmentation Using a Local GMM in a Variational Framework. J Math Imaging Vis 46, 161–176 (2013). https://doi.org/10.1007/s10851-012-0376-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-012-0376-5