An adaptive spatial information-theoretic fuzzy clustering algorithm for image segmentation

https://doi.org/10.1016/j.cviu.2013.05.001Get rights and content

Highlights

  • We incorporate the spatial context to the conventional fuzzy c-means (FCM) algorithm for image segmentation.

  • We incorporate the information-theoretic framework into the FCM algorithm to improve its robustness.

  • The new clustering algorithm can effectively improve the image segmentation results and is useful for brain image analysis.

Abstract

This paper presents an adaptive spatial information-theoretic fuzzy clustering algorithm to improve the robustness of the conventional fuzzy c-means (FCM) clustering algorithms for image segmentation. This is achieved through the incorporation of information-theoretic framework into the FCM-type algorithms. By combining these two concepts and modifying the objective function of the FCM algorithm, we are able to solve the problems of sensitivity to noisy data and the lack of spatial information, and improve the image segmentation results. The experimental results have shown that this robust clustering algorithm is useful for MRI brain image segmentation and it yields better segmentation results when compared to the conventional FCM approach.

Introduction

Image segmentation is one of the most important steps in many computer vision applications. The goal of image segmentation is to partition a given image into regions or parts that have a strong correlation with patterns or areas corresponding to objects in the real world. In the last few decades, data clustering techniques had been widely used in image segmentation and had achieved great successes in the areas of medical image analysis [1], [2], face recognition [3], [4], and machine vision [5], [6]. The fuzzy clustering method, especially the fuzzy c-means (FCM) algorithm [7], is one of the most popular data clustering algorithms for image segmentation. It has been shown to be more advantageous than crisp clustering in that the crisp assignment of a data point to cluster center is not reasonable in real applications. Further, when compared to the crisp approaches, the FCM method is more tolerant to variations and noise in the input data [8].

Like many other standard unsupervised clustering methods, the FCM method suffers the lack of spatial information when applying to image segmentation applications. They rely only on the intensity distribution of the pixels, and disregard their geometric information, which make them very sensitive to noise and other artifacts introduced during the imaging process. In order to make the standard FCM algorithm [7] more robust to noise and outliers for image segmentation, many modified fuzzy clustering approaches had been reported in [9], [10], [11], [12], [13], [14], [15]. These methods are better than the conventional fuzzy clustering algorithms because the clustering decision of a single pixel is now reconsidered by the influence from the neighborhood patterns. This improvement tends to smooth out the isolated noise or image artifacts and produces more homogeneous segmentation results.

Most of these improved methods were developed in the last decade. The major contribution to the modifications of the FCM algorithm through the incorporation of the spatial information can be tracked back to 1998. Mohamed et al. [9] used a modified FCM algorithm for medical image segmentation. They introduced the spatial information into the similarity measure. The similarity measure is modified such that the pixel can be dragged closer to the cluster center if it is in homogenous regions. Although there is no more model assumption in the FCM algorithm, the drawbacks of the FCM algorithm [8] are its sensitivity to the non-descriptive initial centers and its massive computational load. Therefore, Ahmed et al. [10] used another similarity measure in a Bias-Corrected FCM (BCFCM) algorithm for bias field estimation and segmentation, which achieved a better performance when an additional term is added to the new objective function. Many researchers subsequently modified the objective functions and developed several robust FCM variants for image segmentation [11], [12], [13], [14], [15]. These algorithms were shown to have better performance than the standard FCM algorithm. However, some of these methods [11], [13], [14] depend on a fixed spatial factor which needs to be adjusted according to the real applications. The shortcoming of using a fixed spatial parameter is evident. It makes the segmentation algorithm less robust to various images and causes the problem of over-smoothed edges. In order to overcome this, clustering algorithms that have an adaptive selection mechanism of the spatial parameters have been proposed recently [16], [15]. The new similarity measure makes use of local and spatial intensity information, and so it performs better and is able to reduce the blurring effect. However, the need for experimentally adjusted parameter and the blurring problems still exist.

In this paper, we propose a new adaptive spatial fuzzy clustering algorithm, called the Adaptive Spatial Information-Theoretic Fuzzy Clustering Algorithm (ASIFC), to address the noise problem and the lack of spatial information for the conventional FCM algorithms with two-level robustness enhancements. We extend the idea in [17] to specifically enhance the robustness of FCM algorithms. The lack of spatial information problem is taken into consideration by using a novel adaptive similarity measure, while the noise and outliers are to be identified through the mutual information (MI) maximization. This new information framework allows us to add robust capability to the basic FCM algorithm while inheriting its advantages such as fast processing time and less sensitive to the density of clusters.

Section snippets

Conventional FCM algorithm

One approach to fuzzy clustering, probably the most commonly used, is the FCM algorithm, which was proposed by Dunn [18] in 1973 and improved by Bezdek [7] in 1981. FCM is formulated as the minimization of the following objective function with respect to the membership functions u and the centers w:Jfcm=i=1Nk=1Kuikqxi-wk2,1q<where q is any real number greater than 1, uik is the degree of fuzzy membership of xi in the kth cluster, and ∥ · ∥ is any norm expressing the similarity measure.

Introducing spatial information – level 1

Besides the lack of spatial information problem, the conventional FCM algorithm also suffers from the lack of robustness against outliers [8].

In order to overcome the outlier problem of FCM algorithm, Krishnapuram et al. [20] proposed the possibilistic clustering algorithm to achieve membership values that are possibilistic. Here, one input data point has little effect on good clusters if its possibility as noise is high, so that the clustering results are less distorted as compared to the FCM

Implementation of ASIFC algorithm

The implementation of the ASIFC algorithm is described below. Suppose that we are given the feature vectors of input image X = {x1,1, x1,2,  , xM,N} with the resolution of L = M × N.

Fuzzy clustering with adaptive spatial weighting factors:

  • (1)

    Set the pre-specified number of clusters K, convergence parameter  = 0.001, fuzzifier q > 0, and the input data distribution ei,j = 1/(M × N) for i = 1–M, j = 1–N.

  • (2)

    Initialization: calculate the weighting function λi,j as discussed in Section 3.1.

  • (3)

    Perform fixed point iteration

Experimental results

In this section, the results of applying ASIFC algorithm to synthetic and real images are presented. In the comparative study, we also included other competing techniques from the literature like bias-corrected fuzzy c-means (BCFCM) [10], enhanced fuzzy c-means (EnFCM) [14], Fast Generalized fuzzy c-means (FGFCM) [15], and our own Adaptive Spatial Information-Theoretic Clustering (ASIC) [19].

In all examples, the cooling factor α = 0.95 was used unless otherwise stated. The default values for

Conclusions

In this paper, we have presented a novel robust information fuzzy clustering method that uses the information-theoretic clustering concept and adaptive spatial weighting factors to improve the image segmentation results. The proposed ASIFC algorithm addresses the two interwined problems, i.e. the identification of noisy data, and the lack of spatial contextual information, in data clustering based image segmentation. The algorithm is fully automated, except for the initialization of fuzzifier,

References (24)

  • X.W. Chen et al.

    Facial expression recognition: a clustering-based approach

    Patt. Recog. Lett.

    (2003)
  • D.L. Pham

    Spatial models for fuzzy clustering

    Comput. Vis. Image Understand.

    (2001)
  • Z.M. Wang et al.

    Adaptive spatial information-theoretic clustering for image segmentation

    Patt. Recogn.

    (2009)
  • M.C. Clark et al.

    MRI segmentation using fuzzy clustering techniques

    IEEE Eng. Med. Biol. Mag.

    (1994)
  • A. Pitiot et al.

    Adaptive elastic segmentation of brain MRI via shape-model-guided evolutionary programming

    IEEE Trans. Med. Imag.

    (2002)
  • N. Davidenko

    Silhouetted face profiles: a new methodology for face perception research

    J. Vis.

    (2007)
  • Y. Tsaig et al.

    Automatic segmentation of moving objects in video sequences: a region labeling approach

    IEEE Trans. Med. Imag.

    (2002)
  • A. Millonig et al.

    Developing landmark-based pedestrian-navigation systems

    IEEE Trans. Intell. Trans. Syst.

    (2007)
  • J.C. Bezdek

    Pattern Recognition with Fuzzy Objective Function Algorithms

    (1981)
  • R.N. Dave et al.

    Robust clustering methods: a unified view

    IEEE Trans. Fuzzy Syst.

    (1997)
  • N.A. Mohamed, M.N. Ahmed, A.A. Farag, Modified fuzzy c-mean in medical image segmentation, in: Proc. of IEEE-EMBS, vol....
  • M.N. Ahmed, S.M. Yamany, A.A. Farag, T. Moriaty, Bias field estimation and adaptive segmentation of MRI data using a...
  • Cited by (0)

    1

    Present address: Maccine Pte. Ltd., 10 Science Park Road, #01-05 The Alpha, Singapore Science Park II, Singapore 117684, Singapore.

    View full text