A new active contour model driven by pre-fitting bias field estimation and clustering technique for image segmentation

https://doi.org/10.1016/j.engappai.2021.104299Get rights and content

Highlights

  • A new function for computing bias field is proposed.

  • The computation of the bias field is completed before the iteration and there is no more time-consuming convolutions in iterations.

  • The computing of clustering center points takes into account the average value of the grayscale within and without the contour of the bias field.

  • The variational level set function is optimized with an adaptive function to limit the magnitude of the data driven term.

  • The proposed model shows better segmentation accuracy and robustness.

Abstract

Due to uneven illumination or limitations of imaging devices, intensity inhomogeneities are more or less present in images obtained by different imaging modes. This ubiquitous intensity inhomogeneity makes image segmentation more difficult. This paper proposes a new bias field model (KPBFE) based on pre-fitting bias field estimation to deal with intensity inhomogeneity in the image segmentation. A new function for computing bias field b is proposed with K-means++ clustering algorithm. The computation method of clustering center points takes into account the average value of the grayscale within the contour of the bias field estimation and outside the contour. Meanwhile, we use a variational level set function with arctan function and a new adaptive function τ to limit the magnitude of the data driver term. Since the computation of bias field estimation is completed before the iteration and there is no convolution operation in the process, the computing speed of the proposed model is greatly increased. Experiments results show that our model can effectively segment the images with intensity inhomogeneity. Compared with some classical models, our method also has faster computation speed, higher segmentation accuracy and better initial robustness.

Introduction

Image segmentation is an important part in the field of image processing and computer vision. It is widely used in many fields, including industrial automation production, medical image analysis, intelligent monitoring and traffic management. In the past decades, various image segmentation methods were proposed (Wu and Kang, 2021, Mousavirad et al., 2020, Sarkar et al., 2016, Çataloluk and Çelebi, 2018, Li et al., 2006, Gamino-Sánchez et al., 2018, Demirhan and Güler, 2011, Jin and Weng, 2019, Cai et al., 2018, Chan et al., 2018, Banerjee and Maji, 2019). Active contour model (ACM) is one of the most representative image segmentation methods since Kass et al. (2011) proposed. Active contour model can obtain subpixel level accuracy of the target boundary and provide a smooth closed contour as the segmentation result (Miao et al., 2018). Therefore, it is suitable for scenes requiring high segmentation accuracy, such as detecting the shape and size of lesions, locating damaged areas of industrial machines, automatic segmentation and identification of vehicle license plates, etc (Pham et al., 2016, Comelli et al., 2019). In addition, the introduction of level set method (Li et al., 2010) promotes the development of active contour model. Nowadays it is also a research hotspot in image segmentation. Traditional active contour models can be classified as: edge-based models (Li et al., 2010, Li et al., 2016, Liu et al., 2017, Zhou et al., 2015) and region-based models (Wang et al., 2009, Zhang et al., 2010, Chan and Vese, 1977, Li et al., 2008).

The most widely used active contour model is region-based models. There are usually some interferences in image segmentation, such as uneven illumination, noise, shadow and intensity inhomogeneity. These disturbances bring great difficulties to image segmentation. Traditional region-based models are not ideal enough to guarantee segmentation accuracy and speed simultaneously for intensity inhomogeneity image. Another kind of region-based segmentation method is called bias field model. The bias correction (BC) model (Li et al., 2011) and the LSACM model (Zhang et al., 2016) are two classical bias field models. The BC model has strong robustness to the initial contour. Nevertheless, too much convolution computation in iteration results in slow segmentation speed. The LSACM model has a good segmentation effect for images with intensity inhomogeneity. However, it still fails to solve the problems of initial contour sensitivity and slow segmentation speed. The CLSM model proposed by Zhou et al. (Zhou et al., 2017) in 2017 allows flexible initializations and can segment images effectively with both noise and intensity inhomogeneity. Its defect is a kernel function leads to long segmentation time. Wang et al. proposed the EFI model (Wang et al., 2018) to deal with images with intensities inhomogeneous and estimate their bias fields with a high performance. However, the convolution computation in this model still increases the iteration time. Table 1 briefly summarizes the characteristics of the above four bias field models.

In this paper, we propose a new active contour model (KPBFE) to compute the estimation of bias field and overcome the shortcomings of the BC model and the LSACM model. Firstly, we use K-means++ clustering algorithm to cluster multivariable data and take the clustering center point as bias field b. The computation method of clustering center points takes the average value of the grayscale within and outside the contour into account. The function of clustering center can be regarded as a special case of the CV model. Then we minimize the energy function. We optimize a variational level set function with different data driven term. A new adaptive function τ is used to limit the magnitude of the data driver term. Finally, we compute gradient flow function and complete the computation. The computation of bias field value b is completed before the iteration. There is no convolution operation in the computing process, so the computation speed is greatly increased. Experiments results show that our model has faster segmentation speed and better robustness on the images with intensity inhomogeneity.

The rest of this paper is organized as follows. We introduce the research background in Section 2. The proposed model is shown in Section 3. Section 4 is experiments. Section 5 includes several discussions. The conclusion is in Section 6.

Section snippets

Background

Taking the intensity inhomogeneity in image segmentation into consideration, the real image can be built into a composite image model (Wells et al., 1995, Li et al., 2014), which is given as follows: I(x)=b(x)J(x)+n(x)

This model decomposes grayscale inhomogeneity into a component of the image. Where b(x) is the component of intensity inhomogeneity, which is called the bias field, J(x) is the real image, and n(x) is the additional noise. Fig. 1 is a schematic diagram of this image model. The

Pre-fitting bias field estimation function with K-means++ clustering algorithm

In this paper we propose an active contour model based on K-means++ clustering algorithm (KPBFE). The basic principle of K-means++ clustering algorithm is the initial cluster centers should be as far as possible. The specific steps are as follows:

1. Choose a point x as the first center point c1 randomly from all input dataset X. Calculate the Euclidean distance Di(x) between each sample x and the current existing clustering center.

2. Arrange the Euclidean distances of each point randomly and

Implementation

In this section, we will segment several groups of images with the proposed KPBFE model to test its effect. We also compare our model with some classic models to show advantages. The proposed model will be experimented in MATLAB R2015b on a 2.6-GHz Inter Core i5 personal computer. Unless otherwise specified, the parameters are fixed as w=11, k=7, α=1, η=10, ɛ=1, Δt=1 and c0=1. N means the iterations number. The complete algorithm steps is:

Step1. Initial the level set function ϕ0 as: ϕ0=c0,xΩ0

About robustness to initialization and noise

We choose two groups of images and set three different initial contours to discuss the robustness of the proposed model to initialization and noise. Meanwhile, Gaussian noise, Salt and pepper noise, Poisson noise and Speckle noise are added to estimate the robustness of our model. Results in Fig. 7 attest that the position of the initial contour has little influence on the segmentation results. That is to say, the proposed model has strong robustness to initialization. At the same time, each

Conclusions

In this paper, we propose a new active contour model (KPBFE) to overcome the shortcomings of classical bias field estimation model. We cluster multivariable data and take the clustering center point as bias field b with our optimized K-means++ clustering algorithm. The computation method of clustering center points takes the average value of the grayscale inside and outside the contour of the bias field estimation into account. Due to an adaptive function τ, we optimize the variational level

CRediT authorship contribution statement

Guirong Weng: Conceptualization, Methodology, Software, Resources, Writing - review & editing, Supervision, Project administration, Funding acquisition. Bin Dong: Validation, Formal analysis, Investigation, Data curation, Writing - original draft, Visualization.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgments

This work is supported by the National Nature Science Foundation of China [grant No. 61873176, No. 61473201] and Postgraduate Research & Practice Innovation Program of Jiangsu Province, China [grant No. KYCX19_1928].

References (39)

Cited by (12)

  • Fuzzy subspace clustering noisy image segmentation algorithm with adaptive local variance & non-local information and mean membership linking

    2022, Engineering Applications of Artificial Intelligence
    Citation Excerpt :

    Image segmentation is one of the most important research topics in computer vision and image understanding. In the past decades, many image segmentation algorithms have been developed (Wei et al., 2021; Weng and Dong, 2021; Wang and Tu, 2012; Pont-Tuset et al., 2016; Li et al., 2006) and applied to resource surveying (Lin et al., 2021), artificial intelligence (Sodjinou et al., 2021), remote sensing data analysis (He et al., 2021), disease diagnosis (Feng et al., 2020), and other fields (Jiang et al., 2021). There are two roughly defined categories of image segmentation: supervised and unsupervised image segmentation.

  • Image segmentation using a novel dual active contour model

    2024, Multimedia Tools and Applications
View all citing articles on Scopus
View full text