Dynamically learned PSO based neighborhood influenced fuzzy c-means for pre-treatment and post-treatment organ segmentation from CT images

https://doi.org/10.1016/j.cmpb.2021.105971Get rights and content

Highlights

  • An unsupervised model is designed for segmentation of organ from pre-treatment and posttreatment CT images of same patient.

  • The main objective function is reformulated as a single variable function while taking the advantages of neighborhood influence on image pixels, for the easy integration with an advanced heuristic technique namely Dynamically Learned Particle Swarm Optimization (DLPSO).

  • This model is specially designed for the real medical environment where despite the limited amount of raw data, an overall outstanding performance in terms of accuracy and convergence can be ensured.

Abstract

Background and Objective

The accurate segmentation of pre-treatment and post-treatment organs is always perceived as a challenging task in medical image analysis field. Especially, in those situations where the amount of data set is limited, the researchers are compelled to design unsupervised model for segmentation. In this paper, we propose a novel dynamically learned particle swarm optimization based neighborhood influenced fuzzy c-means (DLPSO-NIFCM) clustering (unsupervised learning model) for solving pre-treatment and post-treatment organs segmentation problems. The proposed segmentation technique has been successfully applied to segment the liver parts from the Computed Tomography (CT) images of abdomen and also the lung parenchyma from the lungs CT images.

Methodology

In the proposed method, we formulate a primary convex objective function by considering the membership value of a pixel as well as the membership of its other neighboring pixels. Then we apply a new algebraic transformation on the primary objective function to design a new and more suitable objective function without losing convexity of the primary objective function. This new objective function is compatible for hybridization with any heuristic search technique in true sense. In this work, we propose a dynamically learned PSO to obtain the initial cluster centroids from the final objective function. Finally, we use a graph-based isolation mechanism for refining the segmentation results.

Results and Conclusion

This hybrid method, along with the restructured single variable objective function of the distance, leads to accurate clustering results with relatively lesser converging time as compared to the state-of-the-art methods. The segmentation results, obtained through several experiments with real CT images, are encouraging. The numerical values of different performance metrics obtained over the same data set confirm that the proposed algorithm performs better with respect to the state-of-the-art methods. Hence, we may consider the proposed method as a promising tool for clustering and CT image segmentation in a Computer Aided Diagnostic (CAD) system.

Introduction

In the domain of medical image analysis, the rapid development of medical data acquisition devices has made the disease detection more accurate and faster, in an invasive way. However, the analysis of medical images becomes cumbersome and tedious due to the complex structures and the burden of the huge image data obtained from the acquisition system [1], [2]. Since medical images inherently contain complex overlapping physiological tissues and noise, the study of medical image analysis has become a challenging task compared to conventional image analysis [3], and sometimes the traditional manual data analysis becomes inefficient as it provides serious decision errors. Moreover, the visual inspection by human beings often creates an interpersonal variation of opinions based on the qualitative analyzing approach [4]. Hence, computer-based image analysis and diagnostic systems have become indispensable, nowadays. A lot of computer-based image analysis algorithms have been developed and used for the diagnosis of different kinds of diseases to provide a decision support system to the medical experts. These techniques encompass statistical methods, soft computing based methods, heuristic and meta-heuristic methods, machine learning algorithms, etc [5], [6], [7]. Most recently deep learning based algorithms have got tremendous importance in designing computer-aided medical diagnostic systems to assist the physicians [8].

A major part of medical image analysis is the segmentation of the region of interest (ROI) of the diseased or suspicious organ or tissue. Image segmentation is a procedure of partitioning an image into a set of non-overlapping zones depending upon some similarity criterion. The resultant segmented image contains different parts of interest which are more prominent in some sense compared to the other [9]. Statistical models are mostly used to realize the insights for a certain set of data. The solution is achieved through the inferences made by analyzing the underlying nature of data [10]. Inherently, statistical models employ an approximation over reality, so not always suitable in solving the delicate problem such as segmentation of organs from medical images. In machine learning models, data must be organized in such a way that the machine can decipher the information distinctly. But, in the supervised approach of machine learning technique, the apprehension of data over-fit (when there is an excessive load of data) or under-fit (when there is not enough data for a clear understanding) remains throughout [11]. That is why this particular method might not seem convenient in medical imaging research all the time, as the amount of data is exclusively dependent on the specific problem. Due to the accurate prediction with lesser training overload, soft computing models, as well as heuristic models, are more preferred in medical imaging applications[7]. Data clustering is an unsupervised machine learning approach that assigns n data points into m (m2, m<n) number of clusters (data points are the real number in d dimensional space xiRd), where more similar data should be the member of the same cluster and dissimilar data in different clusters, so that inter-cluster variance should be minimum and intra-cluster variance is large [12], [13]. A common feature between image segmentation and data clustering algorithms is that both are the process of assigning objects or data points (pixels, in case of images) into similar sets or groups. Hard K-means algorithm is based on the classical set-theoretic approach and implements a rigid and sharp classification, in which each data point is either assigned to a class or not [14], [15]. This process works fast and the corresponding implementation mechanism is easy. But, in many cases, it is burdensome to find proper clusters when the distribution structure is complicated. On the other hand, the fuzzy set-theoretic approach produces soft cluster results. Ruspini [16], [17] coined the root concept of fuzzy partition which forms the base of the fuzzy c-means clustering algorithm by using core concepts of fuzzy set theory of Zadeh [18]. In the year 1981, this fuzzy factor was incorporated by Bezdek and he proposed FCM [19]. The utilization of fuzzy concept in a clustering method makes the class membership become a relative one, and a data point can be affiliated to multiple classes simultaneously with different membership values. This feature of fuzzy c-means clustering handles overlapping data compared to hard clustering techniques. Also, it yields an important feature for medical diagnostic systems to increase sensitivity. The main advantage of FCM is that it is more capable of handling the overlapping clustering problem compared to K-means clustering [20], [21]. However, FCM has some limitations too. In most of the cases, it is perplexing to determine the total number of clusters and the initial centroids. Henceforth, the convergence process is very prolonged when the data set is significantly large. Due to its dependency on the random selection of initial cluster prototypes, it easily falls into local optima [22]. These loopholes of FCM inspired many researchers to amalgamate FCM with evolutionary mechanisms, that can improve clustering speed and accuracy [23], [24]. The key idea behind combining FCM with various evolutionary algorithms is that, instead of random guessing of the initial cluster centroids, firstly an evolutionary algorithm determines the cluster centers irrespective of the data distribution. After that, FCM algorithm will compute the partition matrix for the clustering result using those centroids. In this regard, a lot of attention was achieved by Particle Swarm Optimization (PSO), which is an informed searching algorithm based on population statistics, initially proposed by Kennedy et al. [25]. Some researchers successfully hybridized FCM and PSO and applied them in different fields [26], [27]. PSO usually tries to mimic the collective behavior of various social entities, for instance, bees, fishes, insects, etc. Alike the genetic algorithm, in PSO, multiple agents usually explore and exploit search space along with information passing in a mesh-like manner that improves collective behavior of searching technique [28]. PSO can be implemented easily and computationally inexpensive. Another advantage is that it has only a few parameters to adjust. Thus, many enhanced versions of PSO have been proposed in recent years [29], [30].

An alternative form of FCM applied in the image segmentation problem, is the incorporation of the influence spatial information within the clusters. Since pixels in an image are correlated with their neighborhood and constitute homogeneous regions, the membership value is also influenced by neighborhood pixels. In this regard, some researchers developed new variants of FCM for image segmentation, such as spatial information based image segmentation techniques [31], [32]. This makes the clustering noise-robust since the impact of spatial information is considered for determining membership and centroid values as well as the objective function [33]. Perpetual strength of FCM is maintained in these variants of FCM. But, hybridizing an evolutionary algorithm with this version of FCM for iterative searching of the initial cluster prototype becomes computationally intensive due to the complex structure of the corresponding objective function. Hence, using that variant of the objective function without any change is not so beneficial to compute initial cluster prototype concerning convergence and accuracy.

In our study, we are mainly interested to segregate the organ, before and after the treatment accordingly, from the CT images of patients. The automated pre-treatment and post-treatment segmentation of organs can help the physicians in treatment evaluation with more accuracy and, consequently, improve the quality of treatment. For example, the accurate segmentation of pre-treatment and post-treatment organs helps the physicians knowing the degree of the patient’s disease after the treatment. Based on that, a physician may decide on further treatment of the patient. Coming to such a specific issue, such as dealing with the pre-treatment and post-treatment CT images of the same patient, we have observed that, due to limited numbers of collected pre-treatment and post-treatment raw data, an unsupervised model is preferred here. To implement our proposed method, initially, we convert neighborhood influenced fuzzy objective function, containing both the membership and centroid, into a single variable function of distance or centroid. The reformulation of the objective function does not change its nature and characteristics but makes it compatible to be amalgamated with other optimization algorithms to search the initial cluster prototypes easily. In this study, we have suggested a new neighborhood-influenced FCM based on dynamically-learned particle swarm optimization (DLPSO), where the dynamic adaptation makes the convergence faster, and at the same time, it omits the possibility of being trapped in local optima. Along with that, due to its unsupervised nature, this technique can perform well enough irrespective of the large data size.

Section snippets

Related literature

We will quickly review the literature related to evolving fuzzy c-means clustering and its application in image segmentation.

In the available literature, a large number of segmentation methods are mentioned and applied in different fields of image processing and image analysis. These methods are primarily based on edge detection [34], thresholding [35], region growing (RG) [36], watershed [37], normalized graph cuts [38], genetic algorithm [15], neural networks [11], and a variety of clustering

Proposed DLPSO-NIFCM approach for medical image segmentation:

In image analysis application, fuzzy c-means is used as a very popular method where pixel values are considered as feature points to be partitioned. In conventional FCM, a set of pixel values { X=x1, x2,... ..., xn} are clustered by computing the centers of clusters (vi) and the membership matrix (μik) with the minimization of an well-chosen objective function. But in this case the respective positions of the pixel values are not considered, even though they have a great influence on

Description of image dataset:

Different types of images are selected for the primary testing purpose of the algorithms. Among those test images, aeroplane and wolf images are taken from Berkeley image segmentation data set which is a standard segmentation data set [60]1. Lung and abdominal CT images are raw DICOM images collected from Medical

Conclusion:

Fuzzy c-means clustering is one of the most popular methods for cluster analysis that has been used in a wide array of medical imaging applications. Since traditional fuzzy c-means algorithm is constructed based on decreasing gradient optimization method, it is very sensitive to initial cluster prototype selection, and thus, it can easily fall into local optima. In this study, our proposed method entitled as ”Dynamically Learned PSO Based Neighborhood Influenced Fuzzy C-means(DLPSO-NIFCM)”, is

Declaration of Competing Interest

The authors hereby state that they have no known conflicting or competing financial engagements, or any personal obligation that might have been any matter of influence on this research work. No conflict of interest exists in the submission of this manuscript, and the work is approved by all authors.

Acknowledgement

The authors are grateful to Medical College and Hospital Kolkata for providing the major dataset along with some valuable feedback. This study is supported by Ministry of Electronics and Information Technology, Government of India.

References (61)

  • M.S. Choudhry et al.

    Performance analysis of fuzzy c-means clustering methods for MRI image segmentation

    Procedia Comput. Sci.

    (2016)
  • G.I. Sayed et al.

    An automated computer-aided diagnosis system for abdominal CT liver images.

    MIUA

    (2016)
  • M. Xia et al.

    Ivus images segmentation using spatial fuzzy clustering and hierarchical level set evolution

    Comput. Biol. Med.

    (2019)
  • B.N. Li et al.

    Integrating spatial fuzzy clustering with level set methods for automated medical image segmentation

    Comput. Biol. Med.

    (2011)
  • M. Kang et al.

    Fuzzy c-means clustering with spatially weighted information for medical image segmentation

    2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP)

    (2014)
  • S. Alam et al.

    Research on particle swarm optimization based clustering: a systematic review of literature and techniques

    Swarm Evol. Comput.

    (2014)
  • H.S. Urade et al.

    Dynamic particle swarm optimization to solve multi-objective optimization problem

    Procedia Technol.

    (2012)
  • H. Costin

    Recent trends in medical image processing

    Computer Science

    (2014)
  • R. Bellazzi

    Big data and biomedical informatics: a challenging opportunity

    Yearb. Med. Inform.

    (2014)
  • I. Scholl et al.

    Challenges of medical image processing

    Computer Science - Research and Development

    (2011)
  • A. Sims et al.

    Comparison of semi-automated image analysis and manual methods for tissue quantification in pancreatic carcinoma

    Physics in Medicine & Biology

    (2002)
  • M.N. Wernick et al.

    Machine learning in medical imaging

    IEEE Signal Process. Mag.

    (2010)
  • R. Tadeusiewicz

    Modern computational intelligence methods for the interpretation of medical images

    (2008)
  • N. Senthilkumaran et al.

    Image segmentation-a survey of soft computing approaches

    2009 International Conference on Advances in Recent Technologies in Communication and Computing

    (2009)
  • M.H. Hesamian et al.

    Deep learning techniques for medical image segmentation: achievements and challenges

    J. Digit. Imaging

    (2019)
  • D.L. Pham et al.

    Current methods in medical image segmentation

    Annu. Rev. Biomed. Eng.

    (2000)
  • H. Choi et al.

    Multiscale image segmentation using wavelet-domain hidden markov models

    IEEE Trans. Image Process.

    (2001)
  • G. Kuntimad et al.

    Perfect image segmentation using pulse coupled neural networks

    IEEE Trans. Neural Networks

    (1999)
  • A.K. Jain et al.

    Data clustering: a review

    ACM computing surveys (CSUR)

    (1999)
  • G. Gan et al.

    Data clustering: theory, algorithms, and applications

    (2007)
  • Cited by (7)

    • Fuzzy clustering of Acute Lymphoblastic Leukemia images assisted by Eagle strategy and morphological reconstruction

      2022, Knowledge-Based Systems
      Citation Excerpt :

      Multi-level thresholding and clustering-based segmentation fields are two major image segmentation techniques where NIOAs have demonstrated their effectiveness. In 2021, Chakraborty et al. [26] proposed a novel dynamically learned Particle Swarm Optimizer(PSO) based Neighborhood Influenced Fuzzy C-Means (DLPSO-NIFCM) clustering algorithm to segment the Computer Tomography (CT) images of liver parts and lungs. Tongbram et al. [27] proposed a novel image segmentation approach using Fuzzy C-Means(FCM) and Whale Optimization Algorithm (WOA) along with noise detection and reduction mechanism to segment Brain MR images.

    • LM-DNN: pre-trained DNN with LSTM and cross Fold validation for detecting viral pneumonia from chest CT

      2024, Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization
    • Improved algorithm of UAV search based on electric field model and simulation analysis

      2022, Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition)
    View all citing articles on Scopus
    View full text