Abstract
Image segmentation is an essential step in image processing and computer vision with many image segmentation algorithms having been proposed in the literature. Among these, clustering is one of the prominent approaches to achieve segmentation. Traditional clustering algorithms have been used extensively for this purpose, although they have disadvantages such as dependence on initialisation conditions and a tendency to find only local optima. To overcome these disadvantages, population-based metaheuristic algorithms can be applied.
In this paper, we propose a novel clustering algorithm based on human mental search (HMS) for image segmentation. HMS is a relatively new population-based metaheuristic inspired from the manner of searching in online auctions. HMS comprises three operators: mental search, which explores the neighbourhood of candidate solutions using Levy flight; grouping, which clusters candidate solutions; and moving candidate solutions towards a promising area. To verify the efficacy of the proposed algorithm, we conduct several experiments based on different criteria including mean cost function value, statistical analysis and image segmentation criteria. The obtained results confirm superior performance of our proposed algorithm compared to competitors.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Image segmentation is a critical task in computer vision. It partitions an image in terms of pixel-based features into several homogeneous and disjoint regions so that the members within the same region share the same characteristics. Image segmentation is employed as a pre-processing step in many applications such as medical image processing [4, 15] or modelling of microstructures [16].
Clustering is one of the most commonly employed approaches for image segmentation. It divides an image into clusters (groups) so that the members located in the same cluster have more resemblance to each other than to those in others clusters. The k-means algorithm is the most popular clustering algorithm. It initialises k cluster centres randomly and each pattern is then assigned to the closest cluster centre. In the next step, the location of each cluster centre is recomputed and the process continues until a stopping criterion is met. However, k-means suffers from some drawbacks such as dependence on initialisation and getting stuck in local optima.
Population-based metaheuristics are problem-independent optimisation algorithms with stochastic characteristics and can be used to overcome these drawbacks. They typically create a random population of candidate solutions which are then iteratively updated based on operations that are stochastic and share information within the population.
Popular population-based metaheuristics that have been used for clustering-based image segmentation include particle swarm optimisation (PSO) [12, 17], differential evolution (DE) [2, 7], artificial bee colony (ABC) [13] and harmony search (HS) [20] among others.
Human mental search (HMS) [11] is a relatively new population-based metaheuristic that has shown competitive performance in solving optimisation problems [11]. HMS has three main operators: mental search, grouping, and movement. Mental search seeks around a candidate solution based on Levy flight, grouping clusters the population to find a promising region, and movement steers candidate solutions towards the promising area.
In this paper, we propose a novel image segmentation based on clustering and HMS. To this end, our encoding strategy is an array to define the cluster centres and we employ an objective function based on the mean squared error. An extensive set of experiments demonstrates very good segmentation performance and superiority over other methods.
The remainder of the paper is organised as follows. Section 2 summarises the human mental search algorithm, while Sect. 3 details our proposed image segmentation algorithm. Section 4 presents experimental results, and Sect. 5 concludes the paper.
2 Human Mental Search
Human mental search (HMS) [11] is a recent population-based metaheuristic algorithm where candidate solutions are bids in the space of online auctions.
The workings of HMS are detailed in Algorithm 1 in terms of pseudo-code. Like other population-based algorithms, HMS starts with a set of random candidate solutions. Candidate solutions try to move towards the optimum using mental search (to explore the vicinity of bids), grouping (to find the promising area), and movement (to steer bids toward the promising area) operators. In the following, we briefly explain these three operators.

2.1 Mental Search
Here, each bid explores its vicinity based on a Levy flight distribution, resulting in both small and long jumps to enhance both exploration and exploitation ability of the algorithm simultaneously.
A bid \(x^i\) is updated as
with S calculated as
where NFE is the number of objective function evaluations so far, \(NFE_{\max }\) is the maximum number of function evaluations, \(x^{*}\) is the best bid found so far, and u and v are two random numbers calculated as
with
where \(\varGamma \) is a standard gamma function.
2.2 Grouping
A clustering approach is used to group the current population of bids. After clustering, which is performed using the k-means algorithm, similar bids are located in the same group. Then, the mean objective function value is calculated for each group, and the group with the lowest value selected as the winner group.
2.3 Movement
Here, bids move towards the best bid in the winner cluster as
where \(x_{n}^{t+1}\) is the n-th bid element at iteration \(t+1\), \(winner_{n}^{t}\) is the n-th element of the best bid in the winner group, t is the current iteration, C is a constant, and r is a number in [0; 1] taken from a normal distribution.
3 Proposed Segmentation Algorithm
This paper introduces a novel clustering-based image segmentation algorithm based on clustering and HMS.
Assume that a dataset has N objects, \(O_{1}, O_{2},..., O_{N}\). A clustering algorithm tries to find K cluster centres, \(C_{1},C_{2},...,C_{K}\) with the following conditions:
-
1.
Each cluster contains at least one object.
-
2.
Distinct clusters have no objects in common.
-
3.
The total number of cluster members is equal to the total number of objects in the dataset.
For our application of HMS, two issues need to be taken into account: encoding strategy and objective function. The encoding strategy determines the structure of each bid in HMS. We use an array to encode the cluster centres, and the length of the array is thus the number of cluster centres. Also, the upper and lower bound of the array is set to the maximum and minimum of pixel values in the image. As objective function, we use the mean squared error (MSE) defined as
where \(d(P_{i} ,c_{j} )\) is the Euclidean distance between pixel \(P_{i}\) and its cluster centre \(C_{j}\), and n is the total number of pixels in the image.
Our image segmentation algorithm proceeds in the following steps:
-
Step 1: Parameter initialisation: population size \(N_{pop}\), minimum \(M_{l}\) and maximum \(M_{h}\) number of mental searches, number of clusters for bid grouping N, number of objective function evaluations NFE, and number of clusters for image segmentation K.
-
Step 2: Generate an initial random set of bids.
-
Step 3: Calculate the objective function value for each bid using Eq. (6).
-
Step 4: Create a random integer number for each bid in \([M_{l};M_{h}]\) indicating the number of mental searches for the bid.
-
Step 5: Mental search: generate new bids based on Levy flight distribution in the vicinity of each bid.
-
Step 6: Replacement: in case a newly produced bid is better than the old one, it will replace the latter.
-
Step 7: Bid grouping: all bids in the search space are clustered using the k-means algorithm.
-
Step 8: Calculate the mean objective function value for each cluster.
-
Step 9: The cluster with the minimum mean objective function value is selected as the winner cluster.
-
Step 10: Other bids move towards the best bid in the winner cluster based on Eq. (5).
-
Step 11: Find the best bid in the current population and if it is better than the previous best bid, substitute the latter with it.
-
Step 12: If the stopping condition is not met, go back to Step 3.
4 Experimental Results
In our experiments, we select 10 images, shown in Fig. 1, which are commonly used in the literature: Lenna, House, Airplane, Peppers, and MRI, and five images from Berkeley image segmentation dataset [9], namely 12003, 42049, 181079, 198054, and 385028. We compare our algorithm with other population-based algorithms that have been previously used for image segmentation.
The population size and the number of objective function evaluations for all algorithms are set to 50 and 6000, respectively, and all results are run for \(K=5\). For HMS, we set the number of clusters used during grouping to 5 and C to 2, while \(M_l=2\), \(M_h=10\), \(L=0.3\), and \(U=1.99\). For the other algorithms, we adapt default values previously employed in this context, listed in Table 1. Since the algorithms are stochastic, we run each algorithm 25 times on each image, and report the average over these runs. We also rank the algorithms for each image and calculate Friedmann ranks which are obtained by averaging the ranks over the image set.
Table 2 compares the results in terms of objective function values. As we can see, HMS is ranked first for 5 of the 10 images, and second for the other ones, leading to a clear best overall rank, followed by DE and PSO.
We also perform a statistical analysis, using the Wilcoxon signed rank test to compare our HMS-based algorithm with the other techniques. The null hypothesis \(H_{0}\) here indicates no statistical difference between two algorithms, while the alternative hypothesis \(H_{1}\) points to a statistically significant difference. The obtained p-values are 0.0020 for ABC, 0.0039 for HS, 0.0273 for PSO, 0.0488 for DE, and 0.0020 for GA and are thus all below 0.05 demonstrating statistical superiority of HMS.
We further assess our proposed algorithm using several image segmentation criteria, in particular:
-
Borsotti criterion (BOR) [1]: an unsupervised criterion based on the number, the variance, and the area of segmented image regions. A lower BOR indicates a better segmentation performance.
-
Levine and Nazif interclass contrast (LNIC) [8]: an unsupervised criterion based on the sum of region contrasts weighted by their areas. A higher LNIC indicates a better segmentation performance.
-
Levine and Nazif intra-class uniformity (LNIU) [8]: an unsupervised criterion based on the sum of normalised standard deviations of image areas. A higher LNIU indicates a better segmentation performance.
-
Variation of information (VoI) [10]: a supervised criterion that calculates the information shared between a ground truth and a segmented image. A lower VoI indicates better segmentation performance.
-
Probabilistic Rand index (PRI) [14]: a supervised criterion that computes the fraction of pairs of pixels whose labels are consistent between computed and ground truth segmentations. A higher PRI indicates better segmentation performance.
Since the latter two require a ground truth, we can only evaluate these measures on the images of the Berkeley dataset.
The BOR results in Table 3 show that HMS performs best for all but one image and is thus clearly ranked first overall with PSO coming second.
For LNIC, reported in Table 4, HMS yields the first rank for 5 images and second for a further 4, while similar results can be seen for LNIU in Table 5. For both criteria, our approach is the overall top-ranked algorithm.
Table 6 indicates the VoI results. Here, HMS obtained the first rank for 2 and second rank for the remaining 3 images, while GA, HS, and PSO rank first each for one image. Overall, HMS ranks first, followed by PSO and DE.
Table 7 lists the PRI results. For all images, HMS ranks first or second, resulting in an overall first rank.
Last not least, we show an example of the obtained results in Fig. 2 which also demonstrates the superiority of HMS.
Overall, it is clear that our proposed HMS approach outperforms all other algorithms based on all employed measures.
5 Conclusions
This paper proposes a novel clustering-based image segmentation based on human mental search (HMS). Our proposed algorithm encodes cluster centres as the candidate solutions, uses the mean squared error as objective function and employs HMS for optimisation of the latter. The proposed algorithm is compared with five other metaheuristic algorithms and the obtained experimental results verify the efficacy of the proposed algorithm for image segmentation and show it to outperform the other approaches. In future, we plan to extend our approach to find the number of optimal clusters automatically, while integrating a local search mechanism is also being investigated. We also currently explore our algorithm in the context of video analysis [6].
References
Borsotti, M., Campadelli, P., Schettini, R.: Quantitative evaluation of color image segmentation results. Pattern Recogn. Lett. 19(8), 741–747 (1998)
Das, S., Konar, A.: Automatic image pixel clustering with an improved differential evolution. Appl. Soft Comput. 9(1), 226–236 (2009)
Geem, Z.W., Kim, J.H., Loganathan, G.V.: A new heuristic optimization algorithm: harmony search. Simulation 76(2), 60–68 (2001)
Jamil, U., Sajid, A., Hussain, M., Aldabbas, O., Alam, A., Shafiq, M.U.: Melanoma segmentation using bio-medical image analysis for smarter mobile healthcare. J. Ambient Intell. Hum. Comput. 10, 1–22 (2019)
Karaboga, D., Akay, B.: A comparative study of artificial bee colony algorithm. Appl. Math. Comput. 214(1), 108–132 (2009)
Korovin, I.S., Khisamutdinov, M.V.: Obtaining a noise-free image based on an analysis of an unstabilized video sequence under conditions of a probable optical flow failure. In: 12th International Conference on Machine Vision (2019)
Kwedlo, W.: A clustering method combining differential evolution with the \(k\)-means algorithm. Pattern Recogn. Lett. 32(12), 1613–1621 (2011)
Levine, M.D., Nazif, A.M.: Dynamic measurement of computer generated image segmentations. IEEE Trans. Pattern Anal. Mach. Intell. 7(2), 155–164 (1985)
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: 8th International Conference on Computer Vision, vol. 2, pp. 416–423 (2001)
Meilă, M.: Comparing clusterings: an axiomatic view. In: 22nd International Conference on Machine Learning, pp. 577–584 (2005)
Mousavirad, S.J., Ebrahimpour-Komleh, H.: Human mental search: a new population-based metaheuristic optimization algorithm. Appl. Intell. 47(3), 850–887 (2017). https://doi.org/10.1007/s10489-017-0903-6
Omran, M.G., Engelbrecht, A.P., Salman, A.: Image classification using particle swarm optimization. In: Recent Advances in Simulated Evolution and Learning, pp. 347–365. World Scientific (2004)
Ozturk, C., Hancer, E., Karaboga, D.: Improved clustering criterion for image clustering with artificial bee colony algorithm. Pattern Anal. Appl. 18(3), 587–599 (2014). https://doi.org/10.1007/s10044-014-0365-y
Pantofaru, C., Hebert, M.: A comparison of image segmentation algorithms. Technical report, Robotics Institute (2005)
Rose, R.A., Annadhason, A.: GHT based automatic kidney image segmentation using modified AAM and GBDT. Health Technol. 10, 1–10 (2019)
Sanei, S.H.R., Fertig III, R.S.: Uncorrelated volume element for stochastic modeling of microstructures based on local fiber volume fraction variation. Compos. Sci. Technol. 117, 191–198 (2015)
Shi, Y., Eberhart, R.: A modified particle swarm optimizer. In: IEEE International Conference on Evolutionary Computation, pp. 69–73 (1998)
Storn, R., Price, K.: Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997)
Suganthan, P.N., et al.: Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Technical report, Nanyang Technological University Singapore (2005)
Wang, L., Yufeng, Y., Liu, J.: Clustering with a novel global harmony search algorithm for image segmentation. Int. J. Hybrid Inf. Technol. 9(2), 183–194 (2016)
Acknowledgements
This paper is published due to the financial support of the Federal Target Programme of the Ministry of Science and Higher Education of the Russian Federation, project unique identifier RFMEFI60819X0281.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Mousavirad, S.J., Schaefer, G., Ebrahimpour-Komleh, H., Korovin, I. (2020). A Novel Image Segmentation Based on Clustering and Population-Based Optimisation. In: Tan, Y., Shi, Y., Tuba, M. (eds) Advances in Swarm Intelligence. ICSI 2020. Lecture Notes in Computer Science(), vol 12145. Springer, Cham. https://doi.org/10.1007/978-3-030-53956-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-53956-6_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-53955-9
Online ISBN: 978-3-030-53956-6
eBook Packages: Computer ScienceComputer Science (R0)