Abstract
Rapid developments in swarm intelligence optimizers and computer processing abilities make opportunities to design more accurate, stable, and comprehensive methods for color image segmentation. This paper presents a new way for unsupervised image segmentation by combining histogram thresholding methods (Kapur’s entropy and Otsu’s method) and different multi-objective swarm intelligence algorithms (MOPSO, MOGWO, MSSA, and MOALO) to thresholding 3D histogram of a color image. More precisely, this method first combines the objective function of traditional thresholding algorithms to design comprehensive objective functions then uses multi-objective optimizers to find the best thresholds during the optimization of designed objective functions. Also, our method uses a vector objective function in 3D space that could simultaneously handle the segmentation of entire image color channels with the same thresholds. To optimize this vector objective function, we employ multi-objective swarm optimizers that can optimize multiple objective functions at the same time. Therefore, our method considers dependencies between channels to find the thresholds that satisfy objective functions of color channels (which we name as vector objective function) simultaneously. Segmenting entire color channels with the same thresholds also benefits from the fact that our proposed method needs fewer thresholds to segment the image than other thresholding algorithms; thus, it requires less memory space to save thresholds. It helps a lot when we want to segment many images to many regions. The subjective and objective results show the superiority of this method to traditional thresholding methods that separately threshold histograms of a color image.
Similar content being viewed by others
References
AlZu’bi S, Jararweh Y, Al-Zoubi H (2019) Multi-orientation geometric medical volumes segmentation using 3d multiresolution analysis. Multimed Tools Appl 78:24223–24248
AlZu’bi S, Shehab M, Al-Ayyoub M, Jararweh Y, Gupta B (2020) Parallel implementation for 3D medical volume fuzzy segmentation. Pattern Recognit Lett 130:312–318
Al-Zu’bi S, Hawashin B, Mughaid A (2021) Efficient 3D medical image segmentation algorithm over a secured multimedia network. Multimed Tools Appl 80:16887–16905
Awad M, Chehdi K, Nasri A (2007) Multicomponent image segmentation using a genetic algorithm and artificial neural network. IEEE Geosci Remote Sens Lett 4:571–575
Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495
Bhandari AK, Kumar A, Singh GK (2015) Tsallis entropy based multi-level thresholding for colored satellite image segmentation using evolutionary algorithms. Expert Syst Appl 42:8707–8730
Bhandari AK, Kumar IV, Srinivas K (2020) Cuttlefish algorithm-based multilevel 3-D Otsu function for color image segmentation. IEEE Trans Instrum Meas 69:1871–1880
Breve F (2019) Interactive image segmentation using label propagation through complex networks. Expert Syst Appl 123:18–33
Chuanqi T, Fuchun S, Tao K, Wenchang Z, Chao Y, Chunfang L (2018) A survey on deep transfer learning. Artif Neural Netw Machine Learn –ICANN
Fredo ARJ, Abilash RS, Kumar CS (2017) Segmentation and analysis of damages in composite images using multi-level threshold methods and geometrical features. Measurement 100:270–278
Fu X, Liu T, Xiong Z, Smaill BH, Stiles MK, Zhao J (2018) Segmentation of histological images and fibrosis identification with a convolutional neural network. Comput Biol Med 97:147–158
Gao Hao Xu, Wenbo S, Yulan T (2009) Multi-level thresholding for image segmentation through an improved quantum-behaved particle swarm algorithm. IEEE Trans Instrum Meas 59:934–946
Heidari A, Mirjalili S, Faris H, Aljarah I, Mafarja M, Chen H (2019) Harris hawks optimization: algorithm and applications. Future Gener Comput Syst 97:849–872
Hu X, Yang K, Fei L, Wang K (2019) Acnet: Attention based network to exploit complementary features for rgbd semantic segmentation. ICIP, pp 1440-1444
Jiang Y, Tsai P, Yeh W-C, Cao LB (2017) A honey-bee-mating based algorithm for multi-level image segmentation using Bayesian theorem. Appl Soft Comput 52:1181–1190
Kapur JN, Sahoo PK, Wong AKC (1985) A new method for graylevel picture thresholding using the entropy of the histogram. Comput Vis Graph Image Process 29:273–285
Karimpouli S, Tahmasebi P (2019) Segmentation of digital rock images using deep convolutional autoencoder networks. Comput Geosci 126:142–150
Kennedy J, Eberhart R (1995) Particle swarm optimization. Proceedings of IEEE International Conference on Neural Networks
Lee SH, Koo HI, Cho NI (2010) Image segmentation algorithms based on the machine learning of features. Pattern Recognit Lett 31:2325–2336
Li J, Tang W, Wang J, Zhang X (2019) A multi-level color image thresholding scheme based on minimum cross entropy and alternating direction method of multipliers. Optik 183:30–37
Manikandan S, Ramar K, Iruthayarajan MW, Srinivasagan KG (2014) Multi-level thresholding for segmentation of medical brain images using real coded genetic algorithm. Measurement 47:558–568
Manzke R, Meyer C, Ecabert O, Peters J, Noordhoek NJ, Thiagalingam A, Reddy VY, Chan RC, Weese J (2010) Automatic segmentation of rotational X-ray images for anatomic intra-procedural surface generation in atrial fibrillation ablation procedures. IEEE Trans Med Imaging 29:260–272
Milletari F, Navab N, Ahmadi S (2016) V-Net: Fully convolutional neural networks for volumetric medical image segmentation. International Conference on 3D Vision (3DV) 1:565-571
Mirjalili S (2017) Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191
Mirjalili S, Jangir P, Saremi S (2016) Multi-objective ant lion optimizer: a multi-objective optimization algorithm for solving engineering problems. Appl Intell 46:79–95
Mirjalili S, Saremi S, Mirjalili SM, Coelho L (2017) Multi-objective grey wolf optimizer: A novel algorithm for multi-criterion optimization. Expert Syst Appl 47:106–117
Mousavirad SJ, Ebrahimpour-Komleh H (2017) Multi-level image thresholding using entropy of histogram and recently developed population-based metaheuristic algorithms. Evol Intell 10:47–75
Oliba X, Jia H, Lang C (2019) A novel hybrid harris hawks optimization for color image multilevel thresholding segmentation. IEEE Access 7:76529–76546
Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9:62–66
Pare S, Bhandari AK, Kumar A, Singh GK (2018) A new technique for multi-level color image thresholding based on modified fuzzy entropy and LØvy flight firefly algorithm Comput Electr Eng 70:476–495
Parsopoulos K, Vrahatis M (2002) Particle swarm optimization method in multi-objective problems. Proceedings of the ACM Symposium on Applied Computing (SAC), pp 603-607
Qian P, Zhao K, Jiang Y, Su K-H, Deng Z, Wang S, Muzic RF Jr (2017) Knowledge-leveraged transfer fuzzy C-meansfor texture image segmentation with self-adaptive cluster prototype matching. Knowl Base Syst 130:33–50
Rafael C, Gonzalez, Woods RE (2018) Digital image Processing, 4th edn. Pearson
Storn R, Price K (1997) Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces. J Glob Optim 11:341–359
Tang N, Zhou F, Gu Z, Zheng H, Yu Z, Zheng B (2018) Unsupervised pixel-wise classification for Chaetoceros image segmentation. Neurocomputing 318:261–270
The Berkeley segmentation dataset and benchmark (2018) Accessed: Dec. 15 [Online]. Available: https://www2.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/segbench/BSDS300/html/dataset/images.html
Yadav D, Salmani S (2019) Deepfake: A survey on facial forgery technique using generative adversarial network. 2019International Conference on Intelligent Computing and Control Systems (ICCS), pp 852-857
Yang AQ, Huang H, Zheng C, Zhu X, Yang X, Chen P, Xue Y (2018) High-accuracy image segmentation for lactating sows using a fully convolutional network. Biosyst Eng 176:36–47
Yang Y, Tian D, Wu B (2018) “A fast and reliable noise-resistant medical image segmentation and bias field correction model. Magn Reson Imaging 54:15–31
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Naderi Boldaji, M.R., Hosseini Semnani, S. Color image segmentation using multi-objective swarm optimizer and multi-level histogram thresholding. Multimed Tools Appl 81, 30647–30661 (2022). https://doi.org/10.1007/s11042-022-12443-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12443-9