Skip to main content
Log in

Color image segmentation using multi-objective swarm optimizer and multi-level histogram thresholding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Rapid developments in swarm intelligence optimizers and computer processing abilities make opportunities to design more accurate, stable, and comprehensive methods for color image segmentation. This paper presents a new way for unsupervised image segmentation by combining histogram thresholding methods (Kapur’s entropy and Otsu’s method) and different multi-objective swarm intelligence algorithms (MOPSO, MOGWO, MSSA, and MOALO) to thresholding 3D histogram of a color image. More precisely, this method first combines the objective function of traditional thresholding algorithms to design comprehensive objective functions then uses multi-objective optimizers to find the best thresholds during the optimization of designed objective functions. Also, our method uses a vector objective function in 3D space that could simultaneously handle the segmentation of entire image color channels with the same thresholds. To optimize this vector objective function, we employ multi-objective swarm optimizers that can optimize multiple objective functions at the same time. Therefore, our method considers dependencies between channels to find the thresholds that satisfy objective functions of color channels (which we name as vector objective function) simultaneously. Segmenting entire color channels with the same thresholds also benefits from the fact that our proposed method needs fewer thresholds to segment the image than other thresholding algorithms; thus, it requires less memory space to save thresholds. It helps a lot when we want to segment many images to many regions. The subjective and objective results show the superiority of this method to traditional thresholding methods that separately threshold histograms of a color image.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. AlZu’bi S, Jararweh Y, Al-Zoubi H (2019) Multi-orientation geometric medical volumes segmentation using 3d multiresolution analysis. Multimed Tools Appl 78:24223–24248

    Article  Google Scholar 

  2. AlZu’bi S, Shehab M, Al-Ayyoub M, Jararweh Y, Gupta B (2020) Parallel implementation for 3D medical volume fuzzy segmentation. Pattern Recognit Lett 130:312–318

    Article  Google Scholar 

  3. Al-Zu’bi S, Hawashin B, Mughaid A (2021) Efficient 3D medical image segmentation algorithm over a secured multimedia network. Multimed Tools Appl 80:16887–16905

    Article  Google Scholar 

  4. Awad M, Chehdi K, Nasri A (2007) Multicomponent image segmentation using a genetic algorithm and artificial neural network. IEEE Geosci Remote Sens Lett 4:571–575

    Article  Google Scholar 

  5. Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495

    Article  Google Scholar 

  6. Bhandari AK, Kumar A, Singh GK (2015) Tsallis entropy based multi-level thresholding for colored satellite image segmentation using evolutionary algorithms. Expert Syst Appl 42:8707–8730

    Article  Google Scholar 

  7. Bhandari AK, Kumar IV, Srinivas K (2020) Cuttlefish algorithm-based multilevel 3-D Otsu function for color image segmentation. IEEE Trans Instrum Meas 69:1871–1880

    Article  Google Scholar 

  8. Breve F (2019) Interactive image segmentation using label propagation through complex networks. Expert Syst Appl 123:18–33

    Article  Google Scholar 

  9. Chuanqi T, Fuchun S, Tao K, Wenchang Z, Chao Y, Chunfang L (2018) A survey on deep transfer learning. Artif Neural Netw Machine Learn –ICANN

  10. Fredo ARJ, Abilash RS, Kumar CS (2017) Segmentation and analysis of damages in composite images using multi-level threshold methods and geometrical features. Measurement 100:270–278

  11. Fu X, Liu T, Xiong Z, Smaill BH, Stiles MK, Zhao J (2018) Segmentation of histological images and fibrosis identification with a convolutional neural network. Comput Biol Med 97:147–158

    Article  Google Scholar 

  12. Gao Hao Xu, Wenbo S, Yulan T (2009) Multi-level thresholding for image segmentation through an improved quantum-behaved particle swarm algorithm. IEEE Trans Instrum Meas 59:934–946

    Article  Google Scholar 

  13. Heidari A, Mirjalili S, Faris H, Aljarah I, Mafarja M, Chen H (2019) Harris hawks optimization: algorithm and applications. Future Gener Comput Syst 97:849–872

    Article  Google Scholar 

  14. Hu X, Yang K, Fei L, Wang K (2019) Acnet: Attention based network to exploit complementary features for rgbd semantic segmentation. ICIP, pp 1440-1444

  15. Jiang Y, Tsai P, Yeh W-C, Cao LB (2017) A honey-bee-mating based algorithm for multi-level image segmentation using Bayesian theorem. Appl Soft Comput 52:1181–1190

    Article  Google Scholar 

  16. Kapur JN, Sahoo PK, Wong AKC (1985) A new method for graylevel picture thresholding using the entropy of the histogram. Comput Vis Graph Image Process 29:273–285

    Article  Google Scholar 

  17. Karimpouli S, Tahmasebi P (2019) Segmentation of digital rock images using deep convolutional autoencoder networks. Comput Geosci 126:142–150

    Article  Google Scholar 

  18. Kennedy J, Eberhart R (1995) Particle swarm optimization. Proceedings of IEEE International Conference on Neural Networks

  19. Lee SH, Koo HI, Cho NI (2010) Image segmentation algorithms based on the machine learning of features. Pattern Recognit Lett 31:2325–2336

    Article  Google Scholar 

  20. Li J, Tang W, Wang J, Zhang X (2019) A multi-level color image thresholding scheme based on minimum cross entropy and alternating direction method of multipliers. Optik 183:30–37

    Article  Google Scholar 

  21. Manikandan S, Ramar K, Iruthayarajan MW, Srinivasagan KG (2014) Multi-level thresholding for segmentation of medical brain images using real coded genetic algorithm. Measurement 47:558–568

    Article  Google Scholar 

  22. Manzke R, Meyer C, Ecabert O, Peters J, Noordhoek NJ, Thiagalingam A, Reddy VY, Chan RC, Weese J (2010) Automatic segmentation of rotational X-ray images for anatomic intra-procedural surface generation in atrial fibrillation ablation procedures. IEEE Trans Med Imaging 29:260–272

    Article  Google Scholar 

  23. Milletari F, Navab N, Ahmadi S (2016) V-Net: Fully convolutional neural networks for volumetric medical image segmentation. International Conference on 3D Vision (3DV) 1:565-571

  24. Mirjalili S (2017) Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191

    Article  Google Scholar 

  25. Mirjalili S, Jangir P, Saremi S (2016) Multi-objective ant lion optimizer: a multi-objective optimization algorithm for solving engineering problems. Appl Intell 46:79–95

    Article  Google Scholar 

  26. Mirjalili S, Saremi S, Mirjalili SM, Coelho L (2017) Multi-objective grey wolf optimizer: A novel algorithm for multi-criterion optimization. Expert Syst Appl 47:106–117

    Article  Google Scholar 

  27. Mousavirad SJ, Ebrahimpour-Komleh H (2017) Multi-level image thresholding using entropy of histogram and recently developed population-based metaheuristic algorithms. Evol Intell 10:47–75

    Article  Google Scholar 

  28. Oliba X, Jia H, Lang C (2019) A novel hybrid harris hawks optimization for color image multilevel thresholding segmentation. IEEE Access 7:76529–76546

    Article  Google Scholar 

  29. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9:62–66

    Article  Google Scholar 

  30. Pare S, Bhandari AK, Kumar A, Singh GK (2018) A new technique for multi-level color image thresholding based on modified fuzzy entropy and LØvy flight firefly algorithm Comput Electr Eng 70:476–495

  31. Parsopoulos K, Vrahatis M (2002) Particle swarm optimization method in multi-objective problems. Proceedings of the ACM Symposium on Applied Computing (SAC), pp 603-607

  32. Qian P, Zhao K, Jiang Y, Su K-H, Deng Z, Wang S, Muzic RF Jr (2017) Knowledge-leveraged transfer fuzzy C-meansfor texture image segmentation with self-adaptive cluster prototype matching. Knowl Base Syst 130:33–50

    Article  Google Scholar 

  33. Rafael C, Gonzalez, Woods RE (2018) Digital image Processing, 4th edn. Pearson

  34. Storn R, Price K (1997) Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces. J Glob Optim 11:341–359

    Article  MathSciNet  Google Scholar 

  35. Tang N, Zhou F, Gu Z, Zheng H, Yu Z, Zheng B (2018) Unsupervised pixel-wise classification for Chaetoceros image segmentation. Neurocomputing 318:261–270

    Article  Google Scholar 

  36. The Berkeley segmentation dataset and benchmark (2018) Accessed: Dec. 15 [Online]. Available: https://www2.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/segbench/BSDS300/html/dataset/images.html

  37. Yadav D, Salmani S (2019) Deepfake: A survey on facial forgery technique using generative adversarial network. 2019International Conference on Intelligent Computing and Control Systems (ICCS), pp 852-857

  38. Yang AQ, Huang H, Zheng C, Zhu X, Yang X, Chen P, Xue Y (2018) High-accuracy image segmentation for lactating sows using a fully convolutional network. Biosyst Eng 176:36–47

    Article  Google Scholar 

  39. Yang Y, Tian D, Wu B (2018) “A fast and reliable noise-resistant medical image segmentation and bias field correction model. Magn Reson Imaging 54:15–31

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Samaneh Hosseini Semnani.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Naderi Boldaji, M.R., Hosseini Semnani, S. Color image segmentation using multi-objective swarm optimizer and multi-level histogram thresholding. Multimed Tools Appl 81, 30647–30661 (2022). https://doi.org/10.1007/s11042-022-12443-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12443-9

Keywords

Navigation