Skip to main content
SpringerLink
Log in

A novel multilevel color image segmentation technique based on an improved firefly algorithm and energy curve

  • Original Paper
  • Published:
Evolving Systems Aims and scope Submit manuscript

Abstract

Color image multilevel thresholding segmentation based on metaheuristic optimization algorithm and histogram has been widely used in many fields, but histogram neglects the relationships between the neighborhood pixels and any correlation among gray levels of the image when selecting the optimum threshold values. Therefore, in this paper, a novel and efficient color image multilevel thresholding method is proposed which uses an energy function to generate the energy curve of an image by considering spatial contextual information of the image. The presented color image segmentation technique based on energy curve takes the between class variance, Tsallis entropy and Kapur’s entropy as objective functions. In order to further enhance the segmentation performance, an improved firefly algorithm (IFA) is presented in this paper. The IFA algorithm based on energy function is used for color image multilevel thresholding problem and compared with modified firefly algorithm (MFA), cuckoo search (CS), grasshopper optimization algorithm (GOA), Harris hawks optimization (HHO), emperor penguin optimization (EPO) algorithms. The experimental results are presented in terms of optimal threshold value, optimal objective function values, peak signal to noise (PSNR), structural similarity index (SSIM), standard deviation of the objective values and statistical results. The experimental results show that the presented method outperforms the other algorithms and Kapur’s entropy based on energy curve is better than between class variance and Tsallis entropy for color image multilevel thresholding segmentation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig.1
Fig. 2
Fig. 3
Fig.4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig.12

Similar content being viewed by others

Data Availability Statement

Some or all data, models, or code generated or used during the study are available from the corresponding author by request.

References

  • Linda GS, George CS (2001) Computer Vision, 1st edn. Prentice-Hall, New Jersey

    Google Scholar 

  • Pham DL, Xu C, Prince JL (2000) Current methods in medical image segmentation. Annu Rev Biomed Eng 2(1):315–337

    Google Scholar 

  • Wu W, Chen AY, Zhao L, Corso JJ (2014) Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features. Int J Comput Assist Radiol Surg 9(1):241–253

    Google Scholar 

  • J. A. Delmerico, P. David, J. J. Corso, Building facade detection, segmentation, and parameter estimation for mobile robot localization and guidance, in IEEE International Conference on Intelligent Robots and Systems, IEEE (2011)1632–1639.

  • Chai D, Ngan KN (1999) Face segmentation using skin-color map in vidEPOhone applications. IEEE T Circ Syst Vid 9(4):551–564

    Google Scholar 

  • Yahiaoui M, Monfrini E, Dorizzi B (2016) Markov Chains for unsupervised segmentation of degraded NIR iris images for person recognition. Pattern Recogn Lett 82:116–123

    Google Scholar 

  • Cucchiara R, Piccardi M, Mello P (2000) Image analysis and rule-based reasoning for a traffic monitoring system. IEEE T Intell Transp 1(2):119–130

    Google Scholar 

  • Grover S, Saxena VS, Vatwani T (2014) Design of intelligent traffic control system using image segmentation. Int J Adv Eng Technol 7(5):1462–1469

    Google Scholar 

  • Dirami A, Hammouche K, Diaf M, Siarry P (2013) Fast multilevel thresholding for image segmentation through a multiphase level set method. Signal Process 93:139–153

    Google Scholar 

  • Otsu N (1979) A threshold selection method for grey level histograms. IEEE Trans Syst Man Cybern MC-9 62–66

  • Tsai WH (1985) Moment-preserving thresholding: a new approach. Comput vis Graph Image Process 29:377–393

    Google Scholar 

  • Kittler J, Illingworth J (1986) Minimum error thresholding. Pattern Recogn 19(1):41–47

    Google Scholar 

  • Kapur JN, Sahoo PK, Wong AK (1985) A new method for gray-level picture thresholding using the entropy of the histogram. Comput vis Graph Image Process 29(3):273–285

    Google Scholar 

  • Li CH, Lee CK (1993) Minimum cross entropy thresholding. Pattern Recogn 26:617–625

    Google Scholar 

  • Peng H, Wang J, Jérez-Jiménez M (2015) Optimal multi-level thresholding with membrane computing. Digit Signal Process 37:53–64

    Google Scholar 

  • Cuevas E, Zaldivar D, Pérez-Cisneros M (2010) A novel multi-threshold segmentation approach based on differential evolution optimization. Expert Syst Appl 37:5265–5271

    Google Scholar 

  • Sarkar S, Patra GR, Das S (2011) A differential evolution based approach for multilevel image segmentation using minimum cross entropy thresholding. In: international Conference on Swarm Springer-Verlag, Berlin Heidelberg, (2011) 51–58

  • Sarkar S, Das S (2013) Multilevel image thresholding based on 2D histogram and maximum Tsallis entropy—a differential evolution approach. IEEE T Image Process 22:4788–4797

    MathSciNet  MATH  Google Scholar 

  • Hammouche K, Diaf M, Siarry P (2008) A multilevel automatic thresholding method based on a genetic algorithm for a fast image segmentation. Comput vis Image Und 109:163–175

    Google Scholar 

  • Maulik U (2009) Medical image segmentation using genetic algorithms. IEEE Trans Inf Technol B 13:166–173

    Google Scholar 

  • Feng D, Wenkang S, Liangzhou C, Yong D, Zhenfu Z (2005) Infrared image segmentation with 2-D maximum entropy method based on particle swarm optimization (PSO). Pattern Recogn Lett 26:597–603

    Google Scholar 

  • Maitra M, Chatterjee A (2008) A hybrid cooperative–comprehensive learning based PSO algorithm for image segmentation using multilevel thresholding. Expert Syst Appl 34:1341–1350

    Google Scholar 

  • Gao H, Xu W, Sun J, Tang Y (2010) Multilevel thresholding for image segmentation through an improved quantum-behaved particle swarm algorithm. IEEE T Instrum Meas 59:934–946

    Google Scholar 

  • Ghamisi P, Couceiro MS, Martins FM, Benediktsson JA (2014) Multilevel image segmentation based on fractional-order Darwinian particle swarm optimization. IEEE Trans Geosci Remote 52:2382–2394

    Google Scholar 

  • Horng MH (2011) Multilevel thresholding selection based on the artificial bee colony algorithm for image segmentation”. Expert Syst Appl 38:13785–13791

    Google Scholar 

  • Ma M, Liang J, Guo M, Fan Y, Yin Y (2011) SAR image segmentation based on Artificial Bee Colony algorithm, Applied. Soft Comput 11:5205–5214

    Google Scholar 

  • Zhang Y, Wu L (2011) Optimal multi-level thresholding based on maximum Tsallis entropy via an artificial bee colony approach. Entropy 13:841–859

    MATH  Google Scholar 

  • Cuevas E, Sención F, Zaldivar D, Pérez-Cisneros M, Sossa H (2012) A multi-threshold segmentation approach based on Artificial Bee Colony optimization. Appl Intell 37:321–336

    Google Scholar 

  • Horng MH (2013) Multilevel image thresholding with Glowworm swam optimization algorithm based on the minimum cross entropy. Adv Inform Sci Serv Sci 5:1290–1298

    Google Scholar 

  • Qifang L, Zhe O, Xin C, Yongquan Z (2014) A multilevel threshold image segmentation algorithm based on glowworm swarm optimization. J Comput Inf Syst 10:1621–1628

    Google Scholar 

  • Brajevic I, Tuba M, Bacanin N (2012) Multilevel image thresholding selection based on the cuckoo search algorithm. In: WSEAS international conference on visualization, imaging and simulation 217–222

  • Agrawal S, Panda R, Bhuyan S, Panigrahi BK (2013) Tsallis entropy based optimal multilevel thresholding using cuckoo search algorithm. Swarm Evol Comput 11:16–30

    Google Scholar 

  • Zhiwei Y, Mingwei W, Wei L, Shaobin C (2015) Fuzzy entropy based optimal thresholding using bat algorithm. Appl Soft Comput 31:381–395

    Google Scholar 

  • Zhou Y, Li L, Ma M (2015) A novel hybrid bat algorithm for the multilevel thresholding medical image segmentation. J Med Imaging Health Inform 5:1742–1746

    Google Scholar 

  • Yin S, Qian Y, Gong M (2017) Unsupervised hierarchical image segmentation through fuzzy entropy maximization. Pattern Recogn 68:245–259

    Google Scholar 

  • Chakraborty R, Sushil R, Garg ML (2019) An improved pso-based multilevel image segmentation technique using minimum cross-entropy thresholding. Arab J Sci Eng 44:3005–3020

    Google Scholar 

  • Zhao D, Liu L, Yu F, Heidari AA, Wang M, Oliva D, Chen H (2021) Ant colony optimization with horizontal and vertical crossover search: fundamental visions for multi-threshold image segmentation. Expert Syst Appl 167(3):114–122

    Google Scholar 

  • Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42(1):21–57

    Google Scholar 

  • Yang XS, Deb S (2014) Cuckoo search: recent advances and applications. Neural Comput Appl 24(1):169–174

    Google Scholar 

  • Price KV (2013) Differential evolution. In: Handbook of optimization, Springer, Berlin, Heidelberg187–214

  • Yang XS, He X (2013) Bat algorithm: literature review and applications. Int J Bio-Inspired Comput 5(3):141–149

    Google Scholar 

  • Mirjalili S (2016) Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Comput Appl 27(4):1053–1073

    MathSciNet  Google Scholar 

  • Mirjalili SZ, Mirjalili S, Saremi S, Faris H, Aljarah I (2018) Grasshopper optimization algorithm for multi-objective optimization problems. Appl Intell 48(4):805–820

    Google Scholar 

  • Yang XS (2008) Nature-inspired metaheuristic algorithms, 1st edn. Luniver Press, Frome

    Google Scholar 

  • Yang XS (2009) Firefly algorithms for multimodal optimization. In International symposium on stochastic algorithms. Springer, Berlin Heidelberg

  • Yang XS (2010a) Firefly algorithm, stochastic test functions and design optimization. Int J Bio-Inspired Comput 2(2):78–84

    Google Scholar 

  • Miguel LFF, Miguel LFF (2012) Shape and size optimization of truss structures considering dynamic constraints through modern metaheuristic algorithms. Expert Syst Appl 39:9458–9467

    Google Scholar 

  • Fister I, Yang XS, Brest J (2013) A comprehensive review of firefly algorithms. Swarm Evol Comput 13(8):34–46

    Google Scholar 

  • Debbarma S, Saikia LC, Sinha N (2014) Solution to automatic generation control problem using firefly algorithm optimized I λ D µ controller. ISA Trans 53:358–366

    Google Scholar 

  • Pare S, Kumar A, Bajaj V, Singh GK (2016) A multilevel color image segmentation technique based on cuckoo search algorithm and energy curve. Appl Soft Comput 47:76–102

    Google Scholar 

  • Bhandari AK, Kumar A, Singh GK (2014) Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using kapur's entropy. Expert Syst Appl 41(7)

  • Manikandan S, Ramar K, Iruthayarajan MW, Srinivasagan KG (2014) Multilevel thresholding for segmentation of medical brain images using real coded genetic algorithm. Measurement 47(1):558–568

    Google Scholar 

  • Bhandari AK, Kumar A, Singh GK (2015a) Modified artificial bee colony based computationally efficient multilevel thresholding for satellite image segmentation using kapur’s, otsu and tsallis functions. Expert Syst Appl 42(3):1573–1601

    Google Scholar 

  • Alva A, Akash RS, Manikantan K (2015) Optimal multilevel thresholding based on Tsallis entropy and half-life constant PSO for improved image segmentation. In: IEEE UP Section Conference on Electrical Computer and Electronics. IEEE, 1–6

  • Mlakar U, Potočnik B, Brest J (2016) A hybrid differential evolution for optimal multilevel image thresholding. Expert Syst Appl 65:221–232

    Google Scholar 

  • Bhandari AK, Kumar A, Singh GK (2015b) Tsallis entropy based multilevel thresholding for colored satellite image segmentation using evolutionary algorithms. Expert Syst Appl 42(22):8707–8730

    Google Scholar 

  • Dey S, Bhattacharyya S, Maulik U (2016) New quantum inspired meta-heuristic techniques for multi-level colour image thresholding. Appl Soft Comput 46:677–702

    Google Scholar 

  • He L, Huang S (2017) Modified firefly algorithm based multilevel thresholding for color image segmentation. Neurocomputing 240:152–174

    Google Scholar 

  • Liang H, Jia H, Xing Z, Ma J, Peng X (2019) modified grasshopper algorithm-based multilevel thresholding for color image segmentation. IEEE Access 5:11258–11295

    Google Scholar 

  • Bao X (2019) A novel hybrid Harris hawks optimization for color image multilevel thresholding segmentation. IEEE Access 7:76529–76546

    Google Scholar 

  • Xu L, Jia C, Lang C, Peng X, Sun K (2019) A novel method for multilevel color image segmentation based on dragonfly algorithm and differential evolution. IEEE Access 19502–19538.

  • Xing Z (2020) An improved emperor penguin optimization based multilevel thresholding for color image segmentation. Knowl-Based Syst 194(22):105570

    Google Scholar 

  • Łukasik S, Żak S (2009) Firefly algorithm for continuous constrained optimization tasks. In: Computational Collective Intelligence. Semantic Web, Social Networks and Multiagent Systems. Springer Press, Berlin Heidelberg

  • Horng MH, Liou RJ (2011) Multilevel minimum cross entropy threshold selection based on the firefly algorithm. Expert Syst Appl 38:14805–14811

    Google Scholar 

  • Yang XS, Hosseini S, Gandomi AH (2012) Firefly algorithm for solving non-convex economic dispatch problems with valve loading effect. Appl Soft Comput 12(3):1180–1186

    Google Scholar 

  • Yu SH, Zhu SL, Ma Y, Mao DM (2015) A variable step size firefly algorithm for numerical optimization. Appl Math and Comput 4263:214–220

    MathSciNet  MATH  Google Scholar 

  • Yang XS (2010b) Firefly Algorithm, Lévy Flights and Global Optimization. In: Bramer M, Ellis R, Petridis M (eds) Research and Development in Intelligent Systems XXVI. Springer, London

  • Shan J, Chu S, Weng S, Pan J, Jiang S, Zheng S (2022) a parallel compact firefly algorithm for the control of variable pitch wind turbine. Eng Appl Artif Intell 111:104787

    Google Scholar 

  • Xu GH, Zhang TW, Lai Q (2021) A new firefly algorithm with mean condition partial attraction. Appl Intell 52(2021):4418–4431

    Google Scholar 

  • Ewees AA, Al-Qaness MAA, Elaziz MA (2021) Enhanced salp swarm algorithm based on firefly algorithm for unrelated parallel machine scheduling with setup times. Appl Math Model 285–305

  • Al-Qaness MAA, Ewees AA, Elaziz MA (2021) Modified whale optimization algorithm for solving unrelated parallel machine scheduling problems. Soft Comput 25(14):9545–9557

    Google Scholar 

  • Liu J, Lampinen J (2002) A fuzzy adaptive differential evolution algorithm. In: IEEE Region 10 Conference on Computers, Communications, Control and Power Engineering (2002) 606–611

  • Dhiman G, Kumar V (2018) Emperor penguin optimizer: a bio-inspired algorithm for engineering problems. Knowl-Based Syst 159:20–50

    Google Scholar 

  • Sowmya B, Rani BS (2011) Colour image segmentation using fuzzy clustering techniques and competitive neural net-work. Appl Soft Comput 11(3):3170–3178

    Google Scholar 

  • Oliva D, Cuevas E, Pajares G, Zaldivar D, Osuna V (2014) A multilevel thresholding algorithm using electromagnetism optimization. Neurocomputing 139:357–381

    Google Scholar 

  • Wang Z, Simoncelli EP, Bovik AC (2003) Multiscale structural similarity for image quality assessment. In: Processing Asilomar Conference on Signals, Systems and Computers 1398–1402

Download references

Acknowledgements

This work was supported by the doctoral research startup foundation of Yunnan Normal University (No. 2019BSXM13).

Author information

Authors and Affiliations

  1. Pan-Asia Business School, Yunnan Normal University, Kunming, 650092, China

    Qiuping Guo & Hao Peng

Authors
  1. Qiuping Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hao Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hao Peng.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interests regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, Q., Peng, H. A novel multilevel color image segmentation technique based on an improved firefly algorithm and energy curve. Evolving Systems 14, 685–733 (2023). https://doi.org/10.1007/s12530-022-09460-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12530-022-09460-2

Keywords

Search

Navigation