Skip to main content
Log in

A novelty harmony search algorithm of image segmentation for multilevel thresholding using learning experience and search space constraints

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image segmentation is an important part of image understanding and one of the most difficult problems in image processing. For image segmentation processing, this paper proposes an image segmentation algorithm for multilevel thresholding based on novelty harmony search algorithm. Firstly, the central harmony and central congestion distance are introduced to reduce local aggregation of initial points and expand the search range. Secondly, the new harmony generation strategy is constructed, which is based on dominant harmony learning experience. Then the search space constraints and parameters adaptive adjustment are adopted to improve the search efficiency. Finally, the harmony memory updating rules are designed to enhance the diversity of population. The image segmentation effect is evaluated by the between-class variance, peak signal-to-noise ratio and mean structural similarity. A series of experiments have been carried out to analyze the segmentation effect of the proposed NHS algorithm based on the Berkeley segmentation database. Compared with the basic harmony search algorithm, improved harmony search algorithm, global best harmony search algorithm, particle swarm optimization algorithm and artificial bee colony algorithm, the experimental results show the effectiveness of the proposed algorithm. In particular the proposed algorithm is superior to other methods when the threshold number increases. The influence of noise and artifact on image segmentation is also discussed and analyzed. It illustrates that the image can be segmented in the Gaussian noise, mixed noise and strip line artifact conditions based on the proposed algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Akay B (2013) A study on particle swarm optimization and artificial bee colony algorithms for multilevel thresholding. Appl Soft Comput 13(6):3066–3091

    Article  Google Scholar 

  2. Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour Detection and Hierarchical Image Segmentation. IEEE Trans Pattern Anal Mach Intell 33:898–916. https://doi.org/10.1109/TPAMI.2010.161

    Article  Google Scholar 

  3. Aziz MAE, Eweesc AA, Hassanien AE (2017) Whale optimization algorithm and moth-flame optimization for multilevel thresholding image segmentation. Expert Syst Appl 83:242–256. https://doi.org/10.1016/j.eswa.2017.04.023

    Article  Google Scholar 

  4. Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495

    Article  Google Scholar 

  5. Bhandari AK, Rahul K (2019) A context sensitive Masi entropy for multilevel image segmentation using moth swarm algorithm. Infrared Phys Technol 98:132–154. https://doi.org/10.1016/j.infrared.2019.03.010

    Article  Google Scholar 

  6. Bhandari AK, Kumar A, Singh GK (2015) Modified artificial bee colony based computationally efficient multilevel thresholding for satellite image segmentation using Kapur’s, Otsu and Tsallis functions. Expert Syst Appl 42:1573–1601. https://doi.org/10.1016/j.eswa.2014.09.049

    Article  Google Scholar 

  7. Chen J, Pan Q, Li J (2012) Harmony search algorithm with dynamic control parameters. Appl Math Comput 219:592–604. https://doi.org/10.1016/j.amc.2012.06.048

    Article  MathSciNet  MATH  Google Scholar 

  8. Drozdzal M, Chartrand G, Vorontsov E et al (2018) Learning normalized inputs for iterative estimation in medical image segmentation. Med Image Anal 44:1–13. https://doi.org/10.1016/j.media.2017.11.005

    Article  Google Scholar 

  9. Elaziz MA, Ewees AA, Yousri D et al (2020) An improved marine predators algorithm with fuzzy entropy for multi-level thresholding: real world example of COVID-19 CT image segmentation. IEEE Access 8:125306–125330. https://doi.org/10.1109/ACCESS.2020.3007928

    Article  Google Scholar 

  10. He LF, Huang SW (2017) Modified firefly algorithm based multilevel thresholding for color image segmentation. Neurocomputing 240:152–174. https://doi.org/10.1016/j.neucom.2017.02.040

    Article  Google Scholar 

  11. Kattan A, Abdullah R (2013) A dynamic self-adaptive harmony search algorithm for continuous optimization problems. Appl Math Comput 219:8542–8567. https://doi.org/10.1016/j.amc.2013.02.074

    Article  MathSciNet  MATH  Google Scholar 

  12. Khairuzzaman AKM, Chaudhury S (2017) Multilevel thresholding using grey wolf optimizer for image segmentation. Expert Syst Appl 86:64–76. https://doi.org/10.1016/j.eswa.2017.04.029

    Article  Google Scholar 

  13. Liu Y, Li MS, Fu CY (2015) Research of image segmentation algorithm based on edge detection. In: International Conference on Intelligent Systems Research & Mechatronics Engineering, pp 2260–2270

  14. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 3431–3440

  15. Mahdavi M, Fesanghary M, Damangir E (2007) An improved harmony search algorithm for solving optimization problems. Appl Math Comput 188(2):1567–1579

    MathSciNet  MATH  Google Scholar 

  16. Mala C, Sridevi M (2016) Multilevel threshold selection for image segmentation using soft computing techniques. Soft Comput 20:1793–1810. https://doi.org/10.1007/s00500-015-1677-6

    Article  Google Scholar 

  17. Matic T, Aleksi I, Hocenski Z, Kraus D (2018) Real-time biscuit tile image segmentation method based on edge detection. ISA Trans 76:246–254. https://doi.org/10.1016/j.isatra.2018.03.015

    Article  Google Scholar 

  18. Moussa M, Guedri W, Douik A (2020) A novel metaheuristic algorithm for edge detection based on artificial bee colony technique. Traitement Du Signal 37(3):405–412. https://doi.org/10.18280/ts.370307

    Article  Google Scholar 

  19. Nirkin Y, Masi I, Tran AT et al (2018) On face segmentation, face swapping, and face perception. In: IEEE International Conference on Automatic Face & Gesture Recognition (FG), pp 98–105

  20. Niu SJ, Chen Q, Sisternes L (2017) Robust noise region-based active contour model via local similarity factor for image segmentation. Pattern Recogn 61:104–119. https://doi.org/10.1016/j.patcog.2016.07.022

    Article  Google Scholar 

  21. Oliva D, Cuevas E, Pajares G et al (2013) Multilevel thresholding segmentation based on harmony search optimization. J Appl Math :1–12. https://doi.org/10.1155/2013/575414

  22. Oliva D, Hinojosa S, Cuevas E et al (2017) Cross entropy based thresholding for magnetic resonance brain images using Crow Search Algorithm. Expert Syst Appl 79:164–180. https://doi.org/10.1016/j.eswa.2017.02.042

    Article  Google Scholar 

  23. Omran MGH, Mahdavi M (2008) Global-best harmony search. Appl Math Comput 198:643–656. https://doi.org/10.1016/j.amc.2007.09.004

    Article  MathSciNet  MATH  Google Scholar 

  24. Pan QK, Suganthan PN, Tasgetiren MF, Liang JJ (2010) A self-adaptive global best harmony search algorithm for continuous optimization problems. Appl Math Comput 216:830–848. https://doi.org/10.1016/j.amc.2010.01.088

    Article  MathSciNet  MATH  Google Scholar 

  25. Pare S, Kumar A, Singh GK, Bajaj V (2020) Image segmentation using multilevel thresholding: A research review. Iran J Sci Technol - Trans Electr Eng 44:1–29. https://doi.org/10.1007/s40998-019-00251-1

    Article  Google Scholar 

  26. Pare S, Bhandari AK, Kumar A, Singh GK, Khare S (2015) Satellite image segmentation based on different objective functions using genetic algorithm: A comparative study. In: IEEE International Conference on Digital Signal Processing (DSP), pp 730–734

  27. Rad AE, Rahim MSM, Kolivand H, Amin IB (2017) Morphological region-based initial contour algorithm for level set methods in image segmentation. Multimed Tools Appl 76:2185–2122. https://doi.org/10.1007/s11042-015-3196-y

    Article  Google Scholar 

  28. Ramadas M, Abraham A (2020) Detecting tumours by segmenting MRI images using transformed differential evolution algorithm with Kapur’s thresholding. Neural Comput Appl 32:6139–6149. https://doi.org/10.1007/s00521-019-04104-0

    Article  Google Scholar 

  29. Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp 234–241

  30. Salem M, Khelfi MF (2016) The variants of harmony search algorithm: Statistical comparison. In: Third World Conference on Complex Systems (WCCS), pp 1–5

  31. Singha A, Sethi G, Kalra GS (2020) Spatially adaptive image denoising via enhanced noise detection method for grayscale and color images. IEEE Access: 112985–113002. https://doi.org/10.1109/ACCESS.2020.3003874

  32. Smolka B, Kusnik D (2020) On the application of the reachability distance in the suppression of mixed Gaussian and impulsive noise in color images. Multimedia Tool and Applications, pp 32857–32879. https://doi.org/10.1007/s11042-020-09550-w

  33. Suresh S, Lal S (2016) An efficient cuckoo search algorithm based multilevel thresholding for segmentation of satellite images using different objective functions. Expert Syst Appl 58:184–209. https://doi.org/10.1016/j.eswa.2016.03.032

    Article  Google Scholar 

  34. Tuba V, Beko M, Tuba M(2017) Color image segmentation by multilevel thresholding based on harmony search algorithm. In: International Conference on Intelligent Data Engineering and Automated Learning, pp 571–579

  35. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:600–612. https://doi.org/10.1109/TIP.2003.819861

    Article  Google Scholar 

  36. Zhang ZC, Yin JQ (2020) Bee foraging algorithm based multi-level thresholding for image segmentation. IEEE Access 8:16269–16280. https://doi.org/10.1109/ACCESS.2020.2966665

    Article  Google Scholar 

  37. Zou DX, Gao LQ, Wu JH, Li S (2010) Novel global harmony search algorithm for unconstrained problems. Neuro Comput 73:3308–3318. https://doi.org/10.1016/j.neucom.2010.07.010

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xinli Li.

Ethics declarations

Conflict of interest

The authors declared that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, X., Li, X. & Yang, G. A novelty harmony search algorithm of image segmentation for multilevel thresholding using learning experience and search space constraints. Multimed Tools Appl 82, 703–723 (2023). https://doi.org/10.1007/s11042-022-13288-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13288-y

Keywords

Navigation