Skip to main content

Advertisement

Springer Nature Link
Log in

Improved seagull optimization algorithm using Lévy flight and mutation operator for feature selection

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Seagull optimization algorithm (SOA) is a recent bio-inspired technique utilized to improve the constrained large-scale problems in low computational cost and quick convergence speed. However, the globally optimized search space for the SOA is linear, which means that the SOA’s global search capability could not be fully utilized. Thus, we propose an improved SOA algorithm (ISOA) using Lévy flight and mutation operators. The ISOA obtains some Lévy flight features, which improves the original SOA by performing large jumps, making the search escape from the local optima and begin at a different search space region. The mutation operator, which improves the exploration–exploitation trade-off, allows the catch of the optimal solution quickly and accurately. In order to examine the performance of the proposed ISOA approach, three experiments were conducted. The first one evaluates the ISOA in solving the global optimization problem. The second one is a comparative study based on twenty benchmark datasets to evaluate the general capability of ISOA in feature selection, compared to ten recent and well-established algorithms constructed using the other meta-heuristics methods. Furthermore, the third experiment is conducted using a real dataset with various face poses to investigate the efficiency of the ISOA in pose-variation recognition. Compared to the other meta-heuristics methods, the results show that the proposed model is more accurate and efficient in global optimization, feature selection purposes, and pose variation recognition. Furthermore, the ISOA approach outperforms the other methods proposed in the state-of-the-art literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Han C, Zhou G, Zhou Y (2019) Binary symbiotic organism search algorithm for feature selection and analysis. IEEE Access 7:166833–166859

    Article  Google Scholar 

  2. Quiroz JC, Banerjee A, Dascalu SM, Lau SL (2017) Feature selection for activity recognition from smartphone accelerometer data. Intell Autom Soft Comput, 1–9

  3. Aljarah I, Habib M, Faris H, Al-Madi N, Heidari Ali A, Mafarja M, Elaziz MA, Mirjalili S (2020) A dynamic locality multi-objective salp swarm algorithm for feature selection. Comput Industr Eng 147:106628

    Article  Google Scholar 

  4. Hancer E, Xue B, Karaboga D, Zhang M (2015) A binary abc algorithm based on advanced similarity scheme for feature selection. Appl Soft Comput 36:334–348

    Article  Google Scholar 

  5. Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Syst Appl 116:147–160

    Article  Google Scholar 

  6. Zhong C, Yu C, Peng J (2020) Feature selection based on a novel improved tree growth algorithm. Int J Comput Intell Syst 13(1):247–258

    Article  Google Scholar 

  7. Vieira SM, Mendonça LF, Farinha GJ, Sousa JM (2013) Modified binary PSO for feature selection using svm applied to mortality prediction of septic patients. Appl Soft Comput 13(8):3494–3504

    Article  Google Scholar 

  8. Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65

    Article  Google Scholar 

  9. De Souza RCT, dos Santos Coelho L, De Macedo CA, Pierezan J (2018) A v-shaped binary crow search algorithm for feature selection. In: 2018 IEEE congress on evolutionary computation (CEC), pp 1–8. IEEE

  10. Moorthy U, Gandhi UD (2020) Forest optimization algorithm-based feature selection using classifier ensemble. Comput Intell 36(4):1445–1462

    Article  Google Scholar 

  11. de Souza RCT, de Macedo CA, dos Santos CL, Pierezan J, Mariani VC (2020) Binary coyote optimization algorithm for feature selection. Pattern Recogn 107:107470

    Article  Google Scholar 

  12. Dhiman G, Kumar V (2019) Seagull optimization algorithm: theory and its applications for large-scale industrial engineering problems. Knowl-Based Syst 165:169–196

    Article  Google Scholar 

  13. W Jiao, L Yan, H Gang (2021) Hybrid seagull optimization algorithm and its engineering application integrating yin–yang pair idea. Eng Comput, 1–37

  14. Yuyin W (2020) OTSU image threshold segmentation method based on seagull optimization algorithm. In: Journal of Physics: Conference Series, vol 1650, p 032181. IOP Publishing

  15. Jia H, Xing Z, Song W (2019) Three dimensional pulse coupled neural network based on hybrid optimization algorithm for oil pollution image segmentation. Remote Sens 11(9):1046

    Article  Google Scholar 

  16. Chen H, Zhou H, Li M, Xu H, Zhou X (2021) Application of distributed seagull optimization improved algorithm in sentiment tendency prediction. In: Conference on complex, intelligent, and software intensive systems, pp 90–99. Springer

  17. Dhiman G, Singh KK, Soni M, Nagar A, Dehghani M, Slowik A, Kaur A, Sharma A, Houssein EH, Cengiz K (2021) Mosoa: a new multi-objective seagull optimization algorithm. Expert Syst Appl 167:114150

    Article  Google Scholar 

  18. Dhiman G, Singh KK, Slowik A, Chang Yildiz AR, Kaur A, Garg M (2021) Emosoa: a new evolutionary multi-objective seagull optimization algorithm for global optimization. Int J Mach Learning Cybern 12(2):571–596

    Article  Google Scholar 

  19. Olorunda O, Engelbrecht AP (2008) Measuring exploration/exploitation in particle swarms using swarm diversity. In: 2008 IEEE congress on evolutionary computation (IEEE world congress on computational intelligence), pp 1128–1134. IEEE

  20. Abd Elaziz M, Mirjalili S (2019) A hyper-heuristic for improving the initial population of whale optimization algorithm. Knowl-Based Syst 172:42–63

    Article  Google Scholar 

  21. Kabir MM, Shahjahan M, Murase K (2012) A new hybrid ant colony optimization algorithm for feature selection. Expert Syst Appl 39(3):3747–3763

    Article  Google Scholar 

  22. Chen K, Zhou F-Y, Yuan X-F (2019) Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection. Expert Syst Appl 128:140–156

    Article  Google Scholar 

  23. Mohammadzadeh H, Gharehchopogh FS (2020) A novel hybrid whale optimization algorithm with flower pollination algorithm for feature selection: Case study email spam detection. Comput Intell

  24. Shunmugapriya P, Kanmani S (2017) A hybrid algorithm using ant and bee colony optimization for feature selection and classification (ac-abc hybrid). Swarm Evolut Comput 36:27–36

    Article  Google Scholar 

  25. El-Hasnony IM, Barakat SI, Elhoseny M, Mostafa RR (2020) Improved feature selection model for big data analytics. IEEE Access 8:66989–67004

    Article  Google Scholar 

  26. Tawhid MA, Dsouza KB (2018) Hybrid binary bat enhanced particle swarm optimization algorithm for solving feature selection problems. Appl Comput Inf

  27. Zhang Y, Liu R, Wang X, Chen H, Li C (2020) Boosted binary harris hawks optimizer and feature selection. Eng Comput, pp 1–30

  28. Niknamfar AH, Niaki STA (2017) Opposition-based learning for competitive hub location: a bi-objective biogeography-based optimization algorithm. Knowl-Based Syst 128:1–19

    Article  Google Scholar 

  29. Edwards Andrew M, Phillips Richard A, Watkins Nicholas W, Freeman Mervyn P, Murphy Eugene J, Vsevolod Afanasyev, Buldyrev Sergey V, da Luz Marcos GE, Raposo Ernesto P, Eugene Stanley H et al (2007) Revisiting lévy flight search patterns of wandering albatrosses, bumblebees and deer. Nature 449(7165):1044–1048

    Article  Google Scholar 

  30. Viswanathan Gandhimohan M, Afanasyev V, Buldyrev SV, Murphy EJ, Prince PA, Eugene StH (1996) Lévy flight search patterns of wandering albatrosses. Nature 381(6581):413–415

    Article  Google Scholar 

  31. Xu L, Li Y, Li K, Beng GH, Jiang Z, Wang C, Liu N (2018) Enhanced moth-flame optimization based on cultural learning and gaussian mutation. J Bionic Eng 15(4):751–763

    Article  Google Scholar 

  32. Zhang H, Xie J, Hu Q, Shao L, Chen T (2018) A hybrid DPSO with levy flight for scheduling MIMO radar tasks. Appl Soft Comput 71:242–254

    Article  Google Scholar 

  33. Amirsadri S, Mousavirad SJ, Ebrahimpour-Komleh H (2018) A levy flight-based grey wolf optimizer combined with back-propagation algorithm for neural network training. Neural Comput Appl 30(12):3707–3720

    Article  Google Scholar 

  34. Fileccia Scimemi G, Turetta T, Celauro C (2016) Backcalculation of airport pavement moduli and thickness using the lévy ant colony optimization algorithm. Constr Build Mater 119:288–295

    Article  Google Scholar 

  35. Hussein WA, Sahran S, Abdullah SNHS (2014) Patch-levy-based initialization algorithm for bees algorithm. Appl Soft Comput 23:104–121

    Article  Google Scholar 

  36. Li Z, Zhou Y, Zhang S, Song J (2016) Lévy-flight moth-flame algorithm for function optimization and engineering design problems. Math Probl Eng

  37. Xie J, Zhou Y, Tang Z (2013) Differential lévy-flights bat algorithm for minimization makespan in permutation flow shops. In: International conference on intelligent computing, pp 179–188. Springer

  38. Sharawi M, Zawbaa HM, Emary E (2017) Feature selection approach based on whale optimization algorithm. In: 2017 Ninth international conference on advanced computational intelligence (ICACI), pp 163–168. IEEE

  39. Eid Heba F (2018) Binary whale optimisation: an effective swarm algorithm for feature selection. Int J Metaheur 7(1):67–79

    Article  Google Scholar 

  40. Sayed GI, Darwish A, Hassanien AE (2018) A new chaotic whale optimization algorithm for features selection. J Classif 35(2):300–344

    Article  MathSciNet  MATH  Google Scholar 

  41. Mafarja M, Aljarah I, H Faris, Abdelaziz AI, Ala’M A-Z, Mirjalili S (2019) Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Syst Appl 117:267–286

  42. Mafarja M, Mirjalili S (2018) Whale optimization approaches for wrapper feature selection. Appl Soft Comput 62:441–453

    Article  Google Scholar 

  43. Shivahare BD, Singh M, Gupta A, Ranjan S, Pareta D, Sahu BM (2021) Survey paper: Whale optimization algorithm and its variant applications. In: 2021 International Conference on Innovative Practices in Technology and Management (ICIPTM), pp 77–82. IEEE

  44. Abdel-Basset M, Ding W, El-Shahat D (2021) A hybrid harris hawks optimization algorithm with simulated annealing for feature selection. Artif Intell Rev 54(1):593–637

    Article  Google Scholar 

  45. Ibrahim RA, Ewees AA, Oliva D, AbdElaziz M, Songfeng L (2019) Improved salp swarm algorithm based on particle swarm optimization for feature selection. J Amb Intell Human Comput 10(8):3155–3169

    Article  Google Scholar 

  46. Aljarah I, Mafarja M, Heidari AA, Faris H, Zhang Y, Mirjalili S (2018) Asynchronous accelerating multi-leader salp chains for feature selection. Appl Soft Comput 71:964–979

    Article  Google Scholar 

  47. Faris H, Mafarja MM, Heidari AA, Aljarah I, Ala’M AZ, Mirjalili S, Fujita H (2018) An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowl-Based Syst 154:43–67

  48. Premkumar M, Jangir P, Kumar BS, Sowmya R, Alhelou HH, Abualigah L, Yildiz AR, Mirjalili S (2021) A new arithmetic optimization algorithm for solving real-world multiobjective cec-2021 constrained optimization problems: Diversity analysis and validations. IEEE Access

  49. Demertzis K, Iliadis L (2016) Adaptive elitist differential evolution extreme learning machines on big data: intelligent recognition of invasive species. In: INNS conference on Big Data, pp 333–345. Springer

  50. Zhang Z, Ding S, Sun Y (2020) A support vector regression model hybridized with chaotic krill herd algorithm and empirical mode decomposition for regression task. Neurocomputing 410:185–201

    Article  Google Scholar 

  51. Jiang H, Yang Y, Ping W, Dong Y (2020) A novel hybrid classification method based on the opposition-based seagull optimization algorithm. IEEE Access 8:100778–100790

    Article  Google Scholar 

  52. Jia H, Xing Z, Song W (2019) A new hybrid seagull optimization algorithm for feature selection. IEEE Access 7:49614–49631

    Article  Google Scholar 

  53. Panagant N, Pholdee N, Bureerat S, Kaen K, Rıza Yıldız A, Sait Sadiq M (2020) Seagull optimization algorithm for solving real-world design optimization problems. Mater Test 62(6):640–644

    Article  Google Scholar 

  54. Liu J, Mao Y, Liu X, Li Y (2020) A dynamic adaptive firefly algorithm with globally orientation. Math Comput Simul 174:76–101

    Article  MathSciNet  MATH  Google Scholar 

  55. Zhang XM, Wang X, Tu Q, Kang Q (2018) Particle swarm optimization algorithm based on combining global-best operator and levy fligh. J Univ Electr Sci Technol China 47(3):103–111

    Google Scholar 

  56. Yin H, Dong KL, Peng ZR, Li SY (2018) Fish swarm algorithm with lévy flight and firefly behavior. Control Theory Appl 35(4):497–505

    Google Scholar 

  57. Li N, Li G, Deng ZL (2017) An improved sine cosine algorithm based on levy flight. In: Ninth international conference on digital image processing (ICDIP 2017), vol 10420, p 104204R. International Society for Optics and Photonics

  58. Liu S, Wang Y (2021) A lévy flight based firefly algorithm for multilevel thresholding image segmentation. In: Journal of Physics: Conference Series, vol 1865, p 042098. IOP Publishing

  59. Xie W, Jie-Sheng Wang, Tao Y (2019) Improved black hole algorithm based on golden sine operator and levy flight operator. IEEE Access 7:161459–161486

    Article  Google Scholar 

  60. Khurma RA, Aljarah I, Sharieh A (2021) A simultaneous moth flame optimizer feature selection approach based on levy flight and selection operators for medical diagnosis. Arab J Sci Eng, 1–26

  61. Cui Z, Hou X, Zhou H, Lian W, Wu J (2020) Modified slime mould algorithm via levy flight. In: 2020 13th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp 1109–1113. IEEE

  62. Iacca G (2021) An improved jaya optimization algorithm with levy flight. Expert Syst Appl 165:113902

    Article  Google Scholar 

  63. Liu Y, Cao B (2020) A novel ant colony optimization algorithm with levy flight. IEEE Access 8:67205–67213

    Article  Google Scholar 

  64. Zhang X, Xu Y, Yu C, Heidari AA, Li S, Chen H, Li C (2020) Gaussian mutational chaotic fruit fly-built optimization and feature selection. Expert Syst Appl 141:112976112976

    Article  Google Scholar 

  65. Abdel-Basset M, El-Shahat D, El-henawy I, de Albuquerque VH, Mirjalili S (2020) A new fusion of grey wolf optimizer algorithm with a two-phase mutation for feature selection. Expert Syst Appl 139:112824

    Article  Google Scholar 

  66. Yong Zhang, Dun-wei Gong, Xiao-yan Sun, Yi-nan Guo (2017) A pso-based multi-objective multi-label feature selection method in classification. Sci Rep 7(1):1–12

    Google Scholar 

  67. Chengming Qi, Zhangbing Zhou, Yunchuan Sun, Houbing Song, Lishuan Hu, Qun Wang (2017) Feature selection and multiple kernel boosting framework based on PSO with mutation mechanism for hyperspectral classification. Neurocomputing 220:181–190

    Article  Google Scholar 

  68. Zhang C, Ding S, Zhang J, Jia W (2021) Parallel stochastic configuration networks for large-scale data regression. Appl Soft Comput 103:107143

    Article  Google Scholar 

  69. Zhang C, Ding S (2021) A stochastic configuration network based on chaotic sparrow search algorithm. Knowl-Based Syst 220:106924

    Article  Google Scholar 

  70. Xia J, Zhengb L (2020) A hybrid algorithm based on cuckoo search and differential evolution for numerical optimization. Computing 4:1–8

    Google Scholar 

  71. Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82

    Article  Google Scholar 

  72. Macdonald SM, Mason CF (1973) Predation of migrant birds by gulls. British Birds 66:361–363

    Google Scholar 

  73. Chechkin AV, Ralf M, Joseph K, Gonchar VY et al (2008) Introduction to the theory of lévy flights. Anomal Transp 1:129

    Article  MATH  Google Scholar 

  74. Chegini SN, Bagheri A, Najafi F (2018) Psoscalf: A new hybrid PSO based on sine cosine algorithm and levy flight for solving optimization problems. Appl Soft Comput 73:697–726

  75. Xie J, Zhou Y, Chen H (2013) A novel bat algorithm based on differential operator and lévy flights trajectory. Comput Intell Neurosci

  76. Problem definitions and evaluation criteria for the cec 2017 special session and competition on single objective real-parameter numerical optimization

  77. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN’95-international conference on neural networks, vol 4, pp 1942–1948. IEEE

  78. Heidari AA, Mirjalili S, Faris H, Aljarah I, Mafarja M, Chen H (2019) Harris hawks optimization: algorithm and applications. Futur Gener Comput Syst 97:849–872

    Article  Google Scholar 

  79. Mitchell M (1998) An introduction to genetic algorithms. MIT press, Cambridge

    Book  MATH  Google Scholar 

  80. Ewees AA, Abd El Aziz M, Hassanien AE (2019) Chaotic multi-verse optimizer-based feature selection. Neural Comput Appl 31(4):991–1006

    Article  Google Scholar 

  81. Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76(2):60–68

    Article  Google Scholar 

  82. Wang Y, Li H-X, Huang T, Li L (2014) Differential evolution based on covariance matrix learning and bimodal distribution parameter setting. Appl Soft Comput 18:232–247

    Article  Google Scholar 

  83. Tanabe R, Fukunaga AS (2014) Improving the search performance of shade using linear population size reduction. In: 2014 IEEE congress on evolutionary computation (CEC), pp 1658–1665. IEEE

  84. Mohamed AW, Hadi AA, Fattouh AM, Jambi KM (2017) Lshade with semi-parameter adaptation hybrid with cma-es for solving cec 2017 benchmark problems. In: 2017 IEEE Congress on evolutionary computation (CEC), pp 145–152. IEEE

  85. Sahlol AT, Kollmannsberger P, Ewees AA (2020) Efficient classification of white blood cell leukemia with improved swarm optimization of deep features. Sci Rep 10(1):1–11

    Article  Google Scholar 

  86. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Article  Google Scholar 

  87. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61

    Article  Google Scholar 

  88. Cong L, Zhu X (2018) Unsupervised feature selection via local structure learning and sparse learning. Multimed Tools Appl 77(22):29605–29622

    Article  Google Scholar 

  89. Zhang H, Wang J, Sun Z, Zurada JM, Pal NR (2019) Feature selection for neural networks using group lasso regularization. IEEE Trans Knowl Data Eng 32(4):659–673

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of e-Systems, University of Bisha, Bisha, 61922, Saudi Arabia

    Ahmed A. Ewees

  2. Department of Computer, Damietta University, Damietta, Egypt

    Ahmed A. Ewees & Marwa A. Gaheen

  3. Information Systems Department, Faculty of Computers and Information Sciences, Mansoura University, Mansoura, 35516, Egypt

    Reham R. Mostafa

  4. Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh, 84428, Saudi Arabia

    Rania M. Ghoniem

  5. Department of Computer, Mansoura University, Mansoura, 35516, Egypt

    Rania M. Ghoniem

Authors
  1. Ahmed A. Ewees
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Reham R. Mostafa
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Rania M. Ghoniem
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Marwa A. Gaheen
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Ahmed A. Ewees.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ewees, A.A., Mostafa, R.R., Ghoniem, R.M. et al. Improved seagull optimization algorithm using Lévy flight and mutation operator for feature selection. Neural Comput & Applic 34, 7437–7472 (2022). https://doi.org/10.1007/s00521-021-06751-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-06751-8

Keywords