Skip to main content
Springer Nature Link
Log in

Hybrid binary whale with harris hawks for feature selection

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

A tremendous flow of big data has come from the growing use of digital technology and intelligent systems. This has resulted in an increase in not just the dimensional issues that big data encounters, but also the number of challenges that big data faces, including redundancies and useless features. As a result, feature selection is offered as a method for eliminating unwanted characteristics. This study introduces the BWOAHHO memetic technique, which combines the binary hybrid Whale Optimization Algorithm (WOA) with Harris Hawks Optimization (HHO). A transfer function to transfer continuous characteristics to binary to fulfill the feature selection nature condition. The efficiency of the selected attributes is assessed using a wrapper k-Nearest neighbor (KNN) Classifier. About 18 benchmark datasets obtained from UCI repository were utilized to measure the proposed method’s proficiency. The performance of the novel hybrid technique was evaluated by comparing to that of WOA, HHO, Particle Swarm Optimization (PSO), the Genetic Algorithm (GA), and the WOASAT-2. With the new hybrid feature selection method, the WOA algorithm’s efficiency was improved. Classification accuracy, average fitness, average selected attributes, and computational time were all used as performance indicators. In terms of accuracy, the proposed BWOHHO algorithm compared with 5 similar metaheuristic algorithms. The BWOAHHO had a classification accuracy of 92% in the 18 datasets, which was higher than BWOA (90%), BPSO (82%), and BGA (82%). (83%), the fitness measures of the BWOHHO algorithm are 0.08, which is lower than the average fitness of BWOA, BPSO, and BGA., in terms of selected attribute size compare the proposed BWOAHHO algorithm to the results obtained by the other five techniques The average selected feature sizes for BWOAHHO, BWOA, BHHO, BGA, and WOASAT-2 were 18.07, 20.12, 22.3, 22.32, 22.40, and 15.99, respectively, and computing time for the proposed BWOHHO was 7.36 in second which was the lowest computed value. To determine the significance of BWOAHHO, a statistical one-way ANOVA test was used. When compared to existing algorithms, the proposed approach produced better results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The data were taken from UCI public repository.

Code availability

Will be made available upon request.

References

  1. Xue B, Zhang M, Browne WN, Yao X (2016) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626. https://doi.org/10.1109/TEVC.2015.2504420

    Article  Google Scholar 

  2. Gou J, Xue Y, Ma H, Liu Y, Zhan Y, Ke J (2020) Double graphs-based discriminant projections for dimensionality reduction. Neur Comput Appl. https://doi.org/10.1007/s00521-020-04924-5

    Article  Google Scholar 

  3. Chen K, Zhou F-Y, Yuan X-F (2019) Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection. Expert Sys Appl. https://doi.org/10.1016/j.eswa.2019.03.039

    Article  Google Scholar 

  4. Bellman RE (2015) Adaptive control processes. Princeton University Press, New Jersey

    Google Scholar 

  5. Al-Wajih R, Abdulkadir SJ, Aziz N, Al-Tashi Q, Talpur N (2021) Hybrid binary grey wolf with harris hawks optimizer for feature selection. IEEE Access 9:31662–31677

    Article  Google Scholar 

  6. Dash M, Liu H (1997) Feature selection for classification. Intell Data Anal 1(1–4):131–156

    Article  Google Scholar 

  7. Heidari AA, Mirjalili S, Faris H, Aljarah I, Mafarja M, Chen H (2019) Harris hawks optimization: algorithm and applications. Future Generat Comp Sys. https://doi.org/10.1016/j.future.2019.02.028

    Article  Google Scholar 

  8. D. Karaboga (2005) "An idea based on honey bee swarm for numerical optimization,"

  9. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw. https://doi.org/10.1016/j.advengsoft.2013.12.007

    Article  Google Scholar 

  10. Panwar LK, Reddy S, Verma A, Panigrahi BK, Kumar R (2018) Binary grey wolf optimizer for large scale unit commitment problem. Swarm Evol Comput 38:251–266

    Article  Google Scholar 

  11. Mirjalili S (2015) The ant lion optimizer. Adv Eng Softw. https://doi.org/10.1016/j.advengsoft.2015.01.010

    Article  Google Scholar 

  12. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw. https://doi.org/10.1016/j.advengsoft.2016.01.008

    Article  Google Scholar 

  13. Thaher T, Heidari AA, Mafarja M, Dong JS, Mirjalili S (2020) Binary Harris Hawks optimizer for high-dimensional, low sample size feature selection. Evolutionary machine learning techniques. Springer, Berlin, pp 251–272

    Chapter  Google Scholar 

  14. Chandrashekar G, Sahin F (2014) A survey on feature selection methods. Comput Electr Eng. https://doi.org/10.1016/j.compeleceng.2013.11.024

    Article  Google Scholar 

  15. Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502

    Article  MathSciNet  Google Scholar 

  16. Muni DP, Pal NR, Das J (2006) “Genetic programming for simultaneous feature selection and classifier design,.” IEEE Trans Sys, Man, Cybernet Part B (Cybernetics) 36(1):106–117

    Article  Google Scholar 

  17. Lin J-Y, Ke H-R, Chien B-C, Yang W-P (2008) Classifier design with feature selection and feature extraction using layered genetic programming. Expert Syst Appl 34(2):1384–1393

    Article  Google Scholar 

  18. Talbi EG (2002) A taxonomy of hybrid metaheuristics. J Heurist. https://doi.org/10.1023/A:1016540724870

    Article  Google Scholar 

  19. Il-Seok O, Jin-Seon L, Byung-Ro M (2004) Hybrid genetic algorithms for feature selection. IEEE Trans Pattern Anal Mach Intell 26(11):1424–1437. https://doi.org/10.1109/TPAMI.2004.105

    Article  Google Scholar 

  20. Dong H, Li T, Ding R, Sun J (2018) A novel hybrid genetic algorithm with granular information for feature selection and optimization. Appl Soft Comput. https://doi.org/10.1016/j.asoc.2017.12.048

    Article  Google Scholar 

  21. Huang J, Cai Y, Xu X (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. Patt Recogn Lett. https://doi.org/10.1016/j.patrec.2007.05.011

    Article  Google Scholar 

  22. Liu X-Y, Liang Y, Wang S, Yang Z-Y, Ye H-S (2018) A hybrid genetic algorithm with wrapper-embedded approaches for feature selection. IEEE Access 6:22863–22874

    Article  Google Scholar 

  23. Huang C-L, Dun J-F (2008) A distributed PSO–SVM hybrid system with feature selection and parameter optimization. Appl Soft Comput. https://doi.org/10.1016/j.asoc.2007.10.007

    Article  Google Scholar 

  24. Abdel-Basset M, Ding W, El-Shahat D (2021) A hybrid Harris Hawks optimization algorithm with simulated annealing for feature selection. Artif Intell Rev 54(1):593–637

    Article  Google Scholar 

  25. Javidrad F, Nazari M, Javidrad HR (2018) Optimum stacking sequence design of laminates using a hybrid PSO-SA method. Comp Struct. https://doi.org/10.1016/j.compstruct.2017.11.074

    Article  Google Scholar 

  26. Eappen G, Shankar T (2020) Hybrid PSO-GSA for energy efficient spectrum sensing in cognitive radio network. Phys Commun. https://doi.org/10.1016/j.phycom.2020.101091

    Article  Google Scholar 

  27. Abdel-Basset M, El-Shahat D, El-henawy I, De Albuquerque Victor Hugo C., Mirjalili S (2020) A new fusion of grey wolf optimizer algorithm with a two-phase mutation for feature selection. Expert Sys Appl. https://doi.org/10.1016/j.eswa.2019.112824

    Article  Google Scholar 

  28. Mafarja M, Qasem A, Heidari AA, Aljarah I, Faris H, Mirjalili S (2020) Efficient hybrid nature-inspired binary optimizers for feature selection. Cogn Comput 12(1):150–175

    Article  Google Scholar 

  29. Mohammadzadeh H, Gharehchopogh FS (2021) A novel hybrid whale optimization algorithm with flower pollination algorithm for feature selection: Case study Email spam detection. Comput Intell 37(1):176–209

    Article  MathSciNet  Google Scholar 

  30. Got A, Moussaoui A, Zouache D (2021) Hybrid filter-wrapper feature selection using whale optimization algorithm: a multi-objective approach. Expert Sys Appl 183:115312

    Article  Google Scholar 

  31. Liu M, Yao X, Li Y (2020) Hybrid whale optimization algorithm enhanced with Lévy flight and differential evolution for job shop scheduling problems. Appl Soft Comput. https://doi.org/10.1016/j.asoc.2019.105954

    Article  Google Scholar 

  32. Hussain K, Neggaz N, Zhu W, Houssein EH (2021) An efficient hybrid sine-cosine Harris hawks optimization for low and high-dimensional feature selection. Expert Syst Appl 176:114778

    Article  Google Scholar 

  33. Houssein EH, Hosney ME, Elhoseny M, Oliva D, Mohamed WM, Hassaballah M (2020) Hybrid Harris hawks optimization with cuckoo search for drug design and discovery in chemoinformatics. Sci Rep 10(1):1–22

    Article  Google Scholar 

  34. Reddy KS, Panwar LK, Panigrahi B, Kumar R (2018) A new binary variant of sine–cosine algorithm: development and application to solve profit-based unit commitment problem. Arab J Sci Eng 43(8):4041–4056

    Article  Google Scholar 

  35. Yıldız AR, Yıldız BS, Sait SM, Bureerat S, Pholdee N (2019) A new hybrid Harris hawks-Nelder-Mead optimization algorithm for solving design and manufacturing problems. Mater Test 61(8):735–743. https://doi.org/10.3139/120.111378

    Article  Google Scholar 

  36. Barshandeh S, Piri F, Sangani SR (2020) HMPA: an innovative hybrid multi-population algorithm based on artificial ecosystem-based and Harris Hawks optimization algorithms for engineering problems. Eng Comput. https://doi.org/10.1007/s00366-020-01120-w

    Article  Google Scholar 

  37. Mafarja MM, Mirjalili S (2017) Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing. https://doi.org/10.1016/j.neucom.2017.04.053

    Article  Google Scholar 

  38. Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing. https://doi.org/10.1016/j.neucom.2016.03.101

    Article  Google Scholar 

  39. Chuang L-Y, Chang H-W, Tu C-J, Yang C-H (2008) Improved binary PSO for feature selection using gene expression data. Computat Biol Chem. https://doi.org/10.1016/j.compbiolchem.2007.09.005

    Article  MATH  Google Scholar 

  40. Gou J, Qiu W, Yi Z, Shen X, Zhan Y, Ou W (2019) Locality constrained representation-based K-nearest neighbor classification. Knowl-Based Sys. https://doi.org/10.1016/j.knosys.2019.01.016

    Article  Google Scholar 

  41. Gou J, Ma H, Ou W, Zeng S, Rao Y, Yang H (2019) A generalized mean distance-based k-nearest neighbor classifier. Expert Syst Appl 115:356–372

    Article  Google Scholar 

  42. Yesilbudak M, Sagiroglu S, Colak I (2017) A novel implementation of kNN classifier based on multi-tupled meteorological input data for wind power prediction. Energy Convers Manage. https://doi.org/10.1016/j.enconman.2016.12.094

    Article  Google Scholar 

  43. Asuncion A, Newman D (2007) "UCI machine learning repository," ed: Irvine, CA, USA

  44. Al-Tashi Q, Kadir SJA, Rais HM, Mirjalili S, Alhussian H (2019) Binary optimization using hybrid grey wolf optimization for feature selection. IEEE Access 7:39496–39508. https://doi.org/10.1109/ACCESS.2019.2906757

    Article  Google Scholar 

  45. Imandoust SB, Bolandraftar M (2013) Application of k-nearest neighbor (knn) approach for predicting economic events: theoretical background. Int J Eng Res Appl 3(5):605–610

    Google Scholar 

  46. Wang L, Khan L, Thuraisingham B (2008) "An effective evidence theory based k-nearest neighbor (knn) classification," In 2008 IEEE/WIC/ACM International conference on web intelligence and intelligent agent technology, 2008, vol. 1: IEEE, pp. 797–801

  47. Al-wajih R, Abdulakaddir SJ, Aziz NBA, Al-tashi Q (2020) "Binary Grey Wolf Optimizer with K-Nearest Neighbor classifier for Feature Selection," In 2020 International conference on computational intelligence (ICCI), 8–9 Oct. 2020 2020, pp. 130–136, doi: https://doi.org/10.1109/ICCI51257.2020.9247792

  48. Khanesar MA, Teshnehlab M, Shoorehdeli MA (2007) "A novel binary particle swarm optimization," In: 2007 Mediterranean conference on control & automation, IEEE, pp. 1–6

  49. Mafarja M, Aljarah I, Faris H, Hammouri AI, Ala’M A-Z, Mirjalili S (2019) Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Sys Appl 117:267–286

    Article  Google Scholar 

  50. Abdulrauf Sharifai G, Zainol Z (2020) "Feature selection for high-dimensional and imbalanced biomedical data based on robust correlation based redundancy and binary grasshopper optimization algorithm," Genes, vol. 11, no. 7, p. 717, 2020. [Online]. Available: https://www.mdpi.com/2073-4425/11/7/717

  51. Emary E, Zawbaa HM, Hassanien AE (2016) Binary grey wolf optimization approaches for feature selection. Neurocomputing 172:371–381

    Article  Google Scholar 

Download references

Acknowledgements

Research reported in this publication was supported by Fundamental Research Grant Project (FRGS) from the Ministry of Education Malaysia (FRGS/1/2018/ICT02/UTP/03/1) under UTP Grant No. 015MA0-013.

Author information

Authors and Affiliations

  1. Centre for Research in Data Science (CeRDaS), Computer Information Science Department, Universiti Teknologi PETRONAS, SeriIskandar, Perak, Malaysia

    Ranya Alwajih, Said Jadid Abdulkadir, Hitham Al Hussian, Norshakirah Aziz & Alawi Alqushaibi

  2. Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA

    Qasem Al-Tashi

  3. Faculty of Administrative and Computer Sciences, University of Albaydha, Albaydha, Yemen

    Qasem Al-Tashi

  4. Centre for Artificial Intelligence Research and Optimization, Torrens University Australia, Fortitude Valley, QLD, 4006, Australia

    Seyedali Mirjalili

  5. Yonsei Frontier Lab., Yonsei University, Seoul, Republic of Korea

    Seyedali Mirjalili

Authors
  1. Ranya Alwajih
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Said Jadid Abdulkadir
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Hitham Al Hussian
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Norshakirah Aziz
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Qasem Al-Tashi
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Seyedali Mirjalili
    View author publications

    You can also search for this author inPubMed Google Scholar

  7. Alawi Alqushaibi
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Said Jadid Abdulkadir.

Ethics declarations

Conflict of interest

The author declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alwajih, R., Abdulkadir, S.J., Al Hussian, H. et al. Hybrid binary whale with harris hawks for feature selection. Neural Comput & Applic 34, 19377–19395 (2022). https://doi.org/10.1007/s00521-022-07522-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07522-9

Keywords