Skip to main content

Advertisement

Springer Nature Link
Log in

Heterogeneous cognitive learning chameleon swarm algorithm for high-dimensional feature selection

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

High-dimensional feature selection problems (HFSPs) are becoming more prevalent but complex. Currently used feature selection (FS) techniques for problems like biological and medical data often struggle due to the complexity of the problems they face. To adeptly address this kind of problem, a new binary form of the chameleon swarm algorithm (BCSA) called binary heterogeneous cognitive learning CSA (BHCLCSA) is proposed. In BHCLCSA, chameleons are specifically divided during optimization into topmost chameleons (\(\text {TC}\)) and undermost chameleons (\(\text {UC}\)) as per their fitness. These two types of chameleons are addressed variously by creating an elite cognitive learning (CL) mechanism to evolve the undermost chameleons and a predominant CL mechanism to mature the topmost ones. With the collaboration between these two learning strategies, BHCLCSA is expected to evolve chameleons capable of efficiently exploring the search space and exploiting the discovered optimal regions to obtain the best solutions for HFSPs. Further, this work develops adaptive and dynamic swarm partition mechanisms to adaptively segregate chameleons into two categories. HCLCSA is used in FS domain to confront premature convergence, locate the best subset of features between classes, and improve the CSA’s global and local search capabilities. The BHCLCSA-based FS method was evaluated, using the k-nearest neighbor (k-NN) classifier, on 20 HFSPs collected from the UCI repository. The results showed that BHCLCSA performed substantially better than several other widely recognized FS methods. Notably, it excelled many others in 10 datasets concerning classification accuracy, 13 datasets concerning F1-score, 7 datasets concerning the number of selected features, and 4 datasets concerning fitness values out of the 20 datasets considered. Simply put, the results on 5 and 8 datasets showed that BHCLCSA performed at performance levels exceeding 90% for F1-score and classification accuracy metrics, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Algorithm 2
Algorithm 3
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

Data will be available on a reasonable request.

References

  1. Javaid M, Haleem A, Singh RP, Suman R, Rab S (2022) Significance of machine learning in healthcare: features, pillars and applications. Int J Intell Netw 3:58–73

    Google Scholar 

  2. Hemdan EE-D, El-Shafai W, Sayed A (2023) Cr19: a framework for preliminary detection of covid-19 in cough audio signals using machine learning algorithms for automated medical diagnosis applications. J Ambient Intell Humaniz Comput 14(9):11715–11727

    Article  MATH  Google Scholar 

  3. Nanath K, Olney L (2023) An investigation of crowdsourcing methods in enhancing the machine learning approach for detecting online recruitment fraud. Int J Inf Manag Data Insights 3(1):100167

    MATH  Google Scholar 

  4. Sheta A, Thaher T, Surani SR, Turabieh H, Braik M, Too J, Abu-El-Rub N, Mafarjah M, Chantar H, Subramanian S (2023) Diagnosis of obstructive sleep apnea using feature selection, classification methods, and data grouping based age, sex, and race. Diagnostics 13(14):2417

    Article  Google Scholar 

  5. Braik MS, Hammouri AI, Awadallah MA, Al-Betar MA, Khtatneh K (2023) An improved hybrid chameleon swarm algorithm for feature selection in medical diagnosis. Biomed Signal Process Control 85:105073

    Article  Google Scholar 

  6. Braik M, Hammouri A, Alzoubi H, Sheta A (2024) Feature selection based nature inspired capuchin search algorithm for solving classification problems. Expert Syst Appl 235:121128

    Article  MATH  Google Scholar 

  7. Braik M (2023) Enhanced ali baba and the forty thieves algorithm for feature selection. Neural Comput Appl 35(8):6153–6184

    Article  MATH  Google Scholar 

  8. Zhu Y, Li W, Li T (2023) A hybrid artificial immune optimization for high-dimensional feature selection. Knowl-Based Syst 260:110111

    Article  MATH  Google Scholar 

  9. Braik M, Awadallah MA, Al-Betar MA, Hammouri AI, Alzubi OA (2023) Cognitively enhanced versions of capuchin search algorithm for feature selection in medical diagnosis: a covid-19 case study. Cogn Comput 1–38

  10. Al-Betar MA, Braik MS, Mohamed EA, Awadallah MA, Nasor M (2024) Augmented electric eel foraging optimization algorithm for feature selection with high-dimensional biological and medical diagnosis. Neural Comput Appl 36(35):22171–22221

    Article  Google Scholar 

  11. Vommi AM, Battula TK (2023) A hybrid filter-wrapper feature selection using fuzzy knn based on bonferroni mean for medical datasets classification: a covid-19 case study. Expert Syst Appl 218:119612

    Article  MATH  Google Scholar 

  12. Cilia ND, D’Alessandro T, De Stefano C, Fontanella F, di Freca AS (2023) Comparing filter and wrapper approaches for feature selection in handwritten character recognition. Pattern Recognit Lett 168:39–46

    Article  Google Scholar 

  13. Hu Y, Zhang Y, Gao X, Gong D, Song X, Guo Y, Wang J (2023) A federated feature selection algorithm based on particle swarm optimization under privacy protection. Knowl-Based Syst 260:110122

    Article  MATH  Google Scholar 

  14. Mostafa RR, Gaheen MA, ElAziz MA, Al-Betar MA, Ewees AA (2023) An improved gorilla troops optimizer for global optimization problems and feature selection. Knowl-Based Syst 269:110462

    Article  MATH  Google Scholar 

  15. Karimi F, Dowlatshahi MB, Hashemi A (2023) Semiaco: a semi-supervised feature selection based on ant colony optimization. Expert Syst Appl 214:119130

    Article  MATH  Google Scholar 

  16. Braik M, Ryalat MH, Al-Zoubi H (2022) A novel meta-heuristic algorithm for solving numerical optimization problems: Ali baba and the forty thieves. Neural Comput Appl 34(1):409–455

    Article  MATH  Google Scholar 

  17. Braik M, Sheta A, Al-Hiary H (2021) A novel meta-heuristic search algorithm for solving optimization problems: capuchin search algorithm. Neural Comput Appl 33:2515–2547

    Article  MATH  Google Scholar 

  18. Braik M, Hammouri A, Atwan J, Al-Betar MA, Awadallah MA (2022) White shark optimizer: a novel bio-inspired meta-heuristic algorithm for global optimization problems. Knowl-Based Syst 243:108457

    Article  Google Scholar 

  19. Braik MS (2021) Chameleon swarm algorithm: a bio-inspired optimizer for solving engineering design problems. Expert Syst Appl 174:114685

    Article  MATH  Google Scholar 

  20. Mostafa RR, Ewees AA, Ghoniem RM, Abualigah L, Hashim FA (2022) Boosting chameleon swarm algorithm with consumption aeo operator for global optimization and feature selection. Knowl-Based Syst 246:108743

    Article  Google Scholar 

  21. Hu G, Yang R, Qin X, Wei G (2023) Mcsa: multi-strategy boosted chameleon-inspired optimization algorithm for engineering applications. Comput Methods Appl Mech Eng 403:115676

    Article  MathSciNet  MATH  Google Scholar 

  22. Umamageswari A, Bharathiraja N, Irene DS (2021) A novel fuzzy c-means based chameleon swarm algorithm for segmentation and progressive neural architecture search for plant disease classification. ICT Express

  23. Braik MS (2023) Modified chameleon swarm algorithm for brightness and contrast enhancement of satellite images. Multimed Tools Appl 1–52

  24. Xue B, Zhang M, Browne WN, Yao X (2016) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626

    Article  MATH  Google Scholar 

  25. Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowl-Based Syst 89:228–249

    Article  MATH  Google Scholar 

  26. Zhou Y, Zhang W, Kang J, Zhang X, Wang X (2021) A problem-specific non-dominated sorting genetic algorithm for supervised feature selection. Inf Sci 547:841–859

    Article  MathSciNet  MATH  Google Scholar 

  27. Zhou Y, Kang J, Sam K, Wang X, Zhang Q (2021) An evolutionary multi-objective optimization framework of discretization-based feature selection for classification. Swarm Evol Comput 60:100770

    Article  MATH  Google Scholar 

  28. Zhou Y, Kang J, Guo H (2020) Many-objective optimization of feature selection based on two-level particle cooperation. Inf Sci 532:91–109

    Article  MathSciNet  MATH  Google Scholar 

  29. Zhou Y, Qiu Y, Kwong S (2022) Region purity-based local feature selection: a multiobjective perspective. IEEE Trans Evol Comput 27(4):787–801

    Article  MATH  Google Scholar 

  30. Zhou Y, Gao L, Wang D, Wu W, Zhou Z, Ye T (2023) Imbalanced multi-fault diagnosis via improved localized feature selection. IEEE Trans Instrum Meas

  31. Zhou Y, Lin J, Guo H (2021) Feature subset selection via an improved discretization-based particle swarm optimization. Appl Soft Comput 98:106794

    Article  MATH  Google Scholar 

  32. Tuo S, Jiang J (2024) A novel detection method for high-order snp epistatic interactions based on explicit-encoding-based multitasking harmony search. Interdiscip Sci Comput Life Sci 16(3):688–711

    MATH  Google Scholar 

  33. Tuo S, Li C, Liu F, Li A, He L, Geem ZW, Shang J, Liu H, Zhu Y, Feng Z et al (2023) Mthsa-dhei: multitasking harmony search algorithm for detecting high-order snp epistatic interactions. Complex Intell Syst 9(1):637–658

    Article  MATH  Google Scholar 

  34. Tuo S, Li C, Liu F, Zhu Y, Chen T, Feng Z, Liu H, Li A (2022) A novel multitasking ant colony optimization method for detecting multiorder snp interactions. Interdiscip Sci Comput Life Sci 14(4):814–832

    Article  MATH  Google Scholar 

  35. Li Z (2023) A local opposition-learning golden-sine grey wolf optimization algorithm for feature selection in data classification. Appl Soft Comput 142:110319

    Article  MATH  Google Scholar 

  36. Gupta S, Deep K, Moayedi H, Foong LK, Assad A (2021) Sine cosine grey wolf optimizer to solve engineering design problems. Eng Comput 37:3123–3149

    Article  Google Scholar 

  37. Yang Z (2024) Competing leaders grey wolf optimizer and its application for training multi-layer perceptron classifier. Expert Syst Appl 239:122349

    Article  Google Scholar 

  38. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN’95-International Conference on Neural Networks, vol 4. IEEE, pp 1942–1948

  39. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61

    Article  MATH  Google Scholar 

  40. Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82

    Article  MATH  Google Scholar 

  41. Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175–185

    Article  MathSciNet  MATH  Google Scholar 

  42. Bishop CM et al (1995) Neural networks for pattern recognition. Oxford University Press

    Book  MATH  Google Scholar 

  43. Russell SJ, Norvig P (2003) Instructor’s solution manual for artificial intelligence: a modern approach

  44. Ding S, Zhang X, An Y, Xue Y (2017) Weighted linear loss multiple birth support vector machine based on information granulation for multi-class classification. Pattern Recognit 67:32–46

    Article  MATH  Google Scholar 

  45. Rokach L (2016) Decision forest: twenty years of research. Inf Fusion 27:111–125

    Article  MATH  Google Scholar 

  46. Allam M, Nandhini M (2022) Optimal feature selection using binary teaching learning based optimization algorithm. J King Saud Univ Comput Inf Sci 34(2):329–341

    Article  MATH  Google Scholar 

  47. Denoeux T (2008) A k-nearest neighbor classification rule based on dempster-shafer theory. Classic works of the Dempster-Shafer theory of belief functions, pp 737–760

  48. Qin Z, Wang AT, Zhang C, Zhang S (2023) Cost-sensitive classification with k-nearest neighbors. In: Knowledge Science, Engineering and Management: 6th International Conference, KSEM 2013, Dalian, China, August 10-12, 2013. Proceedings 6. Springer, pp 112–131

  49. Shakhnarovich G, Darrell T, Indyk P (2008) Nearest-neighbor methods in learning and vision. IEEE Trans Neural Netw 19(2):377

    Article  MATH  Google Scholar 

  50. Abdel-Salam M, Chhabra A, Braik M, Gharehchopogh FS, Bacanin N (2025) A halton enhanced solution-based human evolutionary algorithm for complex optimization and advanced feature selection problems. Knowl Based Syst 113062

  51. Asuncion A, Newman D (2007) Uci machine learning repository

  52. Liu J, Sheng Y, Lan W, Guo R, Wang Y, Wang J (2020) Improved asd classification using dynamic functional connectivity and multi-task feature selection. Pattern Recognit Lett 138:82–87

    Article  MATH  Google Scholar 

  53. Simon D (2008) Biogeography-based optimization. IEEE Trans Evol Comput 12(6):702–713

    Article  MATH  Google Scholar 

  54. Shreem SS, Turabieh H, Azwari SA, Baothman F (2022) Enhanced binary genetic algorithm as a feature selection to predict student performance. Soft Comput 26(4):1811–1823

    Article  Google Scholar 

  55. Venkata Rao R, Savsani VJ, Vakharia DP (2012) Teaching-learning-based optimization: an optimization method for continuous non-linear large scale problems. Inf Sci 183(1):1–15

    Article  MathSciNet  MATH  Google Scholar 

  56. Viktorin A, Pluhacek M, Senkerik R (2016) Success-history based adaptive differential evolution algorithm with multi-chaotic framework for parent selection performance on cec2014 benchmark set. In: 2016 IEEE Congress on Evolutionary Computation (CEC). IEEE, pp 4797–4803

  57. Jain M, Singh V, Rani A (2019) A novel nature-inspired algorithm for optimization: squirrel search algorithm. Swarm Evol Comput 44:148–175

    Article  MATH  Google Scholar 

  58. Ziyu T, Dingxue Z, (2009) A modified particle swarm optimization with an adaptive acceleration coefficients. In: 2009 Asia-Pacific Conference on Information Processing, vol 2. IEEE, pp 330–332

  59. Khishe M, Mosavi MR (2020) Chimp optimization algorithm. Expert Syst Appl 149:113338

    Article  Google Scholar 

  60. Hashim FA, Houssein EH, Hussain K, Mabrouk MS, Al-Atabany W (2022) Honey badger algorithm: new metaheuristic algorithm for solving optimization problems. Math Comput Simul 192:84–110

    Article  MathSciNet  MATH  Google Scholar 

  61. Qtaish A, Braik M, Albashish D, Alshammari MT, Alreshidi A, Alreshidi EJ (2024) Enhanced coati optimization algorithm using elite opposition-based learning and adaptive search mechanism for feature selection. Int J Mach Learn Cybern 1–34

  62. Venkata Lakshmi S, Edwin Prabakaran T (2014) Application of k-nearest neighbour classification method for intrusion detection in network data. Int J Comput Appl 97(7)

  63. Kausar N, Samir BB, Abdullah A, Ahmad I, Hussain M (2011) A review of classification approaches using support vector machine in intrusion detection. In: International Conference on Informatics Engineering and Information Science. Springer, pp 24–34

  64. Farahani G (2020) Feature selection based on cross-correlation for the intrusion detection system. Secur Commun Netw 2020

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Al-Balqa Applied University, Salt, Jordan

    Malik Braik & Heba Al-Hiary

  2. Department of Computer Science, Al-Aqsa University, Gaza, Palestine

    Mohammed A. Awadallah

  3. Artificial Intelligence Research Center (AIRC), Ajman University, Ajman, United Arab Emirates

    Mohammed A. Awadallah

  4. Computer Engineering Department, Yarmouk University, Irbid, Jordan

    Hussein Alzoubi

Authors
  1. Malik Braik
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Mohammed A. Awadallah
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Hussein Alzoubi
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Heba Al-Hiary
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Malik Braik.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

None.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file 1 (rar 78177 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Braik, M., Awadallah, M.A., Alzoubi, H. et al. Heterogeneous cognitive learning chameleon swarm algorithm for high-dimensional feature selection. J Supercomput 81, 652 (2025). https://doi.org/10.1007/s11227-025-07139-4

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11227-025-07139-4

Keywords