Skip to main content

Advertisement

Springer Nature Link
Log in

Reinforced covariance weighted mean of vectors optimizer: insight, diversity, deep analysis and feature selection

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The WeIghted meaN oF vectOrs (INFO) algorithm is widely used as an efficient optimization tool due to its simple structure and superior performance. However, achieving a balance in solving complex high-dimensional problems is difficult and quickly falls into premature convergence or local optimality. To better balance the conflict between exploration and exploitation capabilities, a Q-learning Covariance weIghted meaN oF vectOrs Algorithm (QCINFOCMA) based on reinforcement learning is designed in this study to solve the global optimization problem. QCINFOCMA incorporates a covariance matrix adaptation evolution strategy and Cauchy mutation as a new exploration scheme. The Q-learning strategy in reinforcement learning is also integrated into the original INFO to achieve adaptive switching between the original local search and the new exploration scheme. This allows search agents to use rewards and penalties to select exploration methods without following established models or strategies. In this study, a comprehensive analysis is conducted, pitting QCINFOCMA against 10 heuristics and 9 state-of-the-art algorithms, utilizing the IEEE CEC 2017 test functions. The experimental results show that QCINFOCMA outperforms other advanced algorithms in terms of convergence speed and convergence accuracy. Subsequently, QCINFOCMA was subjected to a discretization process, effectively transforming it into a binary tool through the application of a specific transformation function. This binary tool was then employed to address the real-world challenge of feature selection across a cohort of 36 datasets obtained from the UCI machine learning library. Empirical findings demonstrate that QCINFOCMA attains superior classification accuracy and requires fewer features in comparison to alternative optimization algorithms. The proposed QCINFOCMA can be a novel optimization tool for implementing global optimization and wrapper-based feature selection tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Algorithm 2
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

We have declared the public nature of the data used in lines 1372-1388 of the paper. The data used in this study are from the publicly available UCI dataset.

References

  1. Hu J et al (2021) Chaotic diffusion-limited aggregation enhanced grey wolf optimizer: insights, analysis, binarization, and feature selection (Intelligent Systems, impact factor:8.709). Int J Intell Syst. https://aliasgharheidari.com

  2. Ren L et al (2022) Gaussian kernel probability-driven slime mould algorithm with new movement mechanism for multi-level image segmentation. Measurement 192:110884

    Google Scholar 

  3. Jati GK et al (2023) Discrete komodo algorithm for traveling salesman problem. Appl Soft Comput 139:110219

    Google Scholar 

  4. Shi S et al. (2022) Dynamic in vivo computation for learning-based nanobiosensing in time-varying biological landscapes. IEEE Trans Evol Comput

  5. Liu J et al (2015) A novel differential search algorithm and applications for structure design. Appl Math Comput 268:246–269

    Google Scholar 

  6. Xian S, Feng X (2023) Meerkat optimization algorithm: a new meta-heuristic optimization algorithm for solving constrained engineering problems. Expert Syst Appl:120482

  7. Liu J et al (2022) Dynamic multi-swarm differential learning Harris Hawks Optimizer and its application to optimal dispatch problem of cascade hydropower stations. Knowl-Based Syst 242:108281

    Google Scholar 

  8. Guan Z et al (2023) Great wall construction algorithm: a novel meta-heuristic algorithm for engineer problems. Expert Syst Appl 233:120905

    Google Scholar 

  9. Iliyasu AM et al (2023) Using particle swarm optimization and artificial intelligence to select the appropriate characteristics to determine volume fraction in two-phase flows. Fractal Fract 7(4):283

    Google Scholar 

  10. Heidari AA et al (2020) An enhanced associative learning-based exploratory whale optimizer for global optimization. Neural Comput Appl 32(9):5185–5211

    Google Scholar 

  11. Li S et al (2023) Hybrid method with parallel-factor theory, a support vector machine, and particle filter optimization for intelligent machinery failure identification. Machines 11(8):837

    Google Scholar 

  12. Afzal A et al (2023) Optimizing the thermal performance of solar energy devices using meta-heuristic algorithms: a critical review. Renew Sustain Energy Rev 173:112903

    Google Scholar 

  13. Mahdavi S, Shiri ME, Rahnamayan S (2015) Metaheuristics in large-scale global continues optimization: a survey. Inf Sci 295:407–428

    MathSciNet  Google Scholar 

  14. Hu R et al (2023) Analysis of the influence of population distribution characteristics on swarm intelligence optimization algorithms. Inf Sci 645:119340

    Google Scholar 

  15. Wang Y, Han X, Jin S (2022) MAP based modeling method and performance study of a task offloading scheme with time-correlated traffic and VM repair in MEC systems. Wirel Netw

  16. Xing J et al (2023) Boosting whale optimizer with quasi-oppositional learning and Gaussian Barebone for feature selection and COVID-19 image segmentation. J Bionic Eng 20(2):797–818

    Google Scholar 

  17. Yang X et al (2022) Boosted machine learning model for predicting intradialytic hypotension using serum biomarkers of nutrition. Comput Biol Med 147:105752

    Google Scholar 

  18. Chen J et al (2023) Renal pathology images segmentation based on improved cuckoo search with diffusion mechanism and adaptive Beta-Hill climbing. J Bionic Eng 20(5):2240–2275

    Google Scholar 

  19. Qi A et al (2022) Directional mutation and crossover boosted ant colony optimization with application to COVID-19 X-ray image segmentation. Comput Biol Med 148:105810

    Google Scholar 

  20. Dong R et al (2023) Boosting Kernel search optimizer with slime mould foraging behavior for combined economic emission dispatch problems. J Bionic Eng

  21. Dong R et al (2021) Boosted kernel search: framework, analysis and case studies on the economic emission dispatch problem. Knowl-Based Syst 233:107529

    Google Scholar 

  22. Deng W et al (2022) An enhanced fast non-dominated solution sorting genetic algorithm for multi-objective problems. Inf Sci 585:441–453

    Google Scholar 

  23. Hua Y et al (2021) A survey of evolutionary algorithms for multi-objective optimization problems with irregular Pareto fronts. IEEE/CAA J Autom Sin 8(2):303–318

    MathSciNet  Google Scholar 

  24. Wu S-H, Zhan Z-H, Zhang J (2021) SAFE: scale-adaptive fitness evaluation method for expensive optimization problems. IEEE Trans Evol Comput 25(3):478–491

    Google Scholar 

  25. Li J-Y et al (2020) Boosting data-driven evolutionary algorithm with localized data generation. IEEE Trans Evol Comput 24(5):923–937

    Google Scholar 

  26. Fan C et al (2019) Heronian mean operators of linguistic neutrosophic multisets and their multiple attribute decision-making methods. Int J Distrib Sens Netw 15(4):1550147719843059

    Google Scholar 

  27. Cui W-H, Ye J (2019) Logarithmic similarity measure of dynamic neutrosophic cubic sets and its application in medical diagnosis. Comput Ind 111:198–206

    Google Scholar 

  28. Fan C, Fan E, Hu K (2018) New form of single valued neutrosophic uncertain linguistic variables aggregation operators for decision-making. Cogn Syst Res 52:1045–1055

    Google Scholar 

  29. Ye J, Cui W (2020) Modeling and stability analysis methods of neutrosophic transfer functions. Soft Comput 24(12):9039–9048

    Google Scholar 

  30. Liu J et al (2022) Chaotic simulated annealing multi-verse optimization enhanced kernel extreme learning machine for medical diagnosis. Comput Biol Med 144:105356

    Google Scholar 

  31. Hu J et al (2022) Detection of COVID-19 severity using blood gas analysis parameters and Harris hawks optimized extreme learning machine. Comput Biol Med 142:105166

    Google Scholar 

  32. Li S et al (2020) Slime mould algorithm: a new method for stochastic optimization. Futur Gener Comput Syst 111:300–323

    Google Scholar 

  33. Dhiman G, Kumar V (2019) Seagull optimization algorithm: theory and its applications for large-scale industrial engineering problems. Knowl-Based Syst 165:169–196

    Google Scholar 

  34. Moosavi SHS, Bardsiri VK (2019) Poor and rich optimization algorithm: a new human-based and multi populations algorithm. Eng Appl Artif Intell 86:165–181

    Google Scholar 

  35. Abdullah JM, Ahmed T (2019) Fitness dependent optimizer: inspired by the bee swarming reproductive process. IEEE Access 7:43473–43486

    Google Scholar 

  36. Yadav A (2019) AEFA: artificial electric field algorithm for global optimization. Swarm Evol Comput 48:93–108

    Google Scholar 

  37. Askari Q, Younas I, Saeed M (2020) Political optimizer: a novel socio-inspired meta-heuristic for global optimization. Knowl-Based Syst 195:105709

    Google Scholar 

  38. Yang Y et al (2021) Hunger games search: visions, conception, implementation, deep analysis, perspectives, and towards performance shifts. Expert Syst Appl 177:114864

    Google Scholar 

  39. Tu J et al (2021) The colony predation algorithm. J Bionic Eng 18(3):674–710

    Google Scholar 

  40. Heidari AA et al (2019) Harris hawks optimization: algorithm and applications. Futur Gener Comput Syst 97:849–872

    Google Scholar 

  41. Ahmadianfar I et al (2021) RUN beyond the metaphor: an efficient optimization algorithm based on Runge Kutta method. Expert Syst Appl 181:115079

    Google Scholar 

  42. Yang X et al (2022) An optimized machine learning framework for predicting intradialytic hypotension using indexes of chronic kidney disease-mineral and bone disorders. Comput Biol Med 145:105510

    Google Scholar 

  43. Han Y et al (2023) Multi-verse optimizer with rosenbrock and diffusion mechanisms for multilevel threshold image segmentation from COVID-19 chest X-ray images. J Bionic Eng 20(3):1198–1262

    Google Scholar 

  44. Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82

    Google Scholar 

  45. Xu B et al (2023) Dimensional decision covariance colony predation algorithm: global optimization and high− dimensional feature selection. Artif Intell Rev:1–57

  46. Ye T et al (2024) An improved two-archive artificial bee colony algorithm for many-objective optimization. Expert Syst Appl 236:121281

    Google Scholar 

  47. Al-Qaness MA et al (2020) Optimized forecasting method for weekly influenza confirmed cases. Int J Environ Res Public Health 17(10):3510

    Google Scholar 

  48. Yimit A, Iigura K, Hagihara Y (2020) Refined selfish herd optimizer for global optimization problems. Expert Syst Appl 139:112838

    Google Scholar 

  49. Jia H et al (2019) Masi entropy for satellite color image segmentation using tournament-based lévy multiverse optimization algorithm. Remote Sens 11(8):942

    Google Scholar 

  50. Chen H et al (2019) A balanced whale optimization algorithm for constrained engineering design problems. Appl Math Model 71:45–59

    MathSciNet  Google Scholar 

  51. Raed M et al (2023) A novel improved lemurs optimization algorithm for feature selection problems. J King Saud Univ-Comput Inf Sci 35(8):101704

    Google Scholar 

  52. Awadallah MA et al (2020) Island artificial bee colony for global optimization. Soft Comput 24(17):13461–13487

    Google Scholar 

  53. Singh Chawda G et al (2020) Incremental conductance based particle swarm optimization algorithm for global maximum power tracking of solar-pv under nonuniform operating conditions. Appl Sci 10(13):4575

    Google Scholar 

  54. Tiwari A, Chaturvedi A (2022) A hybrid feature selection approach based on information theory and dynamic butterfly optimization algorithm for data classification. Expert Syst Appl 196:116621

    Google Scholar 

  55. Ahmadianfar I et al (2022) INFO: an efficient optimization algorithm based on weighted mean of vectors. Expert Syst Appl:116516

  56. Mohamed AW, Hadi AA, Jambi KM (2019) Novel mutation strategy for enhancing SHADE and LSHADE algorithms for global numerical optimization. Swarm Evol Comput 50:100455

    Google Scholar 

  57. Mohamed AW et al (2017) LSHADE with semi-parameter adaptation hybrid with CMA-ES for solving CEC 2017 benchmark problems. In: 2017 IEEE Congress on evolutionary computation (CEC). IEEE

  58. Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958

    Google Scholar 

  59. Qin AK, Huang VL, Suganthan PN (2008) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417

    Google Scholar 

  60. Jia D, Zheng G, Khan MK (2011) An effective memetic differential evolution algorithm based on chaotic local search. Inf Sci 181(15):3175–3187

    Google Scholar 

  61. Chen W-N et al (2012) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 17(2):241–258

    Google Scholar 

  62. Liang JJ et al (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295

    Google Scholar 

  63. Chen H et al (2020) Advanced orthogonal learning-driven multi-swarm sine cosine optimization: framework and case studies. Expert Syst Appl 144:113113

    Google Scholar 

  64. García-Martínez C et al (2008) Global and local real-coded genetic algorithms based on parent-centric crossover operators. Eur J Oper Res 185(3):1088–1113

    Google Scholar 

  65. Cai X et al (2019) An efficient surrogate-assisted particle swarm optimization algorithm for high-dimensional expensive problems. Knowl-Based Syst 184:104901

    Google Scholar 

  66. Mesejo P et al (2016) A survey on image segmentation using metaheuristic-based deformable models: state of the art and critical analysis. Appl Soft Comput 44:1–29

    Google Scholar 

  67. Jang S, Yoo S, Kang N (2022) Generative design by reinforcement learning: enhancing the diversity of topology optimization designs. Comput Aided Des 146:103225

    MathSciNet  Google Scholar 

  68. Drugan MM (2019) Reinforcement learning versus evolutionary computation: a survey on hybrid algorithms. Swarm Evol Comput 44:228–246

    Google Scholar 

  69. Anas H, Ong WH, Malik OA (2022) Comparison of deep Q-learning, Q-learning and SARSA reinforced learning for robot local navigation. In: International conference on robot intelligence technology and applications. Springer

  70. Beyer H-G, Schwefel H-P (2002) Evolution strategies–a comprehensive introduction. Nat Comput 1(1):3–52

    MathSciNet  Google Scholar 

  71. Salgotra R, Singh U (2017) Application of mutation operators to flower pollination algorithm. Expert Syst Appl 79:112–129

    Google Scholar 

  72. Deng L et al (2022) Differential evolution with dynamic combination based mutation operator and two-level parameter adaptation strategy. Expert Syst Appl 192:116298

    Google Scholar 

  73. Guan Z et al (2019) MFQE 2.0: a new approach for multi-frame quality enhancement on compressed video. IEEE Trans Pattern Anal Mach Intell 43(3):949–963

    MathSciNet  Google Scholar 

  74. Garcia S et al (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf Sci 180(10):2044–2064

    Google Scholar 

  75. Derrac J et al (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Google Scholar 

  76. Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359

    MathSciNet  Google Scholar 

  77. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN'95-international conference on neural networks. IEEE

  78. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Google Scholar 

  79. Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowl-Based Syst 89:228–249

    Google Scholar 

  80. Yang X-S (2009) Firefly algorithms for multimodal optimization. In: International symposium on stochastic algorithms. Springer

  81. Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248

    Google Scholar 

  82. Mirjalili S (2016) SCA: a sine cosine algorithm for solving optimization problems. Knowl-Based Syst 96:120–133

    Google Scholar 

  83. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61

    Google Scholar 

  84. Van den Bergh F, Engelbrecht AP (2006) A study of particle swarm optimization particle trajectories. Inf Sci 176(8):937–971

    MathSciNet  Google Scholar 

  85. Eddaly M et al (2016) Combinatorial particle swarm optimization for solving blocking flowshop scheduling problem. J Comput Des Eng 3(4):295–311

    Google Scholar 

  86. Hu K et al (2017) A novel object tracking algorithm by fusing color and depth information based on single valued neutrosophic cross-entropy. J Intell Fuzzy Syst 32(3):1775–1786

    Google Scholar 

  87. Liang Z et al (2019) A hybrid of genetic transform and hyper-rectangle search strategies for evolutionary multi-tasking. Expert Syst Appl 138:112798

    Google Scholar 

  88. Zhang H et al (2022) Differential evolution-assisted salp swarm algorithm with chaotic structure for real-world problems. Eng Comput

  89. Qiao K et al (2022) Self-adaptive resources allocation-based differential evolution for constrained evolutionary optimization. Knowl-Based Syst 235:107653

    Google Scholar 

  90. Liang J et al (2021) Differential evolution with rankings-based fitness function for constrained optimization problems. Appl Soft Comput 113:108016

    Google Scholar 

  91. Yu H et al (2022) Apple leaf disease recognition method with improved residual network. Multimed Tools Appl

  92. Liu X et al (2023) Adapting feature selection algorithms for the classification of Chinese texts. Systems 11(9):483

    Google Scholar 

  93. Lu S et al (2023) Multiscale feature extraction and fusion of image and text in VQA. Int J Comput Intell Syst 16(1):54

    Google Scholar 

  94. Zuo C et al (2017) High-resolution transport-of-intensity quantitative phase microscopy with annular illumination. Sci Rep 7(1):1–22

    Google Scholar 

  95. Reddy KS et al (2016) Binary fireworks algorithm for profit based unit commitment (PBUC) problem. Int J Electr Power Energy Syst 83:270–282

    Google Scholar 

  96. Mafarja M et al (2018) Binary dragonfly optimization for feature selection using time-varying transfer functions. Knowl-Based Syst 161:185–204

    Google Scholar 

  97. Zhang Y et al (2019) Cost-sensitive feature selection using two-archive multi-objective artificial bee colony algorithm. Expert Syst Appl 137:46–58

    Google Scholar 

  98. Jadhav S, He H, Jenkins K (2018) Information gain directed genetic algorithm wrapper feature selection for credit rating. Appl Soft Comput 69:541–553

    Google Scholar 

  99. Chang S, Shihong Y, Qi L (2020) Clustering characteristics of UCI dataset. In: 2020 39th Chinese Control Conference (CCC). IEEE

  100. Tumar I et al (2020) Enhanced binary moth flame optimization as a feature selection algorithm to predict software fault prediction. IEEE Access 8:8041–8055

    Google Scholar 

  101. Mirjalili S, Lewis A (2013) S-shaped versus V-shaped transfer functions for binary particle swarm optimization. Swarm Evol Comput 9:1–14

    Google Scholar 

  102. Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65

    Google Scholar 

  103. Mirjalili S, Mirjalili SM, Yang X-S (2014) Binary bat algorithm. Neural Comput Appl 25(3–4):663–681

    Google Scholar 

  104. Faris H et al (2018) An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems. Knowl-Based Syst 154:43–67

    Google Scholar 

  105. Mafarja M, Mirjalili S (2018) Whale optimization approaches for wrapper feature selection. Appl Soft Comput 62:441–453

    Google Scholar 

  106. Rashedi E, Nezamabadi-Pour H, Saryazdi S (2010) BGSA: Binary gravitational search algorithm. Nat Comput 9(3):727–745

    MathSciNet  Google Scholar 

  107. Li Y et al (2019) Epileptic seizure detection in EEG signals using sparse multiscale radial basis function networks and the Fisher vector approach. Knowl-Based Syst 164:96–106

    Google Scholar 

  108. Sun Y, Yen GG, Yi Z (2019) IGD indicator-based evolutionary algorithm for many-objective optimization problems. IEEE Trans Evol Comput 23(2):173–187

    Google Scholar 

  109. Chen H et al (2019) An opposition-based sine cosine approach with local search for parameter estimation of photovoltaic models. Energy Convers Manage 195:927–942

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (62076185, U1809209).

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou, 325035, China

    Boyang Xu & Huiling Chen

  2. School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran, Iran

    Ali Asghar Heidari

Authors
  1. Boyang Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ali Asghar Heidari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huiling Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huiling Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, B., Heidari, A.A. & Chen, H. Reinforced covariance weighted mean of vectors optimizer: insight, diversity, deep analysis and feature selection. Appl Intell 54, 3351–3402 (2024). https://doi.org/10.1007/s10489-023-05261-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-023-05261-5

Keywords

Search

Navigation