Abstract
The WeIghted meaN oF vectOrs (INFO) algorithm is widely used as an efficient optimization tool due to its simple structure and superior performance. However, achieving a balance in solving complex high-dimensional problems is difficult and quickly falls into premature convergence or local optimality. To better balance the conflict between exploration and exploitation capabilities, a Q-learning Covariance weIghted meaN oF vectOrs Algorithm (QCINFOCMA) based on reinforcement learning is designed in this study to solve the global optimization problem. QCINFOCMA incorporates a covariance matrix adaptation evolution strategy and Cauchy mutation as a new exploration scheme. The Q-learning strategy in reinforcement learning is also integrated into the original INFO to achieve adaptive switching between the original local search and the new exploration scheme. This allows search agents to use rewards and penalties to select exploration methods without following established models or strategies. In this study, a comprehensive analysis is conducted, pitting QCINFOCMA against 10 heuristics and 9 state-of-the-art algorithms, utilizing the IEEE CEC 2017 test functions. The experimental results show that QCINFOCMA outperforms other advanced algorithms in terms of convergence speed and convergence accuracy. Subsequently, QCINFOCMA was subjected to a discretization process, effectively transforming it into a binary tool through the application of a specific transformation function. This binary tool was then employed to address the real-world challenge of feature selection across a cohort of 36 datasets obtained from the UCI machine learning library. Empirical findings demonstrate that QCINFOCMA attains superior classification accuracy and requires fewer features in comparison to alternative optimization algorithms. The proposed QCINFOCMA can be a novel optimization tool for implementing global optimization and wrapper-based feature selection tasks.
















Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
We have declared the public nature of the data used in lines 1372-1388 of the paper. The data used in this study are from the publicly available UCI dataset.
References
Hu J et al (2021) Chaotic diffusion-limited aggregation enhanced grey wolf optimizer: insights, analysis, binarization, and feature selection (Intelligent Systems, impact factor:8.709). Int J Intell Syst. https://aliasgharheidari.com
Ren L et al (2022) Gaussian kernel probability-driven slime mould algorithm with new movement mechanism for multi-level image segmentation. Measurement 192:110884
Jati GK et al (2023) Discrete komodo algorithm for traveling salesman problem. Appl Soft Comput 139:110219
Shi S et al. (2022) Dynamic in vivo computation for learning-based nanobiosensing in time-varying biological landscapes. IEEE Trans Evol Comput
Liu J et al (2015) A novel differential search algorithm and applications for structure design. Appl Math Comput 268:246–269
Xian S, Feng X (2023) Meerkat optimization algorithm: a new meta-heuristic optimization algorithm for solving constrained engineering problems. Expert Syst Appl:120482
Liu J et al (2022) Dynamic multi-swarm differential learning Harris Hawks Optimizer and its application to optimal dispatch problem of cascade hydropower stations. Knowl-Based Syst 242:108281
Guan Z et al (2023) Great wall construction algorithm: a novel meta-heuristic algorithm for engineer problems. Expert Syst Appl 233:120905
Iliyasu AM et al (2023) Using particle swarm optimization and artificial intelligence to select the appropriate characteristics to determine volume fraction in two-phase flows. Fractal Fract 7(4):283
Heidari AA et al (2020) An enhanced associative learning-based exploratory whale optimizer for global optimization. Neural Comput Appl 32(9):5185–5211
Li S et al (2023) Hybrid method with parallel-factor theory, a support vector machine, and particle filter optimization for intelligent machinery failure identification. Machines 11(8):837
Afzal A et al (2023) Optimizing the thermal performance of solar energy devices using meta-heuristic algorithms: a critical review. Renew Sustain Energy Rev 173:112903
Mahdavi S, Shiri ME, Rahnamayan S (2015) Metaheuristics in large-scale global continues optimization: a survey. Inf Sci 295:407–428
Hu R et al (2023) Analysis of the influence of population distribution characteristics on swarm intelligence optimization algorithms. Inf Sci 645:119340
Wang Y, Han X, Jin S (2022) MAP based modeling method and performance study of a task offloading scheme with time-correlated traffic and VM repair in MEC systems. Wirel Netw
Xing J et al (2023) Boosting whale optimizer with quasi-oppositional learning and Gaussian Barebone for feature selection and COVID-19 image segmentation. J Bionic Eng 20(2):797–818
Yang X et al (2022) Boosted machine learning model for predicting intradialytic hypotension using serum biomarkers of nutrition. Comput Biol Med 147:105752
Chen J et al (2023) Renal pathology images segmentation based on improved cuckoo search with diffusion mechanism and adaptive Beta-Hill climbing. J Bionic Eng 20(5):2240–2275
Qi A et al (2022) Directional mutation and crossover boosted ant colony optimization with application to COVID-19 X-ray image segmentation. Comput Biol Med 148:105810
Dong R et al (2023) Boosting Kernel search optimizer with slime mould foraging behavior for combined economic emission dispatch problems. J Bionic Eng
Dong R et al (2021) Boosted kernel search: framework, analysis and case studies on the economic emission dispatch problem. Knowl-Based Syst 233:107529
Deng W et al (2022) An enhanced fast non-dominated solution sorting genetic algorithm for multi-objective problems. Inf Sci 585:441–453
Hua Y et al (2021) A survey of evolutionary algorithms for multi-objective optimization problems with irregular Pareto fronts. IEEE/CAA J Autom Sin 8(2):303–318
Wu S-H, Zhan Z-H, Zhang J (2021) SAFE: scale-adaptive fitness evaluation method for expensive optimization problems. IEEE Trans Evol Comput 25(3):478–491
Li J-Y et al (2020) Boosting data-driven evolutionary algorithm with localized data generation. IEEE Trans Evol Comput 24(5):923–937
Fan C et al (2019) Heronian mean operators of linguistic neutrosophic multisets and their multiple attribute decision-making methods. Int J Distrib Sens Netw 15(4):1550147719843059
Cui W-H, Ye J (2019) Logarithmic similarity measure of dynamic neutrosophic cubic sets and its application in medical diagnosis. Comput Ind 111:198–206
Fan C, Fan E, Hu K (2018) New form of single valued neutrosophic uncertain linguistic variables aggregation operators for decision-making. Cogn Syst Res 52:1045–1055
Ye J, Cui W (2020) Modeling and stability analysis methods of neutrosophic transfer functions. Soft Comput 24(12):9039–9048
Liu J et al (2022) Chaotic simulated annealing multi-verse optimization enhanced kernel extreme learning machine for medical diagnosis. Comput Biol Med 144:105356
Hu J et al (2022) Detection of COVID-19 severity using blood gas analysis parameters and Harris hawks optimized extreme learning machine. Comput Biol Med 142:105166
Li S et al (2020) Slime mould algorithm: a new method for stochastic optimization. Futur Gener Comput Syst 111:300–323
Dhiman G, Kumar V (2019) Seagull optimization algorithm: theory and its applications for large-scale industrial engineering problems. Knowl-Based Syst 165:169–196
Moosavi SHS, Bardsiri VK (2019) Poor and rich optimization algorithm: a new human-based and multi populations algorithm. Eng Appl Artif Intell 86:165–181
Abdullah JM, Ahmed T (2019) Fitness dependent optimizer: inspired by the bee swarming reproductive process. IEEE Access 7:43473–43486
Yadav A (2019) AEFA: artificial electric field algorithm for global optimization. Swarm Evol Comput 48:93–108
Askari Q, Younas I, Saeed M (2020) Political optimizer: a novel socio-inspired meta-heuristic for global optimization. Knowl-Based Syst 195:105709
Yang Y et al (2021) Hunger games search: visions, conception, implementation, deep analysis, perspectives, and towards performance shifts. Expert Syst Appl 177:114864
Tu J et al (2021) The colony predation algorithm. J Bionic Eng 18(3):674–710
Heidari AA et al (2019) Harris hawks optimization: algorithm and applications. Futur Gener Comput Syst 97:849–872
Ahmadianfar I et al (2021) RUN beyond the metaphor: an efficient optimization algorithm based on Runge Kutta method. Expert Syst Appl 181:115079
Yang X et al (2022) An optimized machine learning framework for predicting intradialytic hypotension using indexes of chronic kidney disease-mineral and bone disorders. Comput Biol Med 145:105510
Han Y et al (2023) Multi-verse optimizer with rosenbrock and diffusion mechanisms for multilevel threshold image segmentation from COVID-19 chest X-ray images. J Bionic Eng 20(3):1198–1262
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82
Xu B et al (2023) Dimensional decision covariance colony predation algorithm: global optimization and high− dimensional feature selection. Artif Intell Rev:1–57
Ye T et al (2024) An improved two-archive artificial bee colony algorithm for many-objective optimization. Expert Syst Appl 236:121281
Al-Qaness MA et al (2020) Optimized forecasting method for weekly influenza confirmed cases. Int J Environ Res Public Health 17(10):3510
Yimit A, Iigura K, Hagihara Y (2020) Refined selfish herd optimizer for global optimization problems. Expert Syst Appl 139:112838
Jia H et al (2019) Masi entropy for satellite color image segmentation using tournament-based lévy multiverse optimization algorithm. Remote Sens 11(8):942
Chen H et al (2019) A balanced whale optimization algorithm for constrained engineering design problems. Appl Math Model 71:45–59
Raed M et al (2023) A novel improved lemurs optimization algorithm for feature selection problems. J King Saud Univ-Comput Inf Sci 35(8):101704
Awadallah MA et al (2020) Island artificial bee colony for global optimization. Soft Comput 24(17):13461–13487
Singh Chawda G et al (2020) Incremental conductance based particle swarm optimization algorithm for global maximum power tracking of solar-pv under nonuniform operating conditions. Appl Sci 10(13):4575
Tiwari A, Chaturvedi A (2022) A hybrid feature selection approach based on information theory and dynamic butterfly optimization algorithm for data classification. Expert Syst Appl 196:116621
Ahmadianfar I et al (2022) INFO: an efficient optimization algorithm based on weighted mean of vectors. Expert Syst Appl:116516
Mohamed AW, Hadi AA, Jambi KM (2019) Novel mutation strategy for enhancing SHADE and LSHADE algorithms for global numerical optimization. Swarm Evol Comput 50:100455
Mohamed AW et al (2017) LSHADE with semi-parameter adaptation hybrid with CMA-ES for solving CEC 2017 benchmark problems. In: 2017 IEEE Congress on evolutionary computation (CEC). IEEE
Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958
Qin AK, Huang VL, Suganthan PN (2008) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417
Jia D, Zheng G, Khan MK (2011) An effective memetic differential evolution algorithm based on chaotic local search. Inf Sci 181(15):3175–3187
Chen W-N et al (2012) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 17(2):241–258
Liang JJ et al (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295
Chen H et al (2020) Advanced orthogonal learning-driven multi-swarm sine cosine optimization: framework and case studies. Expert Syst Appl 144:113113
García-Martínez C et al (2008) Global and local real-coded genetic algorithms based on parent-centric crossover operators. Eur J Oper Res 185(3):1088–1113
Cai X et al (2019) An efficient surrogate-assisted particle swarm optimization algorithm for high-dimensional expensive problems. Knowl-Based Syst 184:104901
Mesejo P et al (2016) A survey on image segmentation using metaheuristic-based deformable models: state of the art and critical analysis. Appl Soft Comput 44:1–29
Jang S, Yoo S, Kang N (2022) Generative design by reinforcement learning: enhancing the diversity of topology optimization designs. Comput Aided Des 146:103225
Drugan MM (2019) Reinforcement learning versus evolutionary computation: a survey on hybrid algorithms. Swarm Evol Comput 44:228–246
Anas H, Ong WH, Malik OA (2022) Comparison of deep Q-learning, Q-learning and SARSA reinforced learning for robot local navigation. In: International conference on robot intelligence technology and applications. Springer
Beyer H-G, Schwefel H-P (2002) Evolution strategies–a comprehensive introduction. Nat Comput 1(1):3–52
Salgotra R, Singh U (2017) Application of mutation operators to flower pollination algorithm. Expert Syst Appl 79:112–129
Deng L et al (2022) Differential evolution with dynamic combination based mutation operator and two-level parameter adaptation strategy. Expert Syst Appl 192:116298
Guan Z et al (2019) MFQE 2.0: a new approach for multi-frame quality enhancement on compressed video. IEEE Trans Pattern Anal Mach Intell 43(3):949–963
Garcia S et al (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf Sci 180(10):2044–2064
Derrac J et al (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18
Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN'95-international conference on neural networks. IEEE
Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67
Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowl-Based Syst 89:228–249
Yang X-S (2009) Firefly algorithms for multimodal optimization. In: International symposium on stochastic algorithms. Springer
Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248
Mirjalili S (2016) SCA: a sine cosine algorithm for solving optimization problems. Knowl-Based Syst 96:120–133
Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61
Van den Bergh F, Engelbrecht AP (2006) A study of particle swarm optimization particle trajectories. Inf Sci 176(8):937–971
Eddaly M et al (2016) Combinatorial particle swarm optimization for solving blocking flowshop scheduling problem. J Comput Des Eng 3(4):295–311
Hu K et al (2017) A novel object tracking algorithm by fusing color and depth information based on single valued neutrosophic cross-entropy. J Intell Fuzzy Syst 32(3):1775–1786
Liang Z et al (2019) A hybrid of genetic transform and hyper-rectangle search strategies for evolutionary multi-tasking. Expert Syst Appl 138:112798
Zhang H et al (2022) Differential evolution-assisted salp swarm algorithm with chaotic structure for real-world problems. Eng Comput
Qiao K et al (2022) Self-adaptive resources allocation-based differential evolution for constrained evolutionary optimization. Knowl-Based Syst 235:107653
Liang J et al (2021) Differential evolution with rankings-based fitness function for constrained optimization problems. Appl Soft Comput 113:108016
Yu H et al (2022) Apple leaf disease recognition method with improved residual network. Multimed Tools Appl
Liu X et al (2023) Adapting feature selection algorithms for the classification of Chinese texts. Systems 11(9):483
Lu S et al (2023) Multiscale feature extraction and fusion of image and text in VQA. Int J Comput Intell Syst 16(1):54
Zuo C et al (2017) High-resolution transport-of-intensity quantitative phase microscopy with annular illumination. Sci Rep 7(1):1–22
Reddy KS et al (2016) Binary fireworks algorithm for profit based unit commitment (PBUC) problem. Int J Electr Power Energy Syst 83:270–282
Mafarja M et al (2018) Binary dragonfly optimization for feature selection using time-varying transfer functions. Knowl-Based Syst 161:185–204
Zhang Y et al (2019) Cost-sensitive feature selection using two-archive multi-objective artificial bee colony algorithm. Expert Syst Appl 137:46–58
Jadhav S, He H, Jenkins K (2018) Information gain directed genetic algorithm wrapper feature selection for credit rating. Appl Soft Comput 69:541–553
Chang S, Shihong Y, Qi L (2020) Clustering characteristics of UCI dataset. In: 2020 39th Chinese Control Conference (CCC). IEEE
Tumar I et al (2020) Enhanced binary moth flame optimization as a feature selection algorithm to predict software fault prediction. IEEE Access 8:8041–8055
Mirjalili S, Lewis A (2013) S-shaped versus V-shaped transfer functions for binary particle swarm optimization. Swarm Evol Comput 9:1–14
Emary E, Zawbaa HM, Hassanien AE (2016) Binary ant lion approaches for feature selection. Neurocomputing 213:54–65
Mirjalili S, Mirjalili SM, Yang X-S (2014) Binary bat algorithm. Neural Comput Appl 25(3–4):663–681
Faris H et al (2018) An efficient binary Salp Swarm Algorithm with crossover scheme for feature selection problems. Knowl-Based Syst 154:43–67
Mafarja M, Mirjalili S (2018) Whale optimization approaches for wrapper feature selection. Appl Soft Comput 62:441–453
Rashedi E, Nezamabadi-Pour H, Saryazdi S (2010) BGSA: Binary gravitational search algorithm. Nat Comput 9(3):727–745
Li Y et al (2019) Epileptic seizure detection in EEG signals using sparse multiscale radial basis function networks and the Fisher vector approach. Knowl-Based Syst 164:96–106
Sun Y, Yen GG, Yi Z (2019) IGD indicator-based evolutionary algorithm for many-objective optimization problems. IEEE Trans Evol Comput 23(2):173–187
Chen H et al (2019) An opposition-based sine cosine approach with local search for parameter estimation of photovoltaic models. Energy Convers Manage 195:927–942
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China (62076185, U1809209).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Xu, B., Heidari, A.A. & Chen, H. Reinforced covariance weighted mean of vectors optimizer: insight, diversity, deep analysis and feature selection. Appl Intell 54, 3351–3402 (2024). https://doi.org/10.1007/s10489-023-05261-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-023-05261-5