Abstract
Hybrid evolutionary methods combine approaches extracted from different evolutionary computation techniques to build a single optimization method. The design of such systems represents a current trend in the evolutionary optimization literature. In hybrid algorithms, the objective is to extend the potential advantages of the integrated approaches and eliminate their main drawbacks. In this work, a hybrid method for solving optimization problems is presented. The proposed approach combines (A) the explorative characteristics of the invasive weed optimization method, (B) the probabilistic models of the estimation distribution algorithms and (C) the dispersion capacities of a mixed Gaussian–Cauchy distribution to produce its own search strategy. With these mechanisms, the proposed method conducts an optimization strategy over search areas that deserve a special interest according to a probabilistic model and the fitness value of the existent solutions. In the proposed method, each individual of the population generates new elements around its own location, dispersed according to the mixed distribution. The number of new elements depends on the relative fitness value of the individual regarding the complete population. After this process, a group of promising solutions are selected from the set compound by the (a) new elements and the (b) original individuals. Based on the selected solutions, a probabilistic model is built from which a certain number of members (c) are sampled. Then, all the individuals of the sets (a), (b) and (c) are joined in a single group and ranked in terms of their fitness values. Finally, the best elements of the group are selected to replace the original population. This process is repeated until a termination criterion has been reached. To test the performance of our method, several comparisons to other well-known metaheuristic methods have been made. The comparison consists of analyzing the optimization results over different standard benchmark functions within a statistical framework. Conclusions based on the comparisons exhibit the accuracy, efficiency and robustness of the proposed approach.
Similar content being viewed by others
References
Alba E (2005) Parallel metaheuristics: a new class of algorithms. Wiley, New Yok
Alba E, Dorronsoro B (2005) The exploration/exploitation tradeoff in dynamic cellular genetic algorithms. IEEE Trans Evol Comput 9(3):126–142
Arora JS (2012) Chapter 12—numerical methods for constrained optimum design. In: Introduction to optimum design, pp 491–531
Bäck T (1996) Evolutionary algorithms in theory and practice. Oxford University Press, New York
Basak A, Maity D, Das S (2013) A differential invasive weed optimization algorithm for improved global numerical optimization. Appl Math Comput 219:6645–6668
Beigvand D, Abdi H, La Scala M (2017) Hybrid gravitational search algorithm-particle swarm optimization with time varying acceleration coefficients for large scale CHPED problem. Energy 126:841–853
Bertoin J (1996) Lévy processes. Cambridge University Press, Cambridge
Blum C, Blesa MJ, Roli A Sampels M (2008) Hybrid metaheuristics—an emerging approach to optimization, volume 114 of Studies in Computational Intelligence. Springer, Berlin
Blum C, Puchinger J, Raidl G, Roli A (2011) Hybrid metaheuristics in combinatorial optimization: a survey. Appl Soft Comput 11:4135–4151
Cartwright A, Whitworth AP (2012) Four-parameter fits to the initial mass function using stable distributions. Mon Not R Astron Soc 423(2):1018–1023
Chellapilla K (1998) Combining mutation operators in evolutionary programming. IEEE Trans Evol Comput 2(3):91–96
Chen C-H, Chen YP (2007) Real-coded ECGA for economic dispatch. In: Genetic and evolutionary computation conference, GECCO-2007, pp 1920–1927
Cuevas E, González M, Zaldivar D, Pérez-Cisneros M, García G (2012) An algorithm for global optimization inspired by collective animal behaviour. Discrete Dyn Nat Soc 2012:638275. https://doi.org/10.1155/2012/638275
Cuevas E, Cienfuegos M, Zaldívar D, Pérez-Cisneros M (2013) A swarm optimization algorithm inspired in the behavior of the social-spider. Expert Syst Appl 40(16):6374–6384
Cuevas E, Echavarría A, Ramírez-Ortegón M (2014a) An optimization algorithm inspired by the States of Matter that improves the balance between exploration and exploitation. Appl Intell 40(2):256–272
Cuevas E, Gálvez J, Hinojosa S, Avalos O, Zaldívar D, Pérez-Cisneros MA (2014b) Comparison of evolutionary computation techniques for IIR model identification, vol 2014
Das S, Suganthan P (2011) Problem definitions and evaluation criteria for CEC 2011 competition on testing evolutionary algorithms on real world optimization problems, Technical Report
Ducheyne E, De Baets B, De Wulf R (2004) Probabilistic models for linkage learning in forest management. In: Jin Y (ed) Knowledge incorporation in evolutionary computation. Springer, Berlin, pp 177–194
Ehrgott M, Gandibleux X (2008) Hybrid metaheuristics for multi-objective combinatorial optimization, vol 114 of Blum et al. [14], pp 221–259 (Chapter 8)
Garcia S, Molina D, Lozano M, Herrera F (2008) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behavior: a case study on the CEC’2005 Special session on real parameter optimization. J Heurist. https://doi.org/10.1007/s10732-008-9080-4
Garg H (2016) A hybrid PSO–GA algorithm for constrained optimization problems. Appl Math Comput 274:292–305
Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulations 7:60–68
Goldberg DE, Korb B, Deb K (1989) Messy genetic algorithms: motivation, analysis, and first results. Complex Syst 3(5):493–530
Grosan C, Abraham A (2007) Hybrid evolutionary algorithms: methodologies, architectures, and reviews. Stud Comput Intell (SCI) 75:1–17
Han M, Liu Ch, Xing J (2014) An evolutionary membrane algorithm for global numerical optimization problems. Inf Sci 276:219–241
Holland JH (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor
Holland JH (1992) Adaptation in natural and artificial systems: an introductory analysis with applications to biology. Control and artificial intelligence. MIT Press, Cambridge, ISBN 0262082136
James JQ, Li VOK (2015) A social spider algorithm for global optimization. Appl Soft Comput 30:614–627
Ji Y, Zhang K-C, Qu S-J (2007) A deterministic global optimization algorithm. Appl Math Comput 185:382–387
Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference neural networks, vol 4, pp 1942–1948
Li Z, Wang W, Yan Y, Li Z (2015) PS–ABC: a hybrid algorithm based on particle swarm and artificial bee colony for high-dimensional optimization problems. Expert Syst Appl 42(22):8881–8895
Li D, Zhao H, Weng XW, Han T (2016) A novel nature-inspired algorithm for optimization: virus colony search. Adv Eng Softw 92:65–88
Liang JJ, Qu B-Y, Suganthan PN (2015) Problem definitions and evaluation criteria for the CEC 2015 special session and competition on single objective real parameter numerical optimization, Technical Report 201311, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Nanyang Technological University, Singapore
Lipinski P (2007) ECGA vs. BOA in discovering stock market trading experts. In: Genetic and evolutionary computation conference, GECCO-2007, pp 531–538
Mallahzadeh AR, Es’haghi S, Alipour A (2009) Design of an E-shaped MIMO antenna using IWO algorithm for wireless application at 5.8 GHz. Progr Electromagn Res PIER 90:187–203
Mehrabian AR, Lucas C (2006) A novel numerical optimization algorithm inspired from weed colonization. Ecol Inf 1:355–366
Mehrabian AR, Yousefi-Koma A (2007) Optimal positioning of piezoelectric actuators on a smart fin using bio-inspired algorithms. Aerosp Sci Technol 11:174–182
Meng Z, Jeng-Shyang P (2016) Monkey king evolution: a new memetic evolutionary algorithm and its application in vehicle fuel consumption optimization. Knowl-Based Syst 97:144–157
Mühlenbein H, Paaß GH (1996) From recombination of genes to the estimation of distributions I. Binary parameters. In: Eiben A, Bäck T, Shoenauer M, Schwefel H (eds) Parallel problem solving from nature. Springer, Berlin, pp 178–187
Mühlenbein H, Schlierkamp-Voosen D (1993) Predictive models for the breeder genetic algorithm I. Continuous parameter optimization. Evol Comput 1(1):25–49
Nedjah N, Alba E, Macedo M (2008) Parallel evolutionary computations. Computational intelligence & complexity, vol 22. Springer
Ou-Yang C, Utamima A (2013) Hybrid estimation of distribution algorithm for solving single row facility layout problem. Comput Ind Eng 66:95–103
Paenke I, Jin Y, Branke J (2009) Balancing population- and individual-level adaptation in changing environments. Adapt Behav 17(2):153–174
Pardalos PM, Romeijn HE, Tuy H (2000) Recent developments and trends in global optimization. J Comput Appl Math 124:209–228
Park J-B, Lee K-S, Shin J-R, Lee KY (2005) A particle swarm optimization for economic dispatch with non-smooth cost functions. IEEE Trans Power Syst 20(1):34–42
Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179:2232–2248
Rudolph G (1997) Local convergence rates of simple evolutionary algorithms with Cauchy mutations. IEEE Trans Evol Comput 1:249–258
Sandgren E (1990) Nonlinear integer and discrete programming in mechanical design optimization. J Mech Des 112(2):223
Santana R, Larrañaga P, Lozano JA (2008) Protein folding in simplified models with estimation of distribution algorithms. IEEE Trans Evol Comput 12:418–438
Schutte JF, Reinbolt JA, Fregly BJ, Haftka RT, George AD (2004) Parallel global optimization with the particle swarm algorithm. Int J Numer Methods Eng 61(13):2296–2315
Storn R, Price K (1995) Differential evolution—a simple and efficient adaptive scheme for global optimisation over continuous spaces. Technical Report TR-95–012, ICSI, Berkeley
Tan KC, Chiam SC, Mamun AA, Goh CK (2009) Balancing exploration and exploitation with adaptive variation for evolutionary multi-objective optimization. Eur J Oper Res 197:701–713
Trivedi A, Srinivasan D, Biswas S, Reindl T (2016) A genetic algorithm—differential evolution based hybrid framework: case study on unit commitment scheduling problem. Inf Sci 354:275–300
Uchaikin VV, Zolotarev VM (1999) Chance and stability: stable distributions and their applications. VSP, Utrecht
Wang Y, Li B (2009) A self-adaptive mixed distribution based uni-variate estimation of distribution algorithm for large scale global optimization. In: Chiong R (ed) Nature-inspired algorithms for optimisation. Studies in Computational Intelligence, vol 193. Springer, Berlin, Heidelberg, pp 171–198
Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics 1:80–83
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82
Yang XS (2009) Firefly algorithms for multimodal optimization. In: Stochastic algorithms: foundations and applications, SAGA 2009, lecture notes in computer sciences, vol 5792, pp 169–178
Yang X-S (2010) Engineering optimization: an introduction with metaheuristic application. Wiley, USA
Yao X, Liu Y (1996) Fast evolutionary programming. In: Fogel LJ, Angeline PJ, Back T (eds) Proceedings of the fifth annual conference evolutionary programming (EP’96). MIT Press, Cambridge, pp 451–460
Yao X, Liu Y, Liu G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3(2):82–102
Yu T-L, Santarelli S, Goldberg DE (2006) Military antenna design using a simple genetic algorithm and hBOA. In: Pelikan M, Sastry K, Cantú-Paz E (eds) Scalable optimization via probabilistic modeling: from algorithms to applications. Springer, Berlin, pp 275–289
Zhang X, Wang Y, Cui G, Niu Y, Xu J (2009) Application of a novel IWO to the design of encoding sequences for DNA computing. Comput Math Appl 57:2001–2008
Zhang J, Wu Y, Guo Y, Wang Bo, Wang H, Liu H (2016) A hybrid harmony search algorithm with differential evolution for day-ahead scheduling problem of a microgrid with consideration of power flow constraints. Appl Energy 183:791–804
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human and animals participants performed by any of the authors.
Additional information
Communicated by V. Loia.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix A: List of benchmark functions
In Tables 23, 24 and 25, \( f\left( {{\mathbf{x}}^{*} } \right) \) is the optimum value of the function, \( {\mathbf{x}}^{*} \) the optimum position and D the search space (subset of \( {\mathbb{R}}^{n} \)).
Appendix B: Engineering problems
2.1 B1. Gear train problem
In this problem (Sandgren 1990), it is required to minimize the squared difference between the teeth ratio of the gear and a given scalar value. The decision variables are the number of teeth corresponding to each gear. Labels \( A \), \( B \), \( D \) and \( F \) are used to identified the gears. The decision variables correspond to \( x_{1} = A \), \( x_{2} = B \), \( x_{3} = D \) and \( x_{4} = F \). The scalar value is \( 1/6.931 \), see Fig. 8. The cost function and constraints are defined as follows:
2.2 B2. Spring problem
In this formulation (Arora 2012), the objective is to minimize the tension or compression experienced by a spring when a load \( P \) is applied. For optimization, the wire diameter \( d \), the coil diameter \( D \) and the number of active coils \( n \) are considered. The decision variables are \( x_{1} = d \), \( x_{2} = D \) and \( x_{3} = n \), see Fig. 9. The design problem is formulated as:
2.3 B3. Pressure vessel problem
In this problem (Sandgren 1990), the goal is to design a pressure vessel minimizing the required material used for its construction. Therefore, the optimization problem must consider the thickness of the shell \( T_{\text{s}} \), the thickness of the head \( T_{\text{h}} \), the internal radius of the vessel \( R \) and the length of the vessel \( L \), see Fig. 10. The decision variables are \( {\mathbf{x}} = \left[ {x_{1} ,x_{2} ,x_{3} ,x_{4} } \right] \) where \( x_{1} = T_{\text{s}} \), \( x_{2} = T_{\text{h}} \), \( x_{3} = R \) and \( x_{4} = L \). The cost function and constraints are defined as follows:
2.4 B4. FM synthesizer problem
An FM synthesizer generates a signal \( y\left( {{\mathbf{x}},t} \right) \) similar to a target signal \( y_{0} \left( t \right) \). To minimize the error between the signal and the target signal, a parameter estimator for the FM synthesizer is designed considering a finite wave amplitude \( a_{i} \) and the frequency \( \omega_{i} \) (Das and Suganthan 2011). The decision variables are \( {\mathbf{x}} = \left[ {x_{1} = a_{1} ,x_{2} = \omega_{1} ,x_{3} = a_{2} ,x_{4} = \omega_{2} ,x_{5} = a_{3} ,x_{6} = \omega_{3} } \right] \). The cost function and constraints are defined as follows:
2.5 B5. Economic dispatch problem
Economic dispatch is a problem of allocating loads to \( n \) plants (Park et al. 2005). The requirement is to minimize the fuel cost of all committed plants considering the total demand \( D \) and losses \( P_{\text{l}} \). In the following table, \( G_{i} \) is the generation cost for the generator \( i \) and \( P_{i} \) is the electrical power generated by generator \( i \). The cost coefficients for generator \( i \) are \( a_{i} \), \( b_{i} \) and \( c_{i} \). The transmission loss can be determined from \( V_{nn} \) coefficients. The decision variables are \( {\mathbf{x}} = \left[ {x_{1} , \ldots , x_{n} } \right] \). The objective function and constraints are defined as follows:
Rights and permissions
About this article
Cite this article
Cuevas, E., Rodríguez, A., Valdivia, A. et al. A hybrid evolutionary approach based on the invasive weed optimization and estimation distribution algorithms. Soft Comput 23, 13627–13668 (2019). https://doi.org/10.1007/s00500-019-03902-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-019-03902-x