Skip to main content
Springer Nature Link
Log in

A modified multi-level cross-entropy algorithm for optimization of problems with discrete variables

  • Original Article
  • Published:
Engineering with Computers Aims and scope Submit manuscript

Abstract

Nowadays, the advancement of technology and the increase in the power of computer processing have enabled using these processors to solve different problems in the shortest possible time. Many scholars throughout the world seek to shorten the time needed to solve various problems. As engineering science has a wide range of problems with different natures, it is impossible to claim whether a particular method can solve all the problems faced. Considering the aim of developing optimization methods, in this study, a new method is used by combining a multi-level cross-entropy optimizer (MCEO) algorithm with sigmoid functions to smooth the space of the problems with discrete variables. It is named modified multi-level cross-entropy optimizer (MMCEO). Four problems including designing vessel, speed reducer, 15-member, and 52-member trusses were considered to examine the effectiveness of the proposed algorithm in dealing with various problems. It is of note that all of these problems have discrete variables and they are defined in very difficult spaces. The results regarding the first two problems (i.e., pressure vessel and speed reducer) indicated the very high accuracy of the proposed method and the improvement of the response (in terms of function calls) and in trusses designing. Moreover, they suggested its higher speed compared to the best algorithms in designing the stated structures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Article  Google Scholar 

  2. Deb K (2000) An efficient constraint handling method for genetic algorithms. Comput Methods Appl Mech Eng 186:311–338

    Article  Google Scholar 

  3. Goldberg DE, Holland JH (1988) Genetic algorithms and machine learning. Mach Learn 3:95–99

    Article  Google Scholar 

  4. Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220:671–680

    Article  MathSciNet  Google Scholar 

  5. Dorigo M, Birattari M (2010) Ant colony optimization. Springer, Berlin

    Google Scholar 

  6. Eberhart R, Kennedy J (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks. Citeseer, pp 1942–1948

  7. Castro LN, De Castro LN, Timmis J (2002) Artificial immune systems: a new computational intelligence approach. Springer Science & Business Media, Berlin

    MATH  Google Scholar 

  8. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61

    Article  Google Scholar 

  9. Mirjalili S, Gandomi AH, Mirjalili SZ et al (2017) Salp Swarm Algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191

    Article  Google Scholar 

  10. Kaveh A (2014) Advances in metaheuristic algorithms for optimal design of structures. Springer, Berlin

    Book  Google Scholar 

  11. Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359

    Article  MathSciNet  Google Scholar 

  12. Yao X, Liu Y, Lin G (1999) Evolutionary programming made faster. IEEE Trans Evol Comput 3:82–102

    Article  Google Scholar 

  13. Rechenberg I, Zurada JM, Marks II RJ, Goldberg C (1994) Evolution strategy, in computational intelligence: imitating life. In: Comput Intell imitating life IEEE Press Piscataw

  14. Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT press, Amsterdam

    MATH  Google Scholar 

  15. Simon D (2008) Biogeography-based optimization. IEEE Trans Evol Comput 12:702–713

    Article  Google Scholar 

  16. Webster B, Bernhard PJ (2003) A local search optimization algorithm based on natural principles of gravitation. In: Proceedings of the international conference on information and knowledge engineering, vol 1. Las Vegas, Nevada

  17. Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci (Ny) 179:2232–2248

    Article  Google Scholar 

  18. Kaveh A, Talatahari S (2010) A novel heuristic optimization method: charged system search. Acta Mech 213:267–289

    Article  Google Scholar 

  19. Lam AYS, Li VOK (2010) Chemical-reaction-inspired metaheuristic for optimization. IEEE Trans Evol Comput 14:381–399

    Article  Google Scholar 

  20. Varaee H, Ghasemi MR (2017) Engineering optimization based on ideal gas molecular movement algorithm. Eng Comput 33:71–93. https://doi.org/10.1007/s00366-016-0457-y

    Article  Google Scholar 

  21. MiarNaeimi F, Azizyan G, Rashki M (2018) Multi-level cross entropy optimizer (MCEO): an evolutionary optimization algorithm for engineering problems. Eng Comput. https://doi.org/10.1007/s00366-017-0569-z

    Article  Google Scholar 

  22. Hatamlou A (2013) Black hole: a new heuristic optimization approach for data clustering. Inf Sci (NY) 222:175–184

    Article  MathSciNet  Google Scholar 

  23. Du H, Wu X, Zhuang J (2006) Small-world optimization algorithm for function optimization. In: International Conference on Natural Computation. Springer, pp 264–273

  24. Moghaddam FF, Moghaddam RF, Cheriet M (2012) Curved space optimization: a random search based on general relativity theory. arXiv Prepr arXiv12082214

  25. Karaboga D, Basturk B (2007) Artificial bee colony (ABC) optimization algorithm for solving constrained optimization. In: Problems, LNCS: Advances in Soft Computing: Foundations of Fuzzy Logic and Soft Computing, Springer-Verlag, IFSA 2007, Citeseer

  26. Li XL (2003) A new intelligent optimization-artificial fish swarm algorithm. Dr thesis, Zhejiang Univ Zhejiang, China

  27. Hedayatzadeh R, Salmassi FA, Keshtgari M, et al (2010) Termite colony optimization: a novel approach for optimizing continuous problems. In: 2010 18th Iranian Conference on Electrical Engineering. IEEE, pp 553–558

  28. Mucherino A, Seref O (2007) Monkey search: a novel metaheuristic search for global optimization. In: AIP conference proceedings. American Institute of Physics, pp 162–173

  29. Gandomi AH, Yang XS, Alavi AH (2013) Cuckoo search algorithm: A metaheuristic approach to solve structural optimization problems. Eng Comput 29:17–35. https://doi.org/10.1007/s00366-011-0241-y

    Article  Google Scholar 

  30. Shiqin Y, Jianjun J, Guangxing Y (2009) A dolphin partner optimization. In: Intelligent Systems, 2009. GCIS’09. WRI Global Congress on. IEEE, pp 124–128

  31. Yang X-S (2010) Firefly algorithm, stochastic test functions and design optimisation. arXiv Prepr arXiv10031409

  32. Nenavath H, Jatoth RK (2019) Hybrid SCA–TLBO: a novel optimization algorithm for global optimization and visual tracking. Neural Comput Appl 31:5497–5526

    Article  Google Scholar 

  33. Saremi S, Mirjalili S, Lewis A (2014) Biogeography-based optimisation with chaos. Neural Comput Appl 25:1077–1097

    Article  Google Scholar 

  34. Hamzehkolaei NS, Miri M, Rashki M (2016) An enhanced simulation-based design method coupled with meta-heuristic search algorithm for accurate reliability-based design optimization. Eng Comput 32:477–495

    Article  Google Scholar 

  35. Mezura-Montes E, Coello CAC (2008) An empirical study about the usefulness of evolution strategies to solve constrained optimization problems. Int J Gen Syst 37:443–473

    Article  MathSciNet  Google Scholar 

  36. Coello CAC, Montes EM (2002) Constraint-handling in genetic algorithms through the use of dominance-based tournament selection. Adv Eng Informatics 16:193–203

    Article  Google Scholar 

  37. He Q, Wang L (2007) An effective co-evolutionary particle swarm optimization for constrained engineering design problems. Eng Appl Artif Intell 20:89–99

    Article  Google Scholar 

  38. He Q, Wang L (2007) A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl Math Comput 186:1407–1422

    MathSciNet  MATH  Google Scholar 

  39. Zahara E, Kao Y-T (2009) Hybrid Nelder-Mead simplex search and particle swarm optimization for constrained engineering design problems. Expert Syst Appl 36:3880–3886

    Article  Google Scholar 

  40. dos Santos CL (2010) Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems. Expert Syst Appl 37:1676–1683

    Article  Google Scholar 

  41. Huang F, Wang L, He Q (2007) An effective co-evolutionary differential evolution for constrained optimization. Appl Math Comput 186:340–356

    MathSciNet  MATH  Google Scholar 

  42. Eskandar H, Sadollah A, Bahreininejad A, Hamdi M (2012) Water cycle algorithm–A novel metaheuristic optimization method for solving constrained engineering optimization problems. Comput Struct 110:151–166

    Article  Google Scholar 

  43. Kashan AH (2011) An efficient algorithm for constrained global optimization and application to mechanical engineering design: League championship algorithm (LCA). Comput Des 43:1769–1792

    Google Scholar 

  44. Yang X-S (2010) Engineering optimization: an introduction with metaheuristic applications. Wiley, Hoboken

    Book  Google Scholar 

  45. Cagnina LC, Esquivel SC, Coello CAC (2008) Solving engineering optimization problems with the simple constrained particle swarm optimizer. Informatica 2008:32

    MATH  Google Scholar 

  46. Aguirre AH, Zavala AM, Diharce EV, Rionda SB (2007) COPSO: Constrained Optimization via PSO algorithm. In: Cent Res Math (CIMAT) Tech Rep No I-07-04/22-02-2007 77

  47. Mezura-Montes E, Hernández-Ocaña B (2009) Modified bacterial foraging optimization for engineering design. In: Intelligent engineering systems through artificial neural networks. ASME Press

  48. Kim H-K, Chong J-K, Park K-Y, Lowther DA (2007) Differential evolution strategy for constrained global optimization and application to practical engineering problems. IEEE Trans Magn 43:1565–1568

    Article  Google Scholar 

  49. Mezura-Montes E, Coello CAC, Landa-Becerra R (2003) Engineering optimization using simple evolutionary algorithm. In: Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence. IEEE, pp 149–156

  50. Ray T, Liew K-M (2003) Society and civilization: an optimization algorithm based on the simulation of social behavior. IEEE Trans Evol Comput 7:386–396

    Article  Google Scholar 

  51. Liu H, Cai Z, Wang Y (2010) Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl Soft Comput 10:629–640

    Article  Google Scholar 

  52. Wang L, Li L (2010) An effective differential evolution with level comparison for constrained engineering design. Struct Multidiscip Optim 41:947–963

    Article  Google Scholar 

  53. Zhang M, Luo W, Wang X (2008) Differential evolution with dynamic stochastic selection for constrained optimization. Inf Sci (Ny) 178:3043–3074

    Article  Google Scholar 

  54. Wang Y, Cai Z, Zhou Y, Fan Z (2009) Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique. Struct Multidiscip Optim 37:395–413

    Article  Google Scholar 

  55. Mezura-Montes E, Velázquez-Reyes J, Coello CAC (2006) Modified differential evolution for constrained optimization. In: 2006 IEEE International Conference on Evolutionary Computation. IEEE, pp 25–32

  56. Mezura-Montes E, Coello CAC (2005) Useful infeasible solutions in engineering optimization with evolutionary algorithms. In: MICAI. Springer, pp 652–662

  57. Sadollah A, Bahreininejad A, Eskandar H, Hamdi M (2013) Mine blast algorithm: a new population based algorithm for solving constrained engineering optimization problems. Appl Soft Comput J 13:2592–2612. https://doi.org/10.1016/j.asoc.2012.11.026

    Article  Google Scholar 

  58. Li LJ, Huang ZB, Liu F (2009) A heuristic particle swarm optimization method for truss structures with discrete variables. Comput Struct 87:435–443

    Article  Google Scholar 

  59. Cheng M-Y, Prayogo D (2014) Symbiotic organisms search: a new metaheuristic optimization algorithm. Comput Struct 139:98–112

    Article  Google Scholar 

  60. Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowledge-Based Syst 89:228–249

    Article  Google Scholar 

  61. Gross JL (2001) AISC Design Guide No. 12 Modification of Existing Welded Steel Moment Frame Connections for Seismic Resistance. In: North American Steel Constrction Conference; 2001

Download references

Author information

Authors and Affiliations

  1. Department of Civil Engineering, Bushehr Branch, Islamic Azad University, Bushehr, Iran

    Amirhossein Parand, Mahmood Seraji & Hadi Dashti

Authors
  1. Amirhossein Parand
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Mahmood Seraji
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Hadi Dashti
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Mahmood Seraji.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Parand, A., Seraji, M. & Dashti, H. A modified multi-level cross-entropy algorithm for optimization of problems with discrete variables. Engineering with Computers 38, 2683–2698 (2022). https://doi.org/10.1007/s00366-020-01232-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00366-020-01232-3

Keywords