Skip to main content

Advertisement

Log in

Enhanced Lichtenberg algorithm: a discussion on improving meta-heuristics

  • Optimization
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Meta-heuristics have been successfully applied to many complex optimization problems. One of the main reasons for its success is its ability to handle non-convex, nonlinear, multimodal, multi-variable, and multi-objective problems with easy implementation. However, the quality of the response of these algorithms to an optimization problem is highly susceptible to the control parameters, and few works aim to tune them or find tools that can improve the algorithms. The literature is rich in proposals for new algorithms, but not for improving existing ones. This paper presents different strategies for tuning and accelerating meta-heuristics using the first hybrid algorithm in the literature. The Lichtenberg algorithm is inspired by lightning and Lichtenberg figures and has been increasingly successfully applied to various optimization problems. However, a study of its best parameters has never been presented until now. After a discussion of the best tuning tools, its tuning parameters are performed using response surface methodology. Then, 14 versions are studied through 10 test functions using chaos theory and Lévy flights scenarios. After 13,500 simulations, the chaotic Lichtenberg algorithm equipped with the piecewise function and tuned parameters proved the best version with only 16% similarity to the original algorithm. Then, it was compared to the genetic algorithm, particle swarm optimization, gray wolf optimizer, salp swarm optimization, whale optimization algorithm, and dragonfly algorithm. The proposed algorithm had both the best average accuracy, lower computational cost, and the smallest standard deviation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

This manuscript has no associated data.

Abbreviations

CCD:

Central composite design

CLA1:

Chaotic Lichtenberg algorithm with Chebyshev series

CLA2:

Chaotic Lichtenberg algorithm with circle series

CLA3:

Chaotic Lichtenberg algorithm with Gauss series

CLA4:

Chaotic Lichtenberg algorithm with iterative series

CLA5:

Chaotic Lichtenberg algorithm with logistic series

CLA6:

Chaotic Lichtenberg algorithm with piecewise series

CLA7:

Chaotic Lichtenberg algorithm with sine series

CLA8:

Chaotic Lichtenberg algorithm with singer series

CLA9:

Chaotic Lichtenberg algorithm with sinusoidal series

CLA10:

Chaotic Lichtenberg algorithm with tent series

DA:

Dragonfly algorithm

DLA:

Diffusion limited aggregation

DoE:

Design of experiments

F opt :

Theoretical optimum

GA:

Genetic algorithm

GWO:

Grey wolf optimizer

LA:

Lichtenberg algorithm

LF:

Lévy flights

LFG:

Lichtenberg figure

LLA1:

Chaotic Lichtenberg algorithm with Lévy flights series (β = ½)

LLA2:

Chaotic Lichtenberg algorithm with Lévy flights series (β = 1)

M :

Figure switching parameter in LA

n :

Dimension or number of design variables (of problems)

N p :

Number of particles (DLA and LA)

OLA:

Original Lichtenberg algorithm

Pop:

Number of population used in LA

PSO:

Particle swarm optimization

R c :

Creation radius (DLA and LA)

Ref:

LA refinement

rand:

Random number between 0 and 1

S :

Stickiness coefficient (DLA and LA)

SSA:

Salp swarm algorithm

TLA:

Tuned Lichtenberg algorithm

WOA:

Whale optimization algorithm

μ :

Mean

σ :

Standard deviation

References

  • Akay D, Karaboga B (2009) Parameter tuning for the artificial bee colony algorithm. In: Nguyen NT, Kowalczyk R, Chen S-M (eds) Computational collective intelligence. Semantic web, social networks and multiagent systems. Springer, Berlin, Heidelberg, pp 608–619

    Google Scholar 

  • Alatas B, Akin E, Ozer AB (2009) Chaos embedded particle swarm optimization algorithms. Chaos Solitons Fractals 40(4):1715–1734

    MathSciNet  MATH  Google Scholar 

  • Amirsadri S, Mousavirad SJ, Komleh HE (2017) A Levy flight-based grey wolf optimizer combined with back propagation algorithm for neural network training. Neural Comput Appl 30:1–14

    Google Scholar 

  • Amoozegar E, Rashedi M (2014) Parameter tuning of GSA using DOE. In: 2014 4th International conference on computer and knowledge engineering (ICCKE), pp 431–436

  • Apribowo CHB, Hadi SP et al (2016) Design of experiments to parameter setting in a genetic algorithm for optimal power flow with TCSC device. In: 2016 2nd International conference of industrial, mechanical, electrical, and chemical engineering (ICIMECE). IEEE, pp 73–78

  • Arora S, Singh S (2017) An improved butterfly optimization algorithm with chaos. J Intell Fuzzy Syst 32(1):1079–1088

    MATH  Google Scholar 

  • Barbosa EBM, Senne ELF (2017) Improving the fine-tuning of metaheuristics: an approach combining design of experiments and racing algorithms. J Optim. https://doi.org/10.1155/2017/8042436

    Article  MathSciNet  Google Scholar 

  • Bartz-Beielstein T, Markon S (2004) Tuning search algorithms for real-world applications: a regression tree based approach. Universitätsbibliothek Dortmund, Dortmund

    Google Scholar 

  • Challan M, Jeet S, Bagal DK, Mishra L, Pattanaik AK, Barua A (2022) Fabrication and mechanical characterization of red mud based Al2025-T6 MMC using Lichtenberg optimization algorithm and Whale optimization algorithm. Mater Today Proc 50:1346–1353

    Google Scholar 

  • Chawla M, Duhan M (2018) Levy flights in metaheuristics optimization algorithms—a review. Appl Artif Intell 32:1–20

    Google Scholar 

  • Chen H, Zhang Q, Luo J, Xu Y, Zhang X (2020) An enhanced bacterial foraging optimization and its application for training kernel extreme learning machine. Appl Soft Comput 86:105884

    Google Scholar 

  • D’Angelo G, Palmieri F (2023) A co-evolutionary genetic algorithm for robust and balanced controller placement in software-defined networks. J Netw Comput Appl 212:103583

    Google Scholar 

  • D’Angelo G, Scoppettuolo MN, Cammarota AL, Rosati A, Palmieri F (2022) A genetic programming-based approach for classifying pancreatic adenocarcinoma: the SICED experience. Soft Comput 26(19):10063–10074

    Google Scholar 

  • Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1:3–18

    Google Scholar 

  • Elseify MA, Kamel S, Nasrat L, Jurado F (2023) Multi-objective optimal allocation of multiple capacitors and distributed generators considering different load models using Lichtenberg and thermal exchange optimization techniques. Neural Comput Appl 35:11867–11899

    Google Scholar 

  • Fisher RA (1936) The design of experiments. Br Med J 1:554–554

    Google Scholar 

  • Francisco MB, Junqueira DM, Oliver GA, Pereira JLJ, da Cunha SS, Gomes GF (2020) Design optimizations of carbon fibre reinforced polymer isogrid lower limb prosthesis using particle swarm optimization and Lichtenberg algorithm. Eng Optim 53:1922–1945

    Google Scholar 

  • Francisco MF, Pereira JLJ et al (2021) Multiobjective design optimization of CFRP isogrid tubes using sunflower optimization based on metamodel. Comput Struct 249:106508

    Google Scholar 

  • Francisco MB, Pereira JLJ, Vasconcelos GAVB, da Cunha Jr SS, Gomes GF (2022) Multiobjective design optimization of double arrowhead auxetic model using Lichtenberg algorithm based on metamodelling. Structures 45:1199–1211

    Google Scholar 

  • Francisco MB, Pereira JLJ, da Cunha Jr SS, Gomes GF (2023) Design optimization of a sandwich composite tube with auxetic core using multiobjective Lichtenberg algorithm based on metamodelling. Eng Struct 281:115775

    Google Scholar 

  • Gomes GF, de Almeida FA (2020) Tuning metaheuristic algorithms using mixture design: application of sunflower optimization for structural damage identification. Adv Eng Softw 149:102877

    Google Scholar 

  • Gomes GF, Giovani RS (2020) An efficient two-step damage identification method using sunflower optimization algorithm and mode shape curvature (MSDBI–SFO). Eng Comput 38:1–20

    Google Scholar 

  • Gomes GF, Pereira JVP (2020) Sensor placement optimization and damage identification in a fuselage structure using inverse modal problem and firefly algorithm. Evol Intell 13(4):571–591

    Google Scholar 

  • Hariya Y, Kurihara T, Shindo T, Jin’no K (2015) Lévy flight PSO. In: 2015 IEEE congress on evolutionary computation (CEC)

  • Heidari AA, Mirjalili S, Faris H, Aljarah I, Mafarja M, Chen H (2019) Harris hawks optimization: algorithm and applications. Future Gener Comput Syst 97:849–872

    Google Scholar 

  • Holland J (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor

    Google Scholar 

  • Hutter HH, Hoos K, Leyton-Brown T (2009) Stutzle, ParamILS: an automatic algorithm configuration framework. J Artif Intell Res 36:267–306

    MATH  Google Scholar 

  • Hutter H, Hoos HH, Leyton-Brown K (2011) Sequential model-based optimization for general algorithm configuration. In: Proceedings of the 5th international conference on learning and intelligent optimization, LION’05. Springer, Berlin, Heidelberg, pp 507–523

  • Iacca G, dos Santos Junior VC, de Melo VV (2021) An improved Jaya optimization algorithm with Lévy flight. Expert Syst Appl 165:113902

    Google Scholar 

  • Iwasaki N, Yasuda K, Ueno G (2006) Dynamic parameter tuning of particle swarm optimization. IEEJ Trans Electr Electron Eng 1(4):353–363

    Google Scholar 

  • Joshi SK, Bansal JC (2019) Parameter tuning for meta-heuristics. Knowl Based Syst 189:105094

    Google Scholar 

  • Joyce T, Herrmann JM (2018) A review of no free lunch theorems, and their implications for metaheuristic optimisation. In: Yang XS (ed) Nature-inspired algorithms and applied optimization. Studies in computational intelligence, vol 744. Springer, Cham

    Google Scholar 

  • Kavitha D, Priyadharshini M, Anitha R, Suma S, Prema V, Vidhya A (2023) Adaptive DBN using hybrid bayesian lichtenberg optimization for intelligent task allocation. Neural Process Lett. https://doi.org/10.1007/s11063-022-11071-6

    Article  Google Scholar 

  • Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, Piscataway, NJ, USA, pp 1942–1948

  • Kromer P, Snael V, Zelinka I (2013) Randomness and chaos in genetic algorithms and differential evolution. In: 5th International conference on intelligent networking and collaborative systems (INCoS), pp 196–201

  • Liu Y, Cao B (2020) A novel ant colony optimization algorithm with levy flight. IEEE Access 8:67205–67213

    Google Scholar 

  • López-Ibáñez M, Dubois-Lacoste J, Cáceres LP, Birattari M, Stützle T (2016) The irace package: Iterated racing for automatic algorithm configuration. Oper Res Perspect 3:43–58

    MathSciNet  Google Scholar 

  • Mirjalili S (2015a) Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Comput Appl 27(4):1053–1073

    Google Scholar 

  • Mirjalili S (2015b) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Google Scholar 

  • Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61

    Google Scholar 

  • Mirjalili SZ, Mirjalili S, Saremi S, Faris H, Aljarah I (2017a) Grasshopper optimization algorithm for multi-objective optimization problems. Appl Intell 48(4):805–820

    Google Scholar 

  • Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM (2017b) Salp swarm algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191

    Google Scholar 

  • Mohanty A, Nag KS, Bagal DK, Barua A, Jeet S, Mahapatra SS, Cherkia H (2022) Parametric optimization of parameters affecting dimension precision of FDM printed part using hybrid Taguchi-MARCOS-nature inspired heuristic optimization technique. Mater Today Proc 50:893–903

    Google Scholar 

  • Montgomery DC (2017) Design and analysis of experiments. Wiley, Hoboken

    Google Scholar 

  • Olorunda O, Engelbrecht AP (2008) Measuring exploration/exploitation in particle swarms using swarm diversity. In: IEEE congress on evolutionary computation (IEEE world congress on computational intelligence). IEEE, pp 1128–1134

  • Ouertani MW, Manita G, Korbaa O (2020) Chaotic lightning search algorithm. Soft Comput 25:2039–2055

    Google Scholar 

  • Paula TI, Gomes GF, de Freitas Gomes JH, de Paiva AP (2019) A mixture design of experiments approach for genetic algorithm tuning applied to multi-objective optimization. In: Optimization of complex systems: theory, models, algorithms and applications, pp 600–610

  • Pazeto D, Pereira JLJ, Gomes GF (2023) Numerical simulation and multiobjective optimization of fluid–structure interaction in aluminum extrusion. Int J Adv Manuf Technol 124:545–566

    Google Scholar 

  • Pereira JLJ, Chuman M, Cunha SS Jr, Gomes GF (2020) Lichtenberg optimization algorithm applied to crack tip identification in thin plate-like structures. Eng Comput. https://doi.org/10.1108/EC-12-2019-0564

    Article  Google Scholar 

  • Pereira JLJ, Francisco MB, Diniz CA, Antônio Oliver G, Cunha SS, Gomes GF (2021a) Lichtenberg algorithm: a novel hybrid physics-based meta-heuristic for global optimization. Expert Syst Appl 170:114522

    Google Scholar 

  • Pereira JLJ, Francisco MB, da Cunha SS, Gomes GF (2021b) A powerful Lichtenberg optimization algorithm: a damage identification case study. Eng Appl Artif Intell 97:104055

    Google Scholar 

  • Pereira JLJ, Oliver GA, Francisco MB et al (2021c) A review of multi-objective optimization: methods and algorithms in mechanical engineering problems. Arch Computat Methods Eng. https://doi.org/10.1007/s11831-021-09663-x

    Article  Google Scholar 

  • Pereira JLJ, Francisco MB, Ribeiro RF et al (2022a) Deep multiobjective design optimization of CFRP isogrid tubes using Lichtenberg algorithm. Soft Comput 26:7195–7209

    Google Scholar 

  • Pereira JLJ, Francisco MB, Souza Chaves JA, Cunha SS Jr, Gomes GF (2022b) Multi-objective sensor placement optimization of helicopter rotor blade based on feature selection. Mech Syst Signal Process 180:109466

    Google Scholar 

  • Pereira JLJ, Guedes FC, Francisco MB, Chiarello AG, Gomes GF (2023) Multi-objective design optimization of a high performance disk brake using Lichtenberg algorithm. Mech Based Des Struct Mach. https://doi.org/10.1080/15397734.2023.2197034

    Article  Google Scholar 

  • Pluhacek M, Kazikova A, Viktorin A, Kadavy T, Senkerik R (2023) Chaos in popular metaheuristic optimizers–a bibliographic analysis. J Differ Equ Appl. https://doi.org/10.1080/10236198.2023.2203779

    Article  Google Scholar 

  • Ramos NP, de Melo Antunes M (2022) Complementary transient thermal models and metaheuristics to simultaneously identify linearly temperature-dependent thermal properties of austenitic stainless steels. Phys Scr 97(11):115006

    Google Scholar 

  • Ramos NP, de Melo Antunes M, de Lima e Silva SMM (2023) A heat flux-corrected experimental inverse technique for simultaneously estimating the thermal properties of a metallic medium as functions of temperature. Exp Heat Transf. https://doi.org/10.1080/08916152.2023.2189328

    Article  Google Scholar 

  • Rehman S, Ali SS, Khan SA (2016) Wind farm layout design using cuckoo search algorithms. Appl Artif Intell 30(10):899–922

    Google Scholar 

  • Richer TJ, Blackwell TM (2006) The Levy particle swarm. In: Proceedings of the IEEE congress on evolutionary computation. Vancouver, Canada, pp 808–815

  • Saremi S, Mirjalili S, Lewis A (2014) Biogeography-based optimisation with chaos. Neural Comput Appl 25(5):1077–1097

    Google Scholar 

  • Sayed GI, Tharwat A, Hassanien AE (2018) Chaotic dragonfly algorithm: an improved metaheuristic algorithm for feature selection. Appl Intell 49:188–205

    Google Scholar 

  • Sharma H, Bansal JC, Arya KV, Yang XS (2016) Lévy flight artificial bee colony algorithm. Int J Syst Sci 47(11):2652–2670

    MATH  Google Scholar 

  • Souza TAZ, Pereira JLJ, Francisco MB, Sotomonte CAR, Jun Ma B, Gomes GF, Coronado CJR (2022) Multi-objective optimization for methane, glycerol, and ethanol steam reforming using Lichtenberg algorithm. Int J Green Energy 20:390–407

    Google Scholar 

  • Tavana M, Kazemi MR, Vafadarnikjoo A, Mobin M (2016) An artificial immune algorithm for ergonomic product classification using anthropometric measurements. Measurement 94:621–629

    Google Scholar 

  • Thietart RA, Forgues B (1995) Chaos theory and organization. Organ Sci 6(1):19–31

    Google Scholar 

  • Tian Z, Wang J (2022) Variable frequency wind speed trend prediction system based on combined neural network and improved multi-objective optimization algorithm. Energy 254:124249

    Google Scholar 

  • Vafadarnikjoo A, Firouzabadi SMAK, Mobin M, Roshani A (2015) A meta-heuristic approach to locate optimal switch locations in cellular mobile networks. In: Proceedings of the international annual conference of the American Society for Engineering Management. American Society for Engineering Management (ASEM), p 1

  • Wang H, Liang C (2016) An improved ant colony algorithm for continuous optimization based on levy flight. Chem Eng Trans 51:487–492

    Google Scholar 

  • Wang GG, Deb S, Gandomi AH, Zhang Z, Alavi AH (2016) Chaotic cuckoo search. Soft Comput 20(9):3349–3362

    Google Scholar 

  • Wang M, Incecik A, Feng S, Gupta MK, Królczyk G, Li Z (2023) Damage identification of offshore jacket platforms in a digital twin framework considering optimal sensor placement. Reliab Eng Syst Saf 237:109336

    Google Scholar 

  • Witten TA, Sander LM (1981) Diffusion-limited aggregation: a kinetic critical phenomenon. Phys Rev Lett 47:1400–1403

    Google Scholar 

  • Witten TA, Sander LM (1983) Diffusion-limited aggregation. Phys Rev Lett 27:5687–5697

    MathSciNet  Google Scholar 

  • Wu J, Zhen X, Liu G, Huang Y (2019) Optimization design on the riser system of next generation subsea production system with the assistance of DOE and surrogate model techniques. Appl Ocean Res 85:34–44

    Google Scholar 

  • Yang XS (2013) Artificial intelligence, evolutionary computing and metaheuristics. In: Studies in computational intelligence, vol 427. Springer, Berlin Heidelberg

  • Yang X-S (2014) Nature-inspired optimization algorithms. Elsevier, Amsterdam

    MATH  Google Scholar 

  • Yang X-S (2020) Nature-inspired optimization algorithms: challenges and open problems. J Comput Sci 46:101104

    MathSciNet  Google Scholar 

  • Yu AJ, Seif J (2016) Minimizing tardiness and maintenance costs in flow shop scheduling by a lower-bound-based GA. Comput Ind Eng 97:26–40

    Google Scholar 

  • Yu H, Yu Y, Liu Y, Wang Y, Gao S (2016) Chaotic grey wolf optimization. In: 2016 International conference on progress in informatics and computing (PIC). IEEE, pp 103–113

  • Zhang X, Feng T (2016) Chaotic bean optimization algorithm. Soft Comput 22(1):67–77

    MathSciNet  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the financial support from the Brazilian agencies FAPESP (São Paulo Research Foundation, Grant 2022/10683-7), CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnológico—Process Number 150117/2021-3), and FAPEMIG (Fundação de Amparo à Pesquisa do Estado de Minas Gerais—APQ-00385-18).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to João Luiz Junho Pereira or Benedict Jun Ma.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix A. Simulation results for the tuning of the Lichtenberg algorithm parameters

Tables 14 and 15.

Table 14 Means results for the 10 objective functions using the matrix of experiments
Table 15 Standard deviations results for the 10 objective functions using the matrix of experiments

Appendix B. Lichtenberg algorithm optimization results for each modified version

See Tables 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28 and 29.

Table 16 Performance of the original Lichtenberg algorithm (LA)
Table 17 Performance of the tuned Lichtenberg algorithm (TLA)
Table 18 Performance of the chaotic Lichtenberg algorithm with Chebyshev map (CLA1)
Table 19 Performance of the chaotic Lichtenberg algorithm with circle map (CLA2)
Table 20 Performance of the Chaotic Lichtenberg algorithm with Gauss map (CLA3)
Table 21 Performance of the Chaotic Lichtenberg algorithm with iterative map (CLA4)
Table 22 Performance of the chaotic Lichtenberg algorithm with logistic map (CLA5)
Table 23 Performance of the chaotic Lichtenberg algorithm with piecewise map (CLA6)
Table 24 Performance of the Chaotic Lichtenberg algorithm with Sine map (CLA7)
Table 25 Performance of the chaotic Lichtenberg algorithm with singer map (CLA8)
Table 26 Performance of the Chaotic Lichtenberg algorithm with Sinusoidal map (CLA9)
Table 27 Performance of the chaotic Lichtenberg algorithm with tent map (CLA10)
Table 28 Performance of the Lévy Lichtenberg algorithm with β = 3/2 (LLA1)
Table 29 Performance of the Lévy Lichtenberg algorithm with β = 1 (LLA2)

Appendix C. Results of other algorithms for test functions

See Tables 30, 31, 32, 33, 34 and 35.

Table 30 Genetic algorithm (GA)
Table 31 Particle swarm optimization (PSO)
Table 32 Grey wolf optimizer (GWO)
Table 33 Salp swarm algorithm (SSA)
Table 34 Whale optimization algorithm (WOA)
Table 35 Dragonfly algorithm (DA)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pereira, J.L.J., Francisco, M.B., de Almeida, F.A. et al. Enhanced Lichtenberg algorithm: a discussion on improving meta-heuristics. Soft Comput 27, 15619–15647 (2023). https://doi.org/10.1007/s00500-023-08782-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-023-08782-w

Keywords

Navigation