Skip to main content
SpringerLink
Log in

A hybridization of cuckoo search and particle swarm optimization for solving nonlinear systems

  • Research Paper
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

In numerical computations, one of the most strenuous problems is to solve systems of nonlinear equations. It is known that traditional numerical methods such as Newton methods and their variants require differentiability and/or good initial guess for the solutions. In practice, it will be difficult to get this initial solution and costly in term of the time to compute Jacobian. Therefore, there is a need to develop an algorithm to avoid the requirements of these traditional methods. This study proposes a new hybrid algorithm by incorporating cuckoo search (CS) with particle swarm optimization (PSO), called CSPSO, for solving systems of nonlinear equations. The goal of the hybridization between CS and PSO is to incorporate the best attributes of two algorithms together to structure a good-quality algorithm. One of the disadvantages to CS, it requires a large number of function evaluations to get the optimal solution, and to PSO, it is trapped into local minima. Our proposed hybrid algorithm attempts to overcome the disadvantages of CS and PSO. Computational experiments of nine benchmark systems of nonlinear equations and 28 benchmark functions of CEC 2013 with various dimensions are applied to test the performance of CSPSO. Computational results show that CSPSO outperforms other existing algorithms by obtaining the optimum solutions for most of the systems of nonlinear equations and 28 benchmark functions of CEC 2013, and reveals its efficacy in the comparison with other algorithms in the literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Moré JJ (1989) A collection of nonlinear model problems. No. CONF-8807156-1, Argonne National Lab., IL (USA). https://www.osti.gov/biblio/6449249

  2. Beers KJ, Beers KJ (2007) Numerical methods for chemical engineering: applications in Matlab. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  3. Judd KL, Guu SM (1997) Asymptotic methods for aggregate growth models. J Econ Dyn Control 21(6):1025–1042

    Article  MathSciNet  Google Scholar 

  4. Parker TS, Chua LO (1987) Chaos: a tutorial for engineers. Proc IEEE 75(8):982–1008

    Article  Google Scholar 

  5. Yuan G, Lu X (2008) A new backtracking inexact bfgs method for symmetric nonlinear equations. Comput Math Appl 55(1):116–129. https://doi.org/10.1016/j.camwa.2006.12.081

    Article  MathSciNet  MATH  Google Scholar 

  6. Kelley C (2003) Solving nonlinear equations with Newton’s method. Fundamentals of algorithms. Society for Industrial and Applied Mathematics, Philadelphia

    Book  Google Scholar 

  7. Koupaei JA, Hosseini S (2015) A new hybrid algorithm based on chaotic maps for solving systems of nonlinear equations. Chaos Solitons Fractals 81:233–245. https://doi.org/10.1016/j.chaos.2015.09.027

    Article  MathSciNet  MATH  Google Scholar 

  8. Luo YZ, Tang GJ, Zhou LN (2008) Hybrid approach for solving systems of nonlinear equations using chaos optimization and quasi-newton method. Appl Soft Comput 8:1068–1073

    Article  Google Scholar 

  9. Turgut OE, Turgut MS, Coban MT (2014) Chaotic quantum behaved particle swarm optimization algorithm for solving nonlinear system of equations. Comput Math Appl 68(4):508–530. https://doi.org/10.1016/j.camwa.2014.06.013

    Article  MathSciNet  MATH  Google Scholar 

  10. Ouyang A, Zhou Y, Luo Q (2009) Hybrid particle swarm optimization algorithm for solving systems of nonlinear equations. In: IEEE international conference on granular computing, 2009, GRC ’09. pp 460–465

  11. Yang Y, Zhou Q, Gong Y (2010) Hybrid artificial glowworm swarm optimization algorithm for solving system of nonlinear equations. J Comput Inf Syst 10(6):3431–3438

    Google Scholar 

  12. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, vol 4. IEEE Publications, pp 1942–1948

  13. Abd-El-Wahed W, Mousa A, El-Shorbagy M (2011) Integrating particle swarm optimization with genetic algorithms for solving nonlinear optimization problems. J Comput Appl Math 235(5):1446–1453

    Article  MathSciNet  Google Scholar 

  14. Chang W-D (2009) PID control for chaotic synchronization using particle swarm optimization. Chaos Solitons Fractals 39(2):910–917

    Article  Google Scholar 

  15. Zielinski K, Weitkemper P, Laur R, Kammeyer KD (2009) Optimization of power allocation for interference cancellation with particle swarm optimization. IEEE Trans Evolut Comput 13(1):128–150

    Article  Google Scholar 

  16. Ouyang A, Li K, Truong TK, Sallam A, Sha EH-M (2014) Hybrid particle swarm optimization for parameter estimation of muskingum model. Neural Comput Appl 25(7):1785–1799. https://doi.org/10.1007/s00521-014-1669-y issn: 1433-3058

    Article  Google Scholar 

  17. Ouyang A, Tang Z, Zhou X, Xu Y, Pan G, Li K (2015) Parallel hybrid PSO with CUDA for lD heat conduction equation. Comput Fluids 110:198–210. https://doi.org/10.1016/j.compfluid.2014.05.020

    Article  MathSciNet  MATH  Google Scholar 

  18. Li L, Jiao L, Zhao J, Shang R, Gong M (2017) Quantum-behaved discrete multi-objective particle swarm optimization for complex network clustering. Pattern Recognit 63:1–14

    Article  Google Scholar 

  19. Marinakis Y, Marinaki M, Migdalas A (2017) Particle swarm optimization for the vehicle routing problem: a survey and a comparative analysis. In: Martí R, Panos P, Resende MGC (eds) Handbook of heuristics. Springer, Cham, pp 1–34. https://doi.org/10.1007/978-3-319-07153-4_42-1 (ISBN: 978-3-319-07153-4)

    Chapter  Google Scholar 

  20. Zhang Y, Wang S, Ji G (2015) A comprehensive survey on particle swarm optimization algorithm and its applications. Math Prob Eng 2015:931256. https://doi.org/10.1155/2015/931256

    Article  MathSciNet  MATH  Google Scholar 

  21. Yang X, Deb S (2009) Cuckoo search via lévy flights. In: 2009 World congress on nature biologically inspired computing (NaBIC), pp 210–214. https://doi.org/10.1109/NABIC.2009.5393690

  22. Rajabioun R (2011) Cuckoo optimization algorithm. Appl Soft Comput 11(8):5508–5518

    Article  Google Scholar 

  23. Huang J, Gao L, Li X (2015) An effective teaching-learning-based cuckoo search algorithm for parameter optimization problems in structure designing and machining processes. Appl Soft Comput 36:349–356

    Article  Google Scholar 

  24. Mellal MA, Williams EJ (2016) Total production time minimization of a multi-pass milling process via cuckoo optimization algorithm. Int J Adv Manuf Technol 87(1):747–754. https://doi.org/10.1007/s00170-016-8498-3

    Article  Google Scholar 

  25. Chiroma H, Herawan T, Fister I Jr, Fister I, Abdulkareem S, Shuib L, Hamza MF, Saadi Y, Abubakar A (2017) Bio-inspired computation: recent development on the modifications of the cuckoo search algorithm. Appl Soft Comput 61:149–173

    Article  Google Scholar 

  26. Shehab M, Khader AT, Al-Betar MA (2017) A survey on applications and variants of the cuckoo search algorithm. Appl Soft Comput 61:1041–1059. https://doi.org/10.1016/j.asoc.2017.02.034

    Article  Google Scholar 

  27. Yang X-S, Deb S (2014) Cuckoo search: recent advances and applications. Neural Comput Appl 24(1):169–174

    Article  Google Scholar 

  28. Dash J, Dam B, Swain R (2017) Optimal design of linear phase multi-band stop filters using improved cuckoo search particle swarm optimization. Appl Soft Comput 52:435–445

    Article  Google Scholar 

  29. Chi R, Su Y-x, Zhang Dh, Xx Chi, Zhang H-j (2017) A hybridization of cuckoo search and particle swarm optimization for solving optimization problems. Neural Comput Appl 31(1):653–670

    Google Scholar 

  30. Mirjalili S, Hashim SZM (2010) A new hybrid psogsa algorithm for function optimization. In: 2010 International conference on computer and information application, pp 374–377. https://doi.org/10.1109/ICCIA.2010.6141614

  31. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007

    Article  Google Scholar 

  32. Socha K, Dorigo M (2008) Ant colony optimization for continuous domains. Eur J Oper Res 185(3):1155–1173. https://doi.org/10.1016/j.ejor.2006.06.046

    Article  MathSciNet  MATH  Google Scholar 

  33. He S, Wu QH, Saunders JR (2009) Group search optimizer: an optimization algorithm inspired by animal searching behavior. IEEE Trans Evolut Comput 13(5):973–990. https://doi.org/10.1109/TEVC.2009.2011992 issn: 1089-778X

    Article  Google Scholar 

  34. Ibrahim AM, Tawhid MA (2017) Conjugate direction de algorithm for solving systems of nonlinear equations. Appl Math Inf Sci 11(2):339–352. https://doi.org/10.18576/amis/110201

    Article  Google Scholar 

  35. Abdollahi M, Bouyer A, Abdollahi D (2016) Improved cuckoo optimization algorithm for solving systems of nonlinear equations. J Supercomput 72(3):1246–1269. https://doi.org/10.1007/s11227-016-1660-8 issn: 1573-0484

    Article  Google Scholar 

  36. Abd-Elazim S, Ali E (2016) Optimal power system stabilizers design via cuckoo search algorithm. Int J Electr Power Energy Syst 20:99–107

    Article  Google Scholar 

  37. Yang X-S, Deb S (2010) Engineering optimisation by cuckoo search. Int J Math Model Numer Optim 1(4):330–343

    MATH  Google Scholar 

  38. Esmin A, Coelho R, Matwin S (2015) A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data. Artif Intell Rev 44(1):23–45

    Article  Google Scholar 

  39. Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of international symposium on micro machine and human science. IEEE, pp 39–43

  40. Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: Proceedings of IEEE international conference on evolutionary computation. IEEE Publications, pp 69–73

  41. Yang X, Shi P, Shen W, Jang K, Pang S (2013) Multi-objective quantum-behaved particle swarm optimization with entropy based density assessment and chaotic mutation operator. J Comput Inf Syst 9(10):3873–3881

    Google Scholar 

  42. Liang JJ, Qu B-Y, Suganthan PN, Hernández-Díaz AG (2013) Problem definitions and evaluation criteria for the cec 2013 special session and competition on real-parameter optimization. In: Technical report 201212, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore

  43. Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evolut Comput 1(1):3–18. https://doi.org/10.1016/j.swevo.2011.02.002

    Article  Google Scholar 

  44. Li MD, Zhao H, Weng XW, Han T (2016) A novel nature-inspired algorithm for optimization: virus colony search. Adv Eng Softw 92:65–88. https://doi.org/10.1016/j.advengsoft.2015.11.004

    Article  Google Scholar 

  45. Sacco W, Henderson N (2011) Finding all solutions of nonlinear systems using a hybrid metaheuristic with fuzzy clustering means. Appl Soft Comput 11(8):5424–5432. https://doi.org/10.1016/j.asoc.2011.05.016

    Article  Google Scholar 

  46. Henderson N, Sacco WF, Platt GM (2010) Finding more than one root of nonlinear equations via a polarization technique: an application to double retrograde vaporization. Chem Eng Res Des 88(5):551–561. https://doi.org/10.1016/j.cherd.2009.11.001

    Article  Google Scholar 

  47. Floudas C, Pardalos P, Adjiman C, Esposito W, Gumus Z, Harding S, Klepeis J, Meyer C, ASchweiger C (1999) Handbook of test problems in local and global optimization. Kluwer Academic Publishers, Dordrecht

    Book  Google Scholar 

  48. Krzyworzcka S (1996) Extension of the lanczos and cgs methods to systems of nonlinear equations. J Comput Appl Math 69:181–190

    Article  MathSciNet  Google Scholar 

  49. Mo Y, Liub H, Wang Q (2009) Conjugate direction particle swarm optimization solving systems of nonlinear equations. Comput Math Appl 57(11–12):1877–1882

    Article  MathSciNet  Google Scholar 

  50. Grau-Snchez M, Grau A, Noguera M (2011) Frozen divided difference scheme for solving systems of nonlinear equations. J Comput Appl Math 235(6):1739–1743

    Article  MathSciNet  Google Scholar 

  51. Sharma J, Arora H (2013) On efficient weighted-newton methods for solving systems of nonlinear equations. Appl Math Comput 222:497–506

    MathSciNet  MATH  Google Scholar 

  52. Abdollahi M, Isazadeh A, Abdollahi D (2013) Imperialist competitive algorithm for solving systems of nonlinear equations. Comput Math Appl 65(12):1894–1908. https://doi.org/10.1016/j.camwa.2013.04.018

    Article  MathSciNet  MATH  Google Scholar 

  53. Ibrahim AM, Tawhid MA (2018) A hybridization of differential evolution and monarch butterfly optimization for solving systems of nonlinear equations. J Comput Des Eng. https://doi.org/10.1016/j.jcde.2018.10.006

    Article  Google Scholar 

  54. Oliveira H, Petraglia A (2013) Solving nonlinear systems of functional equations with fuzzy adaptive simulated annealing. Appl Soft Comput 13(11):4349–4357

    Article  Google Scholar 

  55. Grosan C, Abraham A (2008) A new approach for solving nonlinear equations systems. IEEE Trans Syst Man Cybern Part A Syst Hum 38(3):698–714

    Article  Google Scholar 

  56. Hentenryck PV, McAllester D, Kapur D (1997) Solving polynomial systems using a branch and prune approach read more. SIAM J Numer Anal 34(2):797–827

    Article  MathSciNet  Google Scholar 

  57. Wang C, Luo R, Wu K, Han B (2011) A new filled function method for an unconstrained nonlinear equation. J Comput Appl Math 235(6):1689–1699

    Article  MathSciNet  Google Scholar 

  58. Jaberipour M, Khorram E, Karimi B (2011) Particle swarm algorithm for solving systems of nonlinear equations. Comput Math Appl 62(2):566–576

    Article  MathSciNet  Google Scholar 

  59. Tawhid MA, Dsouza KB (2018) Hybrid binary bat enhanced particle swarm optimization algorithm for solving feature selection problems. Appl Comput Inf. https://doi.org/10.1016/j.aci.2018.04.001

    Article  Google Scholar 

  60. Tawhid MA, Dsouza KB (2018) Hybrid binary dragonfly enhanced particle swarm optimization algorithm for solving feature selection problems. Math Found Comput 1(2):181–200

    Article  Google Scholar 

  61. Ali AF, Tawhid MA (2016) Hybrid simulated annealing and pattern search method for solving minimax and integer programming problems. Pac J Optim 12(1):151–184

    MathSciNet  MATH  Google Scholar 

  62. Ali AF, Tawhid MA (2016) A hybrid cuckoo search algorithm with nelder mead method for solving global optimization problems. SpringerPlus 5(1):473

    Article  Google Scholar 

  63. Tawhid MA, Savsani P (2019) Discrete sine-cosine algorithm (DSCA) with local search for solving traveling salesman problem. Arab J Sci Eng 44(4):3669–3679

    Article  Google Scholar 

  64. Savsani P, Mohamed A (2018) Tawhid. discrete heat transfer search for solving travelling salesman problem. Math Found Comput 1(3):265–280

    Article  Google Scholar 

  65. Ali AF, Tawhid MA (2016) A hybrid particle swarm optimization and genetic algorithm with population partitioning for large scale optimization problems. Ain Shams Eng J 8(2):191–206

    Article  Google Scholar 

  66. Tawhid MA, Ali AF (2017) A hybrid social spider optimization and genetic algorithm for minimizing molecular potential energy function. Soft Comput 21(21):6499–6514

    Article  Google Scholar 

  67. Tawhid MA, Ali AF (2017) A hybrid grey wolf optimizer and genetic algorithm for minimizing potential energy function. Memet Comput 9(4):347–359

    Article  Google Scholar 

  68. Ali AF, Tawhid MA (2016) A hybrid pso and de algorithm for solving engineering optimization problems. Appl Math Inf Sci 10(2):431–449

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank the referees for carefully reading our manuscript and for giving such constructive comments which substantially helped improving the quality of the paper. NSERC supports the postdoctoral fellowship of the 1st author. The research of the 2nd author is supported in part by the Natural Sciences and Engineering Research Council of Canada (NSERC).

Author information

Authors and Affiliations

  1. Department of Mathematics, Faculty of Science, Al-Azhar University, Assiut Branch, Assiut, Egypt

    Abdelmonem M. Ibrahim

  2. Department of Mathematics and Statistics, Faculty of Science, Thompson Rivers University, Kamloops, BC, V2C 0C8, Canada

    Abdelmonem M. Ibrahim & Mohamed A. Tawhid

Authors
  1. Abdelmonem M. Ibrahim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed A. Tawhid
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Abdelmonem M. Ibrahim or Mohamed A. Tawhid.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ibrahim, A.M., Tawhid, M.A. A hybridization of cuckoo search and particle swarm optimization for solving nonlinear systems. Evol. Intel. 12, 541–561 (2019). https://doi.org/10.1007/s12065-019-00255-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-019-00255-0

Keywords

Search

Navigation