Skip to main content

Advertisement

Log in

Evolution of mathematical models of chaotic systems based on multiobjective genetic programming

  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

This work is concerned with the identification of models for nonlinear dynamical systems using multiobjective evolutionary algorithms. Systems modelling involves the processes of structure selection, parameter estimation, model performance and model validation and involves a complex solution space. Evolutionary Algorithms (EAs) are search and optimisation tools founded on the principles of natural evolution and genetics, which are suitable for a wide range of application areas. Due to the versatility of these tools and motivated by the versatility of genetic programming (GP), this evolutionary paradigm is proposed for this modelling problem. GP is then combined with a multiobjective function definition scheme. Multiobjective genetic programming (MOGP) is applied to multiple, conflicting objectives and yields a set of candidate parsimonious and valid models, which reproduce the original system behaviour. The MOGP approach is then demonstrated as being applicable for system modelling with chaotic dynamics. The circuit introduced by Chua, being one of the most popular benchmarks for studying nonlinear oscillations, and the Duffing–Holmes oscillator are the systems to test the evolutionary-based modelling approach introduced in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aguirre LA, Mendes EMAM (1996) Global non-linear polynomial models: Structure, terms clusters and fixed points. Int J Bifurcation Chaos 6:279–294

    Article  MathSciNet  Google Scholar 

  • Akaike H (1974) A new look at the statistical model identification. IEEE Trans Automat Control AC-19:716–723

  • Banzhaf WP, Nordin P, Keller RE, Francone FD (1998) Genetic programming: An introduction. Kaufmann, San Mateo, CA

    Google Scholar 

  • Billings SA, Tao QH (1991) Model validity tests for non-linear signal processing applications. Int J Control 54:157–194

    Article  MathSciNet  Google Scholar 

  • Chen S, Billings SA (1989) Representation of non-linear systems: the NARMAX model. Int J Control 49(3):1013–1032

    Article  Google Scholar 

  • Chen S-H, Yeh C-H (1996) Toward a computable approach to the efficient market hypothesis: an application of genetic programming. J Econ Dynamics Control 21:1043–1064

    Article  Google Scholar 

  • Chua LO, Hasler M (1993) Special issue on chaos in non-linear electronic circuits. IEEE Trans Circuits Syst 40:10–11

    Article  Google Scholar 

  • Chua LO, Kamuro M, Matsumoto T (1986) The double scroll family. IEEE Trans Circuits Syst 33:1072–1118

    Article  MathSciNet  Google Scholar 

  • Coello-Coello CA, Toscano-Pulido G (2001) Multiobjective optimization using a micro-genetic algorithm. In: Zitzler E, Deb K, Thiele L, Coello-Coello CA, Corne D (eds) First international conference on evolutionary multi-criterion optimization. Lecture note in computer science. Springer, Berlin Heidelberg New York, pp 126–140

  • Coello-Coello CA, Van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer

  • Deb K, Agrawal S, Pratab A, Meyarivan T (2000) A fast elitism non-dominated sorting genetic algorithm for multiobjective optimization NSGA-II. In: Schoenauer M, Deb K, Rudolph G, Yao X, Lutton E, Merelo JJ, Schwefel H-P (eds), Proceedings of the parallel problem solving from nature VI conference. Lecture notes in computer science. Springer, Berlin Heidelberg New York, pp 849–858

  • Evans DC, Fleming PJ, Hill DC, Norton JP, Pratt I, Rees D, Rodríguez-Vázquez K (2001) System identification techniques in aircraft gas-turbine engines. Control Eng Pract IFAC 9:135–148

    Article  Google Scholar 

  • Fonseca CM, Fleming PJ (1995) Multiobjective optimization and multiple constraint handling with evolutionary algorithms I: a unified formulation. Research Report 564, Dept of automatic control and systems engineering. University of Sheffield, UK

    Google Scholar 

  • Glover J, Mees A (1993) Reconstructing the dynamics of Chua’s circuit. J Circuits Syst Comput 3:201–214

    Article  MathSciNet  Google Scholar 

  • Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley

  • Gray HF, Maxwell RJ, Martínez-Pérez I, Arus C, Cerdan S (1996) Genetic programming for classification of brain tumors from nuclear magnetic resonance biopsy spectra. In: Koza JR, Goldberg DE, Fogel DB, Riolo RL (eds) Proceedings of the first annual conference on genetic programming. Stanford University, CA, pp 424

  • Hinterding R (2001) Constrained parameter optimisation: equality constraints. In: IEEE Proceedings of congress on evolutionary computation 2001, vol 1, 27–30 May, Seoul, Korea, pp 687–692

  • Holmes P (1979) A non-linear oscillator with a strange attractor. Philos Trans Royal Soc London A 292:419–448

    Article  Google Scholar 

  • Hunter NF (1992) Applications of non-linear time series models to driven systems. In: Casdagli M, Eubank S (eds) Non-linear modeling and forecasting, pp 467–491

  • Kaboudan MA (1999) Genetic evolution of regression models for business and economic forecasting. In: IEEE congress on evolutionary computation 2:1260–1267

  • Knowles JD, Corne DW (2000) Approximating the non-dominated front using the Pareto archived evolution strategy. Evolution Comput 8:149–172

    Article  MathSciNet  Google Scholar 

  • Koza JR (1992) Genetic programming: on the programming of computers by means of natural selection. MIT Press, Cambridge, MA

    Google Scholar 

  • Leontaritis IJ, Billings SA (1985) Input-output parametric models for non-linear systems, part I and part II. Int J Control 41:304–344

    Google Scholar 

  • Mendes EMAM (1995) Identification of non-linear discrete systems with intelligent structure detection. PhD thesis, Department of Automatic Control and Systems Engineering, University of Sheffield, UK

  • Michalewicz Z, Nazhiyath G (1995) Genocop III: A co-evolutionary algorithm for numerical optimization problems with non-linear constraints. In: Fogel DB (ed) Proceedings of the second IEEE conference on evolutionary computation, Piscataway, NJ, pp 647–651

  • Miller JF, Job D, Vassilev VK (2000) Principles in the evolutionary design of digital circuits. Gen Program Evolv Mach 1:7–36

    Article  Google Scholar 

  • Mulloy BS, Riolo RL, Savit RS (1996) Dynamics of genetic programming and chaotic time series prediction. In: Koza JR, Goldberg DA, Fogel DB, Riolo RL (eds) Proceedings of the first annual conference on genetic programming, 13–16 July, Stanford University, CA, pp 157–165

  • Nikolaev NI, Iba H (2001) Accelerated genetic programming of polynomials. Gen Program Evolv Mach 2:231–275

    Article  Google Scholar 

  • Nordin P (1994) A compiling genetic programming system that directly manipulates the machine code. In: Kinnear KE (ed) Advances in genetic programming, chapter 14. MIT Press, Cambridge, MA, pp 311–331

  • Oakley EHN (1994) Two scientific applications of genetic programming: stack filters and non-linear equation fitting to chaotic data. In: Kinnear KE (ed) Advances in genetic programming, chapter 16. MIT Press, Cambridge, MA, pp 369–389

  • Poli R (2001) Exact schema theory for genetic programming and variable-length genetic algorithms with one-point crossover. Gen Program Evolv Mach 2:123–163

    Article  Google Scholar 

  • Rodríguez-Vázquez K, Fleming PJ (1999) Genetic programming for dynamic chaotic systems modelling. In: IEEE proceedings of congress on evolutionary computation, vol 1, 6–9 July, Washington, DC, pp 22–28

  • Rosca JP, Ballard DH (1999) Rooted-tree schemata in genetic programming. In: Spector L, Langdon WB, O’Reilly U, Angeline PJ (eds) Advances in genetic programming 3, chapter 11. MIT Press, Cambridge, MA, pp 243–271

  • Ryan C, Ivan L (1999) An automatic software re-engineering tool based on genetic programming. In: Spector L, Langdon WB, O’Reilly U, Angeline PJ (eds) Advances in genetic programming 3, chapter 2. MIT Press, Cambridge, MA, pp 15–40

  • Spector L, Alpern A (1995) Induction and recapitulation of deep musical structure. In: Proceedings of international joint conference on artificial intelligence, IJCAI’95 workshop on music and AI, Montreal, Quebec

  • Witbrock M, Neil-Reilly S (1999) Evolving genetic art. In: Bentley P (ed) Evolutionary design by computers, chapter 10. Kaufmann, San Francisco, CA, pp 251–259

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katya Rodríguez-Vázquez.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rodríguez-Vázquez, K., Fleming, P. Evolution of mathematical models of chaotic systems based on multiobjective genetic programming. Knowl Inf Syst 8, 235–256 (2005). https://doi.org/10.1007/s10115-004-0184-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-004-0184-3

Keywords

Navigation