Skip to main content
SpringerLink
Log in

A New GA-Based Real Time Controller for the Classical Cart-Pole Balancing Problem

  • Conference paper
Computational Intelligence, Theory and Applications

Part of the book series: Advances in Soft Computing ((AINSC,volume 33))

Abstract

This paper introduces a new application of the genetic algorithm for online control application. It acts as a model free optimization technique that belongs to the class of reinforcement learning. Its concepts and structure is first investigated and then the ability of this algorithm is highlighted by an application in a real-time control (pole balancing) problem. The simulation results approves the better the merit of the proposed technique.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

7 References

  1. D. G. Luenberger, Linear and Nonlinear Programming, 1989, New York

    Google Scholar 

  2. J. H. Holland, Adaptation In Natural And Artificial Systems, Ann Arbor, MI: The University of Michigan Press, 1975

    Google Scholar 

  3. E. Scales, Introduction to Nonlinear Optimization, Springer-verlag, N. Y. 1985

    Google Scholar 

  4. R. E. Bellman, Dynamic Programming, Princetion univ. Press, princetion, N. J., USA, 1957.

    Google Scholar 

  5. K. A. DeJong, “Genetic Algorithms: A 10 Years Perspective,” Proceedings of an International Conference on Genetic Algorithms and Their Applications, pp. 169–177, 1985

    Google Scholar 

  6. J. J. Grefenstetle, “Optimization of Control Parameters for Genetic Algorithms,” IEEE Trans. on Systems, Man and Cybern., SMC-16, No. 1, pp. 122–128, Jun–Feb., 1988

    Google Scholar 

  7. D. E. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, Publishing Company 1988

    Google Scholar 

  8. L. Davis and M. Steenstrup, “Genetic Algorithms & Simulated Annealing,” In GAs & SA, L. Davis, Ed., Pitman, London, UK, pp. 1–11, 1987.

    Google Scholar 

  9. D. B. Fogel, System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling, Needham Heights, MA: Ginn Press, 1991.

    Google Scholar 

  10. Y. T. Chan, J.M. Riley and J.B. Plant, “Modeling of Time Delay and it’s Application to Estimation of Nonstationary Delays,” IEEE Trans. Acoust. Speech, Signal Processing, Vol.: ASSP-29, pp. 577–581, June 1981.

    Article  Google Scholar 

  11. D. M. Elter and M.M. Masukawa, “A Comparison of Algorithms for Adaptive Estimation of The Time-Delay Between Sampled Signals,” proce. of IEEE int. conf. on ASSP., pp. 1253–1256, 1981.

    Google Scholar 

  12. Y. Davidor, Genetic Algorithms & Robotics, A Heuristic Strategy for Optimization, World Scientific, Singapore, 1991.

    MATH  Google Scholar 

  13. C.L. Karr, “Genetic Algorithms for Fuzzy Controllers,” A.I. Expert, Vol. 6, No. 2, pp. 26–33, 1991.

    Article  Google Scholar 

  14. D. Park, A. Kandel, and G. Langholz, “Genetic-Based New Fuzzy Reasoning Models with Application to Fuzzy Control,” IEEE Trans. on Sys., Man, and Cyb., Vol. 24, No. 1, January 1993.

    Google Scholar 

  15. H. Nomura, I. Hayashi and N. Wakami, “A Self Method of Fuzzy Reasoning by Genetic Algorithms,” in Fuzzy Control System, Kandel and Langholz (ed), CRC Press, Inc., London, pp337–354, 1994.

    Google Scholar 

  16. D. A. Linkens, and H. O. Nyongesa, “Genetic Algorithms for Fuzzy Control Part 2: Online System Development and Application,” IEE Proc.-Control Theory Appl., Vol. 142, No. 3, May 1995.

    Google Scholar 

  17. D. J. Montana and L. Davis, “Training Feed-forward Neural Networks Using Genetic Algorithms,” Proc. of Int. Joint Conf. on Artificial Intelligence (Detroid), pp. 762–767, 1989.

    Google Scholar 

  18. F. Z. Brill, D. E. Brown, and W. N. Martin, “Fast Genetic Selection of Features for Neural Networks Classifiers,” IEEE Trans. on Neural Networks, Vol. 3, No. 2, March 1992.

    Google Scholar 

  19. V. Maniezzo, “Genetic Evolution of The Toplogy and Weight Distribution of Neural Networks,” IEEE Trans. Neural Networks, Vol. 5, No. 1, pp. 39–53, Jun 1994.

    Article  Google Scholar 

  20. K.S. Tang, K.F. Man and C. Y. Chan, “Genetic Structure for NN Topology and Weight Optimization,” 1st IEE/IEEE int. conf. on GAs in Engineering System, innovations & Applications, pp. 280–255, 12–14, Sept. 1995.

    Google Scholar 

  21. GA Vignaun and Z. Michalewicz, “A Genetic Algorithms For The Linear Transportation Problem,” IEEE Trans. on Systems Man and Cybernetics, Vol. 21, pp. 445–452, March–April, 1991.

    Article  Google Scholar 

  22. K. Kristinsson, and G. A. Dumont, “System Identification and Control Using Genetic Algorithms,” IEEE Trans. on Sys., Man, and Cyb., Vol. 22, No. 5, September/October 1992.

    Google Scholar 

  23. A. Varsek, T Urbancic, and B. Filipic, “Genetic Algorithms in Controller Design and Tuning,” IEEE Trans. on Sys., Man, and Cyb., Vol. 23, No. 5, September/October 1993.

    Google Scholar 

  24. F. T. Lin, C. Y. Kao, and C. C. Hsu, “Applying the Genetic Approach to Simulated Annealing in Solving Some NP-Hard Problems,” IEEE Trans. on Sys., Man, and Cyb., Vol. 23, No. 6, November/December 1993.

    Google Scholar 

  25. K. Morikawa, T. Furuhashi, and Y. Uchikawa, “Single Populated Genetic Algorithms and its Application to Jobshop Scheduling,” Proc. of IEEE, International Conf. on Power Electronics and Motion Control, Vol. 2, pp. 1014–1019, 1992.

    Google Scholar 

  26. J. J. Grefenstette, “Optimization of Control Parameters for Genetic Algorithms,” IEEE Trans. on Sys., Man, and Cyb., Vol. Smc-16, No. 1, January/February 1986.

    Google Scholar 

  27. M. O. Odetayo, “Optimal Population Size for Genetic Algorithms: An Investigation,” IEEE, Colloquium on Genetic Algorithms for Control Systems Engineering, pp. 2/1–2/4, 1993.

    Google Scholar 

  28. J. T. Alander, “On Optimal Population Size of Genetic Algorithms,” CompEuro’ 92. Computer Systems and Software Engineering’, Proc. pp. 65–70, 1992.

    Google Scholar 

  29. J. Arabas, Z. Michalewicz, and J. Mulawka, “GAVaPS-a Genetic Algorithms with Varying Population Size,” Evolutionary Computation, IEEE World Congress on Computational Intelligence, Proceedings of the IEEE Conf., Vol. 1, pp. 73–78, 1994.

    Article  Google Scholar 

  30. J. A. Lima, N. Gracias, H. Pereira, and A. Rosa, “Fitness Function Design for Genetic Algorithms in Cost Evaluation Based Problems,” Proc. of IEEE, International Conf. on Evolutionary Computation, pp. 207–212, 1996.

    Google Scholar 

  31. A. Ghosh, S. Tsutsui and H. Tanaka, “Individual Aging in Genetic Algorithms,” Conf. on Intelligence Information System, Australian and New Zealand, pp. 276–279, 1996.

    Google Scholar 

  32. J. Hesser and R. Manner, “Towards an Optimal Mutation Probability for Genetic Algorithms,” in Proc. First Int. Workshop on Parallel Problem Solving from Nature, Dortmuntd, 1990, Paper A-XII.

    Google Scholar 

  33. X. Oi and F. Palmieri, “Theoretical Analysis of Evolutionary Algorithms With an Infinite Population Size in Continuous Space Part I: Basic Properties of Selection and Mutation,” IEEE Trans. on Neural Networks, Vol. 5, No. 1, January 1994.

    Google Scholar 

  34. X. Oi and F. Palmieri, “Theoretical Analysis of Evolutionary Algorithms With an Infinite Population Size in Continuous Space Part II: Analysis of the Diversification Role of Crossover,” IEEE Trans. on Neural Networks, Vol. 5, No. 1, January 1994.

    Google Scholar 

  35. Y. Shang and G. J. Li, “New Crossover in Genetic Algorithms,” Proc. of IEEE, Third International Conf. on Tools for Artificial Intelligence, TAI’ 91, pp. 150–153, 1991.

    Google Scholar 

  36. M. Coli, G. Gennuso, P. Palazzari, “A New Crossover Operator for Genetic Algorithms,” Proc. of IEEE, International Conf. on Evolutionary Computation, pp. 201–206, 1996.

    Google Scholar 

  37. J. C. Potts, T. D. Giddens, and S. B. Yadav, “The Development and Evaluation of an Improved Genetic Algorithms Based on Migration and Artificial Selection,” IEEE Trans. on Sys., Man, And Cyb., Vol. 24, No. 1, January 1994.

    Google Scholar 

  38. M.C. Moed, C. V. Stewart and Robert B. Kelly, “Reducing The Search Time of A Steady State Genetic Algorithms Using the Immigration Operator,” Proc. of IEEE, Third International Conf. on Tools for Artificial Intelligence, TAI’ 91, pp. 500–501, 1991.

    Google Scholar 

  39. S. Tsutsui and Y. Fujimoto, “Phenotypic Forking Genetic Algorithms (p-fGA),” Proc. of IEEE, International Conf. on Evolutionary Computation, Vol. 2, pp. 566–572, 1995.

    Article  Google Scholar 

  40. S. Tsutsui and Y. Fujimoto and I. Hayashi, “Extended Forking Genetic Algorithms for Order Representation (o-fGA),” Proc. of the First IEEE, Conf. on IEEE World Congress on Computational Intelligence, Vol. 2, pp. 566–572, 1994.

    Google Scholar 

  41. L. Davis, Handbook of Genetic Algorithms, Van Nostrand Reinhold, 1991.

    Google Scholar 

  42. H. R. Berenji and P. Khedkar, “Learning and Tuning Fuzzy Logic Controllers Through Reinforcements,” IEEE Transactions on Neural Networks, Vol. 3, No. 5, 724–740, 1992.

    Article  Google Scholar 

  43. C. T. Lin and G. Lee, “Reinforcement Structure/Parameter Learning for Neural-Networks-Based Fuzzy Logic Control System,” IEEE Trans. on Fuzzy Systems, Vol. 2, No. 1, Februry 1994.

    Google Scholar 

  44. Fuzzy Logic Control System,” IEEE Trans. on Fuzzy Systems, Vol. 2, No. 1, Februry 1994

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical engineering Department, Azad University, Tehran, Iran

    N. Seifipour

  2. Department of Electrical Enginnering, Amirkabir University, Hafez Ave. #529, Tehran, Iran

    M. B. Menhaj

Authors
  1. N. Seifipour
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. B. Menhaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science 1, University of Dortmund, FB 8 Ektrotechnik FB Informatik LS Informatik I, Postfach 50 05 00, 44221, Dortmund, Germany

    Bernd Reusch

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Seifipour, N., Menhaj, M.B. (2005). A New GA-Based Real Time Controller for the Classical Cart-Pole Balancing Problem. In: Reusch, B. (eds) Computational Intelligence, Theory and Applications. Advances in Soft Computing, vol 33. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-31182-3_73

Download citation

  • DOI: https://doi.org/10.1007/3-540-31182-3_73

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22807-3

  • Online ISBN: 978-3-540-31182-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation