Skip to main content

Genetic Optimization of Type-2 Fuzzy Integrators in Ensembles of ANFIS Models for Time Series Prediction

  • Chapter
  • First Online:

Part of the book series: Studies in Computational Intelligence ((SCI,volume 547))

Abstract

This chapter describes the genetic optimization of interval type-2 fuzzy integrators in Ensembles of ANFIS (adaptive neuro-fuzzy inferences systems) models for the prediction of the Mackey-Glass time series. The considered a chaotic system is he Mackey-Glass time series that is generated from the differential equations, so this benchmarks time series is used for the test of performance of the proposed ensemble architecture. We used the interval type-2 and type-1 fuzzy systems to integrate the output (forecast) of each Ensemble of ANFIS models. Genetic Algorithms (GAs) were used for the optimization of memberships function parameters of each interval type-2 fuzzy integrators. In the experiments we optimized Gaussians, Generalized Bell and Triangular membership functions for each of the fuzzy integrators, thereby increasing the complexity of the training. Simulation results show the effectiveness of the proposed approach.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Brocklebank, J.C., Dickey, D.A.: SAS for Forecasting Series, pp. 6–140. SAS Institute Inc, Cary (2003)

    MATH  Google Scholar 

  2. Brockwell, P.D., Richard, A.D.: Introduction to Time Series and Forecasting, pp. 1–219. Springer, New York (2002)

    MATH  Google Scholar 

  3. Castillo, O., Melin, P.: Optimization of type-2 fuzzy systems based on bio-inspired methods: a concise review. Appl. Soft Comput. 12(4), 1267–1278 (2012)

    Article  Google Scholar 

  4. Castillo, O., Melin, P.: Soft Computing for Control of Non-Linear Dynamical Systems. Springer, Heidelberg (2001)

    Book  MATH  Google Scholar 

  5. Castro, J.R., Castillo, O., Martínez, L.G.: Interval type-2 fuzzy logic toolbox. Eng. Lett. 15(1), 89–98 (2007)

    Google Scholar 

  6. Castro, J.R., Castillo, O., Melin, P., Rodriguez, A.: A Hybrid Learning Algorithm for Interval Type-2 Fuzzy Neural Networks: The Case of Time Series Prediction, vol. 15a, pp. 363–386. Springer, Berlin (2008)

    Google Scholar 

  7. Castro, J.R., Castillo, O., Melin, P., Rodríguez, A.: Hybrid learning algorithm for interval type-2 fuzzy neural networks. In: GrC, pp. 157–162 (2007)

    Google Scholar 

  8. Chua, T.W., Tan, W.W.: Genetically evolved fuzzy rule-based classifiers and application to automotive classification. Lecture Notes in Computer Science, vol. 5361, pp. 101–110 (2008)

    Google Scholar 

  9. Cordon, O., Gomide, F., Herrera, F., Hoffmann, F., Magdalena, L.: Ten years of genetic fuzzy systems: current framework and new trends. Fuzzy Sets Syst. 141, 5–31 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  10. Cordon, O., Herrera, F., Hoffmann, F., Magdalena, L.: Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy, Knowledge Bases. World Scientific, Singapore (2001)

    Book  Google Scholar 

  11. Cordon, O., Herrera, F., Villar, P.: Analysis and guidelines to obtain a good uniform fuzzy partition granularity for fuzzy rule-based systems using simulated annealing. Int. J. Approximate Reasoning 25, 187–215 (2000)

    Article  MATH  Google Scholar 

  12. Eason, G., Noble, B., Sneddon, I.N.: On certain integrals of Lipschitz-Hankel type involving products of Bessel functions. Phil. Trans. Roy. Soc. London A247, 529–551 (1995)

    MathSciNet  Google Scholar 

  13. Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computation, pp. 37–69. Springer, Berlin (2003)

    Google Scholar 

  14. Filev, D., Yager, R.: On the issue of obtaining OWA operador weights. Fuzzy Sets Syst. 94(2), 157–169 (1998)

    Article  MathSciNet  Google Scholar 

  15. Goldberg, D.E., Kalyanmoy, D.: A comparative analysis of selection schemes used in genetic algorithms. In: Rawlins, G.J.E. (ed.) Foundations of Genetic Algorithms, pp. 69–93. Morgan Kaufmann Publishers, San Mateo (1991)

    Google Scholar 

  16. Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Boston (1989)

    MATH  Google Scholar 

  17. Goldberg, D.E., Korb, B., Kalyanmoy, D.: Messy genetic algorithms: motivation, analysis, and first results. Complex Syst. 3, 493–530 (1989)

    MATH  Google Scholar 

  18. Holland, J.H.: Outline for a logical theory of adaptive systems. J. Assoc. Comput. Mach. 3, 297–314 (1962)

    Article  Google Scholar 

  19. Holland, J.H.: Adaptatioon in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)

    Google Scholar 

  20. Jang, J.S.R.: ANFIS: adaptive-network-based fuzzy inference systems. IEEE Trans. Syst. Man Cybernet. 23, 665–685 (1992)

    Article  Google Scholar 

  21. Jang, J.S.R.: Fuzzy modeling using generalized neural networks and Kalman fliter algorithm. In: Proceedings of the Ninth National Conference on Artificial Intelligence. (AAAI-91), pp. 762–767 (1991)

    Google Scholar 

  22. Jang, J.S.R.: Rule extraction using generalized neural networks. In: Proceedings of the 4th IFSA Wolrd Congress, pp. 82–86 (1991)

    Google Scholar 

  23. Konar, A.: Computational Intelligence: Principles, Techniques and Applications. Springer, Berlin (2005)

    Book  Google Scholar 

  24. Lawrence, D.: Handbook of Genetic Algorithms. Van Nostrand Reinhold, New Jersey (1991)

    Google Scholar 

  25. Mackey, M.C., Glass, L.: Oscillation and chaos in physiological control systems. Science 197, 287–289 (1997)

    Article  Google Scholar 

  26. Mackey, M.C.: Mackey-Glass. McGill University, Canada. http://www.sholarpedia.org/-article/ Mackey-Glass_equation, 5th Sept 2009

  27. Melin, P., Mendoza, O., Castillo, O.: An improved method for edge detection based on interval type-2 fuzzy logic. Expert Syst. Appl. 37(12), 8527–8535 (2010)

    Article  Google Scholar 

  28. Melin, P., Soto, J., Castillo, O., Soria, J.: Optimization of Interval Type-2 and Type-1 fuzzy integrators in ensemble of ANFIS models with genetic algorithms. In: Mexican International Conference on Computer Science, Morelia, Mexico, 30, 31 Oct–1st Nov 2013

    Google Scholar 

  29. Mendel, J.M.: Why we need type-2 fuzzy logic systems (Article is provided courtesy of Prentice Hall, By Jerry Mendel) 11 May 2001

    Google Scholar 

  30. Mendel, J.M. (ed.): Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions, pp. 25–200. Prentice Hall, USA (2000)

    Google Scholar 

  31. Mendel, J.M., Mouzouris, G.C.: Type-2 fuzzy logic systems. IEEE Trans. Fuzzy Syst. 7, 643–658 (1999)

    Article  Google Scholar 

  32. Michalewicz, Z.: Genetic Algorithms + Data Structures=Evolution Programs, vol. AI. Springer-Verlag, New York (1994)

    Book  MATH  Google Scholar 

  33. Pulido, M., Melin, P., Castillo, O.: Genetic optimization of ensemble neural networks for complex time series prediction. In: Neural Networks International Joint Conference (IJCNN), pp. 202–206 (2011)

    Google Scholar 

  34. Rojas, R.: Neural Networks: A Systematic Introduction, pp. 431–450. Springer, Berlin (1996)

    Book  Google Scholar 

  35. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, pp. 318–362. MIT Press, Cambridge (1986)

    Google Scholar 

  36. Takagi, T., Sugeno, M.: Derivation of fuzzy control rules from human operation control actions. In: Proceedings of the IFAC Symposium on Fuzzy Information, Knowledge Representation and Decision Analysis, pp. 55–60 (1983)

    Google Scholar 

  37. Takagi, T., Sugeno, M.: Fuzzy identification of systems and its applications to modeling and control. IEEE Trans. Syst. Man Cybernet. 15, 116–132 (1985)

    Article  MATH  Google Scholar 

  38. Thomas, G.D.: Machine learning research: four current directions. Artif. Intell. Mag. 18(4), 97–136 (1997)

    Google Scholar 

  39. Wang, C., Zhang, J.P.: Time series prediction based on ensemble ANFIS. In: Proceedings of the Fourth International Conference on Machine Learning and Cybernetics, Guangzhou, 18–21 Aug 2005

    Google Scholar 

  40. Werbos, P.: Beyond regression: new tools for prediction and analysis in the behavioral sciences. PhD thesis, Harvard University (1974)

    Google Scholar 

  41. Xiaoyu, L., Bing, W., Simon, Y.: Time series prediction based on fuzzy principles. In: Department of Electrical & Computer Engineering FAMU-FSU College of Engineering. Florida State University Tallahassee, FL 32310 (2002)

    Google Scholar 

  42. Yager, R., Filev, D.: Essentials of Fuzzy Modeling and Control, p. 388. Wiley, New York (1994)

    Google Scholar 

  43. Zadeh, L.A.: Fuzzy Logic. Computer 1(4), 83–93 (1988)

    Article  MathSciNet  Google Scholar 

  44. Zadeh, L.A.: Fuzzy logic = computing with words. IEEE Trans. Fuzzy Syst. 4(2), 103 (1996)

    Article  MathSciNet  Google Scholar 

  45. Zhou, Z.H., Wu, J., Tang, W.: Ensembling neural networks: many could be better than all. Artif. Intell. 137(1–2), 239–263 (2002)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Patricia Melin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Soto, J., Melin, P. (2014). Genetic Optimization of Type-2 Fuzzy Integrators in Ensembles of ANFIS Models for Time Series Prediction. In: Castillo, O., Melin, P., Pedrycz, W., Kacprzyk, J. (eds) Recent Advances on Hybrid Approaches for Designing Intelligent Systems. Studies in Computational Intelligence, vol 547. Springer, Cham. https://doi.org/10.1007/978-3-319-05170-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-05170-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-05169-7

  • Online ISBN: 978-3-319-05170-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics