Skip to main content

Ensemble Neural Network with Type-2 Fuzzy Weights Using Response Integration for Time Series Prediction

  • Chapter
  • First Online:
Recent Developments and the New Direction in Soft-Computing Foundations and Applications

Part of the book series: Studies in Fuzziness and Soft Computing ((STUDFUZZ,volume 361))

Abstract

In this paper an ensemble of three neural networks with type-2 fuzzy weights is proposed. One neural network uses type-2 fuzzy inference systems with Gaussian membership functions for obtain the fuzzy weights; the second neural network uses type-2 fuzzy inference systems with triangular membership functions; and the third neural network uses type-2 fuzzy inference systems with triangular membership functions with uncertainty in the standard deviation. Average integration and type-2 fuzzy integrator are used for the results of the ensemble neural network. The proposed approach is applied to a case of time series prediction, specifically in the Mackey-Glass time series.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. M. Cazorla, F. Escolano, Two Bayesian methods for junction detection. IEEE Trans. Image Process. 12(3), 317–327 (2003)

    Article  MathSciNet  Google Scholar 

  2. G. Martinez, P. Melin, D. Bravo, F. Gonzalez, M. Gonzalez, Modular neural networks and fuzzy Sugeno integral for face and fingerprint recognition. Adv. Soft Comput. 34, 603–618 (2006)

    MATH  Google Scholar 

  3. O. De Wilde, The magnitude of the diagonal elements in neural networks. Neural Netw. 10(3), 499–504 (1997)

    Article  Google Scholar 

  4. P.A. Salazar, P. Melin, O. Castillo, A new biometric recognition technique based on hand geometry and voice using neural networks and fuzzy logic, in Soft Computing for Hybrid Intelligent Systems (2008), pp. 171–186

    Google Scholar 

  5. V.V. Phansalkar, P.S. Sastry, Analysis of the back-propagation algorithm with momentum. IEEE Trans. Neural Networks 5(3), 505–506 (1994)

    Article  Google Scholar 

  6. O. Castillo, P. Melin, Soft Computing for Control of Non-linear Dynamical Systems (Springer, Heidelberg, Germany, 2001)

    Book  Google Scholar 

  7. P. Melin, O. Castillo, Hybrid Intelligent Systems for Pattern Recognition Using Soft Computing (Springer, Heidelberg, 2005), pp. 2–3

    Book  Google Scholar 

  8. L.A. Zadeh, Fuzzy sets. J. Inf. Control 8, 338–353 (1965)

    Article  Google Scholar 

  9. M. Okamura, H. Kikuch, R. Yager, S. Nakanishi, Character diagnosis of fuzzy systems by genetic algorithm and fuzzy inference, in Proceedings of the Vietnam-Japan Bilateral Symposium on Fuzzy Systems and Applications, Halong Bay, Vietnam (1998), pp. 468–473

    Google Scholar 

  10. W. Wang, S. Bridges, Genetic Algorithm Optimization of Membership Functions for Mining Fuzzy Association Rules (Department of Computer Science Mississippi State University, 2000)

    Google Scholar 

  11. J.S.R. Jang, C.T. Sun, E. Mizutani, Neuro-fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence (Prentice Hall, 1997)

    Google Scholar 

  12. O. Castillo, P. Melin, Type-2 Fuzzy Logic Theory and Applications (Springer, Berlin, 2008), pp. 29–43

    Google Scholar 

  13. J. Castro, O. Castillo, P. Melin, An interval type-2 fuzzy logic toolbox for control applications, in FUZZ-IEEE (2007), pp. 1–6

    Google Scholar 

  14. J. Castro, O. Castillo, P. Melin, A. Rodriguez-Diaz, Building fuzzy inference systems with a new interval type-2 fuzzy logic toolbox. Trans. Comput. Sci. 1, 104–114 (2008)

    Google Scholar 

  15. D. Hidalgo, O. Castillo, P. Melin, Type-1 and type-2 fuzzy inference systems as integration methods in modular neural networks for multimodal biometry and its optimization with genetic algorithms, in Soft Computing for Hybrid Intelligent Systems (2008), pp. 89–114

    Google Scholar 

  16. D. Sanchez, P. Melin, Optimization of modular neural networks and type-2 fuzzy integrators using hierarchical genetic algorithms for human recognition, in IFSA World Congress, Surabaya, Indonesia, OS-414 (2011)

    Google Scholar 

  17. R. Sepúlveda, O. Castillo, P. Melin, A. Rodriguez, O. Montiel, Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic. Inf. Sci. 177(11), 2023–2048 (2007)

    Article  Google Scholar 

  18. T.G. Barbounis, J.B. Theocharis, Locally recurrent neural networks for wind speed prediction using spatial correlation. Inf. Sci. 177(24), 5775–5797 (2007)

    Article  Google Scholar 

  19. T. Gedeon, Additive neural networks and periodic patterns. Neural Netw. 12(4–5), 617–626 (1999)

    Article  Google Scholar 

  20. M. Meltser, M. Shoham, L. Manevitz, Approximating functions by neural networks: a constructive solution in the uniform norm. Neural Netw. 9(6), 965–978 (1996)

    Article  Google Scholar 

  21. D. Yeung, P. Chan, W. Ng, Radial basis function network learning using localized generalization error bound. Inf. Sci. 179(19), 3199–3217 (2009)

    Article  Google Scholar 

  22. D. Casasent, S. Natarajan, A classifier neural net with complex-valued weights and square-law nonlinearities. Neural Netw. 8(6), 989–998 (1995)

    Article  Google Scholar 

  23. S. Draghici, On the capabilities of neural networks using limited precision weights. Neural Netw. 15(3), 395–414 (2002)

    Article  Google Scholar 

  24. R.S. Neville, S. Eldridge, Transformations of Sigma–Pi Nets: obtaining reflected functions by reflecting weight matrices. Neural Netw. 15(3), 375–393 (2002)

    Article  Google Scholar 

  25. J. Yam, T. Chow, A weight initialization method for improving training speed in feedforward neural network. Neurocomputing 30(1–4), 219–232 (2000)

    Article  Google Scholar 

  26. H. Ishibuchi, K. Morioka, H. Tanaka, A fuzzy neural network with trapezoid fuzzy weights, fuzzy systems, in IEEE World Congress on Computational Intelligence, vol. 1 (1994), pp. 228–233

    Google Scholar 

  27. H. Ishibuchi, H. Tanaka, H. Okada, Fuzzy neural networks with fuzzy weights and fuzzy biases, in IEEE International Conference on Neural Networks, vol. 3 (1993), pp. 160–165

    Google Scholar 

  28. M.T. Hagan, H.B. Demuth, M.H. Beale, Neural Network Design (PWS Publishing, Boston, 1996), p. 736

    Google Scholar 

  29. J. Castro, O. Castillo, P. Melin, A. Rodríguez-Díaz, A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks. Inf. Sci. 179(13), 2175–2193 (2009)

    Article  Google Scholar 

  30. S. Kamarthi, S. Pittner, Accelerating neural network training using weight extrapolations. Neural Netw. 12(9), 1285–1299 (1999)

    Article  Google Scholar 

  31. T. Feuring, Learning in fuzzy neural networks, in IEEE International Conference on Neural Networks, vol. 2 (1996), pp. 1061–1066

    Google Scholar 

  32. J. Castro, O. Castillo, P. Melin, O. Mendoza, A. Rodríguez-Díaz, An interval type-2 fuzzy neural network for chaotic time series prediction with cross-validation and Akaike test, in Soft Computing for Intelligent Control and Mobile Robotics (2011), pp. 269–285

    Google Scholar 

  33. N. Karnik, J. Mendel, Applications of type-2 fuzzy logic systems to forecasting of time-series. Inf. Sci. 120(1–4), 89–111 (1999)

    Article  Google Scholar 

  34. R. Abiyev, A type-2 fuzzy wavelet neural network for time series prediction. Lect. Notes Comput. Sci. 6098, 518–527 (2010)

    Article  Google Scholar 

  35. F. Gaxiola, P. Melin, F. Valdez, O. Castillo, Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction. Inf. Sci. 260, 1–14 (2014)

    Article  MathSciNet  Google Scholar 

  36. O. Castillo, P. Melin, A review on the design and optimization of interval type-2 fuzzy controllers. Appl. Soft Comput. 12(4), 1267–1278 (2012)

    Article  Google Scholar 

  37. P. Melin, Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition (Springer, 2012), pp. 1–204

    Chapter  Google Scholar 

  38. H. Hagras, Type-2 fuzzy logic controllers: a way forward for fuzzy systems in real world environments, in IEEE World Congress on Computational Intelligence (2008), pp. 181–200

    Google Scholar 

  39. R. Sepúlveda, O. Castillo, P. Melin, O. Montiel, An efficient computational method to implement type-2 fuzzy logic in control applications, in Analysis and Design of Intelligent Systems using Soft Computing Techniques (2007), pp. 45–52

    Google Scholar 

  40. M.D. Monirul Islam, K. Murase, A new algorithm to design compact two-hidden-layer artificial neural networks. Neural Netw. 14(9), 1265–1278 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fernando Gaxiola .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Gaxiola, F., Melin, P., Valdez, F., Castro, J.R. (2018). Ensemble Neural Network with Type-2 Fuzzy Weights Using Response Integration for Time Series Prediction. In: Zadeh, L., Yager, R., Shahbazova, S., Reformat, M., Kreinovich, V. (eds) Recent Developments and the New Direction in Soft-Computing Foundations and Applications. Studies in Fuzziness and Soft Computing, vol 361. Springer, Cham. https://doi.org/10.1007/978-3-319-75408-6_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-75408-6_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-75407-9

  • Online ISBN: 978-3-319-75408-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics