Abstract
In this paper, type-1 and type-2 fuzzy inferences systems are used to obtain the type-1 or type-2 fuzzy weights in the connections between the layers of a neural network. We use two type-1 or type-2 fuzzy systems that work in the backpropagation learning method with the type-1 or type-2 fuzzy weight adjustment. The mathematical analysis of the proposed learning method architecture and the adaptation of type-1 or type-2 fuzzy weights are presented. The proposed method is based on recent methods that handle weight adaptation and especially fuzzy weights. In this work neural networks with type-1 fuzzy weights or type-2 fuzzy weights are presented. The proposed approach is applied to the case of Dow-Jones time series prediction for evaluating its efficiency.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abiyev, R.: A Type-2 Fuzzy Wavelet Neural Network for Time Series Prediction. Lecture Notes in Computer Science, vol. 6098, pp. 518–527 (2010)
Barbounis, T.G., Theocharis, J.B.: Locally recurrent neural networks for wind speed prediction using spatial correlation. Inf. Sci. 177(24), 5775–5797 (2007)
Beale, E.M.L.: A derivation of conjugate gradients. In: Lootsma, F.A. (ed.) Numerical Methods for Nonlinear Optimization, pp. 39–43. Academic Press, London (1972)
Casasent, D., Natarajan, S.: A classifier neural net with complex-valued weights and square-law nonlinearities. Neural Netw. 8(6), 989–998 (1995)
Castillo, O., Melin, P.: A review on the design and optimization of interval type-2 fuzzy controllers. Appl. Soft Comput. 12(4), 1267–1278 (2012)
Castro, J., Castillo, O., Melin, P., Rodríguez-Díaz, A.: A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks. Inf. Sci. 179(13), 2175–2193 (2009)
Castro, J., Castillo, O., Melin, P., Mendoza, O., Rodríguez-Díaz, A.: An interval type-2 fuzzy neural network for chaotic time series prediction with cross-validation and Akaike test”. In: Soft Computing for Intelligent Control and Mobile Robotics, pp. 269–285 (2011)
Cazorla, M., Escolano, F.: Two Bayesian methods for junction detection. IEEE Trans. Image Proc. 12(3), 317–327 (2003)
De Wilde, O.: The magnitude of the diagonal elements in neural networks. Neural Netw. 10(3), 499–504 (1997)
Draghici, S.: On the capabilities of neural networks using limited precision weights. Neural Netw. 15(3), 395–414 (2002)
Feuring, T.: Learning in fuzzy neural networks. In: IEEE international conference on neural networks, vol. 2, pp. 1061–1066 (1996)
Fletcher, R., Reeves, C.M.: Function minimization by conjugate gradients. Comput. J. 7, 149–154 (1964)
Gaxiola, F., Melin, P., Valdez, F., Castillo, O.: Neural network with type-2 fuzzy weights adjustment for pattern recognition of the human Iris biometrics. In: Proceedings of the 11th Mexican International Conference on Advances in Computational Intelligence, MICAI ’12, vol. 2, pp. 259–270 (2012)
Gaxiola, F., Melin, P., Valdez, F., Castillo, O.: Optimization of type-2 fuzzy weight for neural network using genetic algorithm and particle swarm optimization. In: 5th World Congress on Nature and Biologically Inspired Computing, pp. 22–28 (2013)
Gaxiola, F., Melin, P., Valdez, F.: Backpropagation method with type-2 fuzzy weight adjustment for neural network learning. In: Fuzzy Information Processing Society (NAFIPS). Annual meeting of the North American, pp. 1–6 (2012)
Gaxiola, F., Melin, P., Valdez, F.: Genetic optimization of type-2 fuzzy weight adjustment for backpropagation ensemble neural network. In: Recent Advances on Hybrid Intelligent Systems, pp. 159–171 (2013)
Gaxiola, F., Melin, P., Valdez, F.: Neural network with lower and upper type-2 fuzzy weights using the backpropagation learning method. In: IFSA World Congress and NAFIPS annual meeting (IFSA/NAFIPS), pp. 637–642 (2013)
Gedeon, T.: Additive neural networks and periodic patterns. Neural Netw. 12(4–5), 617–626 (1999)
Hagan, M.T., Demuth, H.B., Beale, M.H.: Neural Network Design. PWS Publishing, Boston, p. 736 (1996)
Hagras, H.: Type-2 fuzzy logic controllers: a way forward for fuzzy systems in real world environments. In: IEEE World Congress on Computational Intelligence, pp. 181–200 (2008)
Ishibuchi, H., Morioka, K., Tanaka, H.: A fuzzy neural network with trapezoid fuzzy weights, fuzzy systems. In: IEEE World Congress on Computational Intelligence, vol. 1, pp. 228–233 (1994)
Ishibuchi, H., Tanaka, H., Okada, H.: Fuzzy neural networks with fuzzy weights and fuzzy biases. In: IEEE international conference on neural networks, vol. 3, pp. 1650–165 (1993)
Jang, J.S.R., Sun, C.T., Mizutani, E.: Neuro-fuzzy and soft computing: a computational approach to learning and machine intelligence, p. 614. Prentice-Hall, Inc., New Jersey (1997)
Kamarthi, S., Pittner, S.: Accelerating neural network training using weight extrapolations. Neural Netw. 12(9), 1285–1299 (1999)
Karnik, N., Mendel, J.: Applications of type-2 fuzzy logic systems to forecasting of time-series. Inf. Sci. 120(1–4), 89–111 (1999)
Martinez, G., Melin, P., Bravo, D., Gonzalez, F., Gonzalez, M.: Modular neural networks and fuzzy sugeno integral for face and fingerprint recognition. Adv. Soft Comput. 34, 603–618 (2006)
Melin, P.: Modular Neural Networks and Type-2 Fuzzy Systems for Pattern Recognition, pp. 1–204. Springer, Berlin (2012)
Meltser, M., Shoham, M., Manevitz, L.: Approximating functions by neural networks: a constructive solution in the uniform norm. Neural Netw. 9(6), 965–978 (1996)
Moller, M.F.: A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw. 6, 525–533 (1993)
Monirul Islam, M.D., Murase, K.: A new algorithm to design compact two-hidden-layer artificial neural networks. Neural Netw. 14(9), 1265–1278 (2001)
Neville, R.S., Eldridge, S.: Transformations of Sigma–Pi nets: obtaining reflected functions by reflecting weight matrices. Neural Netw. 15(3), 375–393 (2002)
Phansalkar, V.V., Sastry, P.S.: Analysis of the back-propagation algorithm with momentum. IEEE Trans. Neural Netw. 5(3), 505–506 (1994)
Powell, M.J.D.: Restart procedures for the conjugate gradient method. Math. Program. 12, 241–254 (1977)
Salazar, P.A., Melin, P., Castillo, O.: A new biometric recognition technique based on hand geometry and voice using neural networks and fuzzy logic. In: Soft Computing for Hybrid Intelligent Systems, pp. 171–186 (2008)
Sepúlveda, R., Castillo, O., Melin, P., Montiel, O.: An efficient computational method to implement type-2 fuzzy logic in control applications. In: Analysis and Design of Intelligent Systems using Soft Computing Techniques, pp. 45–52 (2007)
Yam, J., Chow, T.: A weight initialization method for improving training speed in feedforward neural network. Neurocomputing 30(1–4), 219–232 (2000)
Yeung, D., Chan, P., Ng, W.: Radial basis function network learning using localized generalization error bound. Inf. Sci. 179(19), 3199–3217 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Gaxiola, F., Melin, P., Valdez, F. (2015). Neural Network with Fuzzy Weights Using Type-1 and Type-2 Fuzzy Learning for the Dow-Jones Time Series. In: Melin, P., Castillo, O., Kacprzyk, J. (eds) Design of Intelligent Systems Based on Fuzzy Logic, Neural Networks and Nature-Inspired Optimization. Studies in Computational Intelligence, vol 601. Springer, Cham. https://doi.org/10.1007/978-3-319-17747-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-17747-2_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-17746-5
Online ISBN: 978-3-319-17747-2
eBook Packages: EngineeringEngineering (R0)