Abstract
The technique of momentum and learning rate formation for children pedagogy was adopted to improve the performance of learning algorithm in training the hybrid multilayered perceptron network (HMLP) using modified recursive prediction error (MRPE) algorithm. An Adaptive Learning Recursive Prediction Error Algorithm (ALRPE) is proposed as a second version of MRPE with a guidance of a new profile of learning and momentum rate. An online model was used to forecast speed, revolution and fuel balanced in a Proton Gen2 car tank. The car measured the injected fuel from fuel injection sensor and became an input to the HMLP model to forecast the speed, revolution and fuel balanced in tank. These forecasted variables were also measured from the car sensors. To date, there is a restricted study on the effect of the profile of learning and momentum rate to the performance of HMLP. This study proposes a new profile of momentum and learning rate to improve the performance of the nonlinear modelling using HMLP. Previous conventional profile was developed only based on its general algorithm. The effect of the profile of momentum and learning rate to the generalisation of the HMLP using MRPE network was lack of discussion and thus, motivates this research using the proposed technique. Experimental results showed that the proposed ALRPE profile of momentum and learning rate can improved the performance of nonlinear HMLP model in the range of 0.002 dB to 3.15 dB of mean square error (MSE) in the model validation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Robinson, A., Clinkenbeard, P.R.: History of giftedness: perspectives from the past presage modern scholarship. In: Pfeiffer, S.I. (ed.) Handbook of Giftedness in Children, pp. 13–31. Springer, New York (2008)
Nakao, H., Andrews, K.: Ready to teach or ready to learn: a critique of the natural pedagogy theory. Rev. Philos. Psychol. 5, 465–483 (2014)
Saad, Z., Osman, M.K., Mashor, M.Y.: Modelling and forecasting of car speed using hybrid multilayered perceptron network. J. Contemp. Eng. Sci. 7, 603–610 (2014). Hikari Ltd
Saad, Z., Mashor, M.Y.: Model structure selection for speed forecasting with nonlinear autoregressive with an exogenous input. In: The 4th International Conference on Intelligent Systems, Modelling and Simulation, Bangkok (2013)
Mashor, M.Y.: On-line nonlinear modelling and forecasting of streamflow using neural network. Int. J. Comput. Internet Manage. 17, 44–45 (2009)
Mashor, M.Y.: Hybrid multilayered perceptron network. Int. J. Syst. Sci. 31, 771–785 (2000)
Chen, S., Cowan, C.F.N., Billings, S.A., Grant, P.M.: A parallel recursive prediction error algorithm for training layered neural network. Int. J. Control 51, 1215–1228 (1990)
Demuth, H.B., Beale, M.: Users’ Guide for the Neural Network Toolbox for MATLAB ver. 4.0. The Mathworks, Natick (2000)
Jesus, O.D., Hagan, M.: Backpropagation algorithms for a broad class of dynamic networks. IEEE Trans. Neural Netw. 18, 14–27 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Saad, Z., Mashor, M.Y., Ahmad, W.K.W. (2015). Formation of Momentum and Learning Rate Profile for Online Training and Testing of HMLP with ALRPE. In: Arik, S., Huang, T., Lai, W., Liu, Q. (eds) Neural Information Processing. ICONIP 2015. Lecture Notes in Computer Science(), vol 9490. Springer, Cham. https://doi.org/10.1007/978-3-319-26535-3_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-26535-3_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26534-6
Online ISBN: 978-3-319-26535-3
eBook Packages: Computer ScienceComputer Science (R0)