Abstract
Cerebellar Model Articulation Controller (CMAC) has attractive properties of fast learning and simple computation. The kernel CMAC, which provides an interpretation for the classic CMAC from the kernel viewpoint, strengthens the modeling capability without increasing its complexity. However, the kernel CMAC suffers from the problem of selecting its hyperparameter. In this paper, the Bayesian Ying-Yang (BYY) learning theory is incorporated into kernel CMAC, referred to as KCMAC-BYY, to optimize the hyperparameter. The BYY learning is motivated from the well-known Chinese Taoism Yin-Yang philosophy, and has been developed in this past decade as a unified statistical framework for parameter learning, regularization, structural scale selection and architecture design. The proposed KCMAC-BYY achieves the systematic tuning of the hyperparameter, further improving the performance in modeling capability and stability. The experimental results show that the proposed KCMAC-BYY outperforms the existing representative techniques in the research literature.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Albus, J.S.: Data storage in the cerebellar model articulation controller (CMAC). IEEE Transaction of the ASME, Dynamic Systems Measurement and Control 97(3), 228–233 (1975)
Ker, J.S., Kuo, Y.H., Wen, R.C., Liu, B.D.: Hardware implementation of CMAC neural network with reduced storage requirement. IEEE Transactions on Neural Networks 8(6), 1545–1556 (1997)
Horvath, G., Szabo, T.: Kernel CMAC with Improved Capability. IEEE Transactions on Systems, Man and Cybernetics Part B-Cybernetics 37(1), 124–138 (2007)
Xu, L.: BYY harmony learning, structural RPCL, and topological self-organizing on mixture models. Neural Networks 15, 1125–1151 (2002)
Xu, L.: Advances on BYY harmony learning: information theoretic perspective, generalized projection geometry, and independent factor auto determination. IEEE Transactions on Neural Networks 15, 885–902 (2004)
Xu, L.: RBF Nets, Mixture Experts, and Bayesian Ying-Yang Learning. Neurocomputing 19(1-3), 223–257 (1998)
Lane, S.H., Handelman, D.A., Gelfand, J.J.: Theory and development of higher-order CMAC neural networks. IEEE Control System Magazine 12(2), 23–30 (1992)
Chiang, C.T., Lin, C.S.: CMAC with general basis function. Neural Networks 9(7), 1199–1211 (1998)
Lee, H.M., Chen, C.M., Lu, Y.F.: A self-organizing HCMAC neural network classifier. IEEE Transactions on Neural Networks 14(1), 15–27 (2003)
Suykens, J.A.K., Gestel, T.V., Brabanter, J.D., Moor, B.D., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific, Singapore (2002)
Nguyen, M.N., Shi, D., Quek, C.: FCMAC-BYY: Fuzzy CMAC Using Bayesian Ying-Yang Learning. IEEE Transactions on Systems, Man and Cybernetics-Part B 36(5), 1180–1190 (2006)
Devroye, L.: A Course in Density Estimation. Birkhauser Publisher, Boston (1987)
Nguyen, M.N., Shi, D., Fu, J.: An online Bayesian Ying-Yang learning applied to fuzzy CMAC. Neurocomputing 72, 562–572 (2008)
Kullback, S., Leibler, R.A.: On information and sufficiency. Annals of Mathematical Statistics 2(1), 79–86 (1951)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, G., Zhou, S., Shi, D. (2009). The Optimization of Kernel CMAC Based on BYY Learning. In: Leung, C.S., Lee, M., Chan, J.H. (eds) Neural Information Processing. ICONIP 2009. Lecture Notes in Computer Science, vol 5863. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10677-4_40
Download citation
DOI: https://doi.org/10.1007/978-3-642-10677-4_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10676-7
Online ISBN: 978-3-642-10677-4
eBook Packages: Computer ScienceComputer Science (R0)