Abstract
Due to the fact that the number of function models and the structure of the sub-model of the modular neural network are difficult to determine when applied to complex problems. This paper presents a self-adaptive multi-hierarchical modular neural network structure design method. In this method, a fast find of density peaks cluster algorithm is adopted to determine the number of the function modules, and a conditional fuzzy clustering algorithm is used to further divide the training samples of each function module into several groups to determine the number of sub-modules in each function module. For each sub-module, an incremental design of radical basis function (RBF) network network algorithm based on train error peak is applied to construct the structure of sub-modules which can self-adaptively build the structure of the sub-modules based on the training samples that allocated to the sub-modules. In sub-modules integration, a sub-module integrate approach based on relative distance measure is applied which can select different sub-modules from different function modules to collaboratively learning the training samples. Experiment results demonstrate that the self-adaptive multi-hierarchical modular neural network can not only solve the complex problems that the fully coupled RBF difficult to deal with, but also can improve the learning accuracy and generalization performance of the network.
Support by the National Natural Science Foundation of China (No.61440059), the Natural Science Foundation of Liaoning Province (No.201602363), China Scholarship Council (No.201508210045) and the Basic Research Plan of Nature Science in Shaanxi Province of China (No.2020JM-522).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Xu, L., Qian, F., Li, Y., Li, Q., Yang, Y., Xu, J.: Resource allocation based on quantum particle swarm optimization and RBF neural network for overlay cognitive. Neurocomputing 173(3), 1250–1256 (2016). Author, F., Author, S.: Title of a proceedings paper. In: Editor, F., Editor, S., (eds.) Conference 2016, LNCS, vol. 9999, pp. 1–13. Springer, Heidelberg (2016)
Quan, L., Fei, X., Qi-Ming, F., et al.: Collaborative Q-V value function approximation model based on adaptive normalized radial base function network. Chin. J. Comput. 38(7), 1386–1396 (in Chinese)
Xiong, T., Bao, Y., Hu, Z., Chiong, R.: Forecasting interval time series using a fully complex-valued RBF neural network with DPSO and PSO algorithms. Inform. Sci 305 (2015)
Li-Cheng, J., Shu-Yun, Y., Fang, L., et al.: Seventy years beyond neural networks: retrospect and prospect. Chin. J. Comput. 39(8), 1697–1716 (2016) (in Chinese)
Yu, H., Reiner, P.D., Xie, T., Bartczak, T., Wilamowski, B.M.: An incremental design of radial basis function networks. IEEE Trans. Neural Netw. Learn. Syst. 25(10) (2014)
Liang, L., Guo, W., Zhang, Y., Zhang, W., Li, L., Xing, X.: Radial Basis Function Neural Network for prediction of medium-frequency sound absorption coefficient of composite structure open-cell aluminum foam. Appl. Acoust. 170, 107505 (2020)
Jacobs, R.A, Michael, I, Jordan, A.: Modular connectionist architecture for learning piecewise control strategies. In: Proceedings of the American Control Conference, pp. 343–224. Boston, USA (1991)
Li, W., Li, M., Zhang, J., Qiao, J.: Design of a self-organizing reciprocal modular neural network for nonlinear system modeling. Neurocomputing 411 (2020)
Qiao, J.F., Zhang, Z.Z., Bo, Y.C.: An online self-adaptive modular neural network for time-varying systems. Neurocomputing 125(11), 7–16 (2014)
Smetana, S., Seebold, C., Heinz, V.: Neural network, blockchain, and modular complex system: the evolution of cyber-physical systems for material flow analysis and life cycle assessment. Resour. Conservat. Recycl. 133 (2018)
Happel, B.L.M., Murre, J.M.J.: Design and evolution of modular neural network architectures. Neural Netw. 7(6–7) (1994)
Molina-Vilaplana, J., Feliu-Batlle, J., López-Coronado, J.: A modular neural network architecture for step-wise learning of grasping tasks. Neural Netw. 20(5) (2007)
Nikola, G., Ramazan, G., Dragan, K.: Option pricing with modular neural networks. IEEE Trans. Neural Netw. 20(4) (2009)
Tseng, H.C., Almogahed, B.: Modular neural networks with applications to pattern profiling problems. Neurocomputing 72, 2093–2100 (2009)
Ying-Chun, B., Jun-Fei, Q., Gang, Y.: A multi-modules cooperative neural networks. CAAI Trans. Intell. Syst. 3, 225–230 (2011) (in Chinese)
Melin, P., Miramontes, I., Prado-Arechiga, G.: A hybrid model based on modular neural networks and fuzzy systems for classification of blood pressure and hypertension risk diagnosis. Expert Syst. Appl. 107, 146–164 (2018)
Goltsev, A., Gritsenko, V.: Modular neural networks with radial neural columnar architecture. Biol. Inspired Cognitive Arch. 13, 63–74 (2015)
Stoffel, M., Gulakala, R., Bamer, F., Markert, B.: Artificial neural networks in structural dynamics: a new modular radial basis function approach vs. convolutional and feedforward topologies, Comput. Meth. Appl. Mech. Eng. 364, 112989 (2020)
Srivastava, V., Tripathi, B.K., Pathak, V.K.: Evolutionary fuzzy clustering and functional modular neural network-based human recognition. Neural Comput. Appl. 22(1) (2013)
Rodriguez, A., Liao, A.: Clustering by fast search and find of density peaks. Science 344, 1492–1496 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhao-zhao, Z., Qiu-wan, W., Ying-qin, Z. (2020). A Self-adaptive Multi-hierarchical Modular Neural Network for Complex Problems. In: Ben Hedia, B., Chen, YF., Liu, G., Yu, Z. (eds) Verification and Evaluation of Computer and Communication Systems. VECoS 2020. Lecture Notes in Computer Science(), vol 12519. Springer, Cham. https://doi.org/10.1007/978-3-030-65955-4_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-65955-4_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-65954-7
Online ISBN: 978-3-030-65955-4
eBook Packages: Computer ScienceComputer Science (R0)