Abstract
In many regression applications, there exist common cases for users to know qualitatively, yet partially, about nonlinear relationships of physical systems. This paper presents a novel direction for constructing feedforward neural networks (FNNs) which are subject to the given nonlinear relationships. The “Integrated models”, associating FNNs with the given nonlinear functions, are proposed. Significant benefits will be obtained over the conventional FNNs by using these models. First, they add a certain degree of comprehensive power for nonlinear approximators. Second, they may provide better generalization capabilities. Two issues are discussed about the improved approximation and the estimation of the real parameters to the partially known function in the proposed models. Numerical studies are given in comparing with the conventional FNNs.
This work is supported in part by National Science Foundation of China (#60275025, #60121302) and Chinese 863 Program (#2002AA241221).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Haykin, S.: Neural Networks, A Comprehensive Foundation, 2nd edn. Printice Hall, New York (1999)
Duda, R.O., Hart, P.E., Stork, D.: Pattern Classification, 2nd edn. John Willy, New York (2001)
Andrews, R., Geva, S.: On the Effects of Initializing a Neural Network with Prior Knowledge. In: Proceedings of the International Conference on Neural Information Processing, Perth, Western Australia, August 1999, pp. 251–256 (1999)
Fu, L.M.: Rule Generation from Neural Networks. IEEE Trans. Sys. Man Cyber. 24, 1114–1124 (1994)
Tickle, A., Andrews, R., Golea, M., Diederich, J.: The Truth will Come to Light: Directions and Hallenges in Extracting the Knowledge Embedded within Trained Artificial Neural Networks. IEEE Trans. Neural Networks 9, 1057–1068 (1998)
Jang, J.-S.R.: ANFIS: Adaptive-network-based Fuzzy Inference System. IEEE Transactions on Systems, Man and Cybernetics 23, 665–685 (1993)
Towell, G., Shavlik, J.: Knowledge-based Artificial Neural Networks. Artificial Intelligence 70, 119–165 (1994)
Yu, T., Jan, T., Debenham, J., Simoff, S.: Incorporating Prior Domain Knowledge in Machine Learning: A Review. In: 2004 International Conference on Advances in Intelligent Systems, Luxembourg (November 2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hu, BG., Qu, HB., Wang, Y. (2005). Associating Neural Networks with Partially Known Relationships for Nonlinear Regressions. In: Huang, DS., Zhang, XP., Huang, GB. (eds) Advances in Intelligent Computing. ICIC 2005. Lecture Notes in Computer Science, vol 3644. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11538059_77
Download citation
DOI: https://doi.org/10.1007/11538059_77
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28226-6
Online ISBN: 978-3-540-31902-3
eBook Packages: Computer ScienceComputer Science (R0)