Summary
In this study, we introduce an advanced architecture of genetically optimized Hybrid Fuzzy Neural Networks (gHFNN) and develop a comprehensive design methodology supporting their construction. A series of of numeric experiments is included to illustrate the performance of the networks. The construction of gHFNN exploits fundamental technologies of Computational Intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms (GAs). The architecture of the gHFNNs results from a synergistic usage of the genetic optimization-driven hybrid system generated by combining Fuzzy Neural Networks (FNN) with Polynomial Neural Networks (PNN). In this tandem, a FNN supports the formation of the premise part of the rule-based structure of the gHFNN. The consequence part of the gHFNN is designed using PNNs. The optimization of the FNN is realized with the aid of a standard back-propagation learning algorithm and genetic optimization. We distinguish between two types of the fuzzy rule-based FNN structures showing how this taxonomy depends upon the type of a fuzzy partition of input variables. As to the consequence part of the gHFNN, the development of the PNN dwells on two general optimization mechanisms: the structural optimization is realized via GAs whereas in case of the parametric optimization we proceed with a standard least square method-based learning. Through the consecutive process of such structural and parametric optimization, an optimized PNN is generated in a dynamic fashion.
To evaluate the performance of the gHFNN, the models are experimented with several representative numerical examples. A comparative analysis demonstrates that the proposed gHFNN come with higher accuracy as well as superb predictive capabilities when comparing with other neurofuzzy models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hornik K, Stinchcombe M, White H (1989) Multilayer feedforward networks are universal approximators. IEEE Trans Neural Netw 2:359–366
Chen T, Chen H (1995) Approximation capability to functions of several variables, nonlinear functions, and operators by radial basis function neural networks. IEEE Trans Neural Netw 6:904–910
Li K (1992) Approximation theory and recurrent networks. Proc IJCNN 2: 266–271
Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples IEEE Trans Syst Man Cybern 22:1414–1427
Wang LX, Mendel JM (1992) Fuzzy basis function, universal approximation, and orthogonal least-squares learning. IEEE Trans Neural Netw 3:807–814
Ivakhnenko AG (1971) Polynomial theory of complex systems. IEEE Trans Syst Man Cybern SMC-1:364–378
Ivakhnenko AG, Ivakhnenko NA (1974) Long-term prediction by GMDH algorithms using the unbiased criterion and the balance-of-variables criterion (1974) Sov Automat Control 7:40–45
Ivakhnenko AG, Ivakhnenko NA (1975) Long-term prediction by GMDH algorithms using the unbiased criterion and the balance-of-variables criterion. Part 2 Sov. Automat Control 8:24–38
Ivakhnenko AG, Vysotskiy VN, Ivakhnenko NA (1978) Principal version of the minimum bias criterion for a model and an investigation of their noise immunity. Sov Automat Control 11:27–45
Ivakhnenko AG, Krotov GI, Ivakhnenko NA (1970) Identification of the mathematical model of a complex system by the self-organization method. In: Halfon E (ed.) Advances and case studies Theoretical Systems Ecology, Academic, New York
Farlow SJ (1984) Self-organizing methods in modeling: GMDH type-algorithms. Marcel Dekker, New York
Kim DW (2002) Evolutionary design of self-organizing polynomial neural networks. MA Thesis, Wonkwang University, Korea
Oh SK, Pedrycz W (2002) The design of self-organizing polynomial neural networks. Inf Sci 141:237–258
Shi Y, Eberhart R, Chen Y (1999) Implementation of evolutionary fuzzy systems. IEEE Trans Fuzzy syst 7:109–119
Kristinnson K, Dumont GA (1992) System identification and control using genetic algorithms. IEEE Trans Syst Man Cybern 22:1033–1046
Uckun S, Bagchi S, Kawamura K (1993) Managing genetic search in job shop scheduling. IEEE Expert 8:15–24
Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning. Addison-Wesley, Reading, MA
Kung SY, Taur JS (1995) Decision-based neural networks with signal/image classification applications. IEEE Trans Neural Netw 6:170–181
Box GEP, Jenkins FM (1976) Time series analysis: forecasting and control. Holden-day, Sanfrancisco, CA
Kim E, Lee H, Park M, Park M (1998) A simple identified Sugeno-type fuzzy model via double clustering. Inf Sci 110:25–39
Lin Y, Cunningham GA (1995) A new approach to fuzzy-neural modeling. IEEE Trans Fuzzy Syst 3:190–197
Takagi H, Hayashi I (1991) NN-driven fuzzy reasoning. Int J Approx Reasoning 5:191–212
Sugeno M, Kang GT (1988) Structure identification of fuzzy model. Fuzzy Sets Syst 28:15–33
Kondo T (1986) Revised GMDH algorithm estimating degree of the complete polynomial. Trans Soc Instrum Control Eng 22:928–934
Wu S, Er MJ, Gao Y (2001) A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks. IEEE Trans Fuzzy Syst 9:578–594
Horikawa SI, Furuhashi T, Uchikawa Y (1992) On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm. IEEE Trans Neural Netw 3:801–806
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Oh, SK., Pedrycz, W. (2008). Genetically Optimized Hybrid Fuzzy Neural Networks: Analysis and Design of Rule-based Multi-layer Perceptron Architectures. In: Abraham, A., Grosan, C., Pedrycz, W. (eds) Engineering Evolutionary Intelligent Systems. Studies in Computational Intelligence, vol 82. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75396-4_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-75396-4_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75395-7
Online ISBN: 978-3-540-75396-4
eBook Packages: EngineeringEngineering (R0)