Summary
In this study, we introduce and investigate a class of neural architectures of self-organizing neural networks (SONN) that is based on a genetically optimized multilayer perceptron with polynomial neurons (PNs) or fuzzy polynomial neurons (FPNs), develop a comprehensive design methodology involving mechanisms of genetic optimization and carry out a series of numeric experiments. The conventional SONN is based on a self-organizing and an evolutionary algorithm rooted in a natural law of survival of the fittest as the main characteristics of the extended Group Method of Data Handling (GMDH) method, and utilized the polynomial order (viz. linear, quadratic, and modified quadratic) as well as the number of node inputs fixed (selected in advance by designer) at the corresponding nodes (PNs or FPNs) located in each layer through a growth process of the network. Moreover it does not guarantee that the SONN generated through learning results in the optimal network architecture. We distinguish between two kinds of SONN architectures, that is, (a) Polynomial Neuron (PN) based and (b) Fuzzy Polynomial Neuron (FPN) based self-organizing neural networks. This taxonomy is based on the character of each neuron structure in the network. The augmented genetically optimized SONN (gSONN) results in a structurally optimized structure and comes with a higher level of flexibility in comparison to the one encountered in the conventional SONN. The GA-based design procedure being applied at each layer of SONN leads to the selection of preferred nodes (PNs or FPNs) with specific local characteristics (such as the number of input variables, the order of the polynomial, and a collection of the specific subset of input variables) available within the network. In the sequel, two general optimization mechanisms of the gSONN are explored: the structural optimization is realized via GAs whereas for the ensuing detailed parametric optimization we proceed with a standard least square method-based learning. Each node of the PN based gSONN exhibits a high level of flexibility and realizes a collection of preferred nodes as well as a preferred polynomial type of mapping (linear, quadratic, and modified quadratic) between input and output variables. FPN based gSONN dwells on the ideas of fuzzy rule-based computing and neural networks. The performance of the gSONN is quantified through experimentation that exploits standard data already used in fuzzy or neurofuzzy modeling. These results reveal superiority of the proposed networks over the existing fuzzy and neural models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Banzhaf W, Nordin P, Keller RE, Francone FD (1998) Genetic programming – an introduction. On the automatic evolution of computer programs and its applications. Morgan Kaufmann, Los Altos, CA
Brabazon A, O’Neill M (2005) Biologically inspired algorithms for financial modelling. Springer, Berlin Heidelberg New York
Cleary R, O’Neill M (2005) An attribute grammar decoder for the 01 multiConstrained knapsack problem. In: LNCS 3448 Proceedings of evolutionary computation in combinatorial optimization EvoCOP 2005, Lausanne, Switzerland. Springer, Berlin Heidelberg New York, pp 34–45
Hemberg M, O’Reilly U-M (2002) GENR8 – using grammatical evolution in a surface design tool. In: Proceedings of the first grammatical evolution workshop GEWS2002, New York City, New York, US. ISGEC, pp 120–123
Koza JR (1992) Genetic programming. MIT, Cambridge, MA
Koza JR (1994) Genetic programming II: automatic discovery of reusable programs. MIT, Cambridge, MA
Koza JR, Andre D, Bennett III FH, Keane M (1999) Genetic programming 3: Darwinian invention and problem solving. Morgan Kaufmann, Los Altos, CA
Koza JR, Keane M, Streeter MJ, Mydlowec W, Yu J Lanza G (2003) Genetic programming IV: routine human-competitive machine intelligence. Kluwer Academic, Dordrecht
Moore JH, Hahn LW (2004) Systems biology modeling in human genetics using petri nets and grammatical evolution. In: LNCS 3102 Proceedings of the genetic and evolutionary computation conference GECCO 2004, Seattle, WA, USA, Springer, Berlin Heidelberg New York, pp 392–401
O’Neill M, Brabazon A (2004) Grammatical swarm. In: LNCS 3102 Proceedings of the genetic and evolutionary computation conference GECCO 2004, Seattle, WA, USA. Springer Berlin Heidelberg New York, pp 163–174
O’Neill M, Adley C, Brabazon A (2005) A grammatical evolution approach to eukaryotic promoter recognition. In: Proceedings of Bioinformatics INFORM 2005, Dublin City University, Dublin, Ireland
O’Neill M, Ryan C (2003) Grammatical evolution: evolutionary automatic programming in an arbitrary language. Kluwer Academic, Dordrecht
O’Neill M (2001) Automatic programming in an arbitrary language: evolving programs in grammatical evolution. PhD thesis, University of Limerick, 2001
O’Neill M, Ryan C (2001) Grammatical evolution. IEEE Trans Evol Comput 5(4):349–358
O’Neill M, Ryan C, Keijzer M, Cattolico M (2003) Crossover in grammatical evolution. Genetic programming and evolvable machines, vol 4, no 1. Kluwer Academic, Dordrecht
Ryan C, Collins JJ, O’Neill M (1998) Grammatical evolution: evolving programs for an arbitrary language. Proceedings of the first European workshop on GP. Springer, Berlin Heidelberg New York, pp 83–95
Hettich S, Blake CL, Merz CJ (1998) UCI repository of machine learning databases [http://www.ics.uci.edu/mlearn/MLRepository.html]. University of California, Department of Information and Computer Science, Irvine, CA
Smith M, Bull L (2005) Genetic programming with a genetic algorithm for feature construction and selection. Genet Program Evolvable Machines 6(3): 265–281
Dempsey I, O’Neill M, Brabazon A (2002) Investigations into market index trading models using evolutionary automatic programming. In: O’Neill M, Sutcliffe R, Ryan C, Eaton M, Griffith N (eds) LNAI 2464, Proceedings of the 13th Irish conference in artificial intelligence and cognitive science. Springer, Berlin Heidelberg New York, pp 165–170
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Oh, SK., Pedrycz, W. (2008). Genetically Optimized Self-organizing Neural Networks Based on Polynomial and Fuzzy Polynomial Neurons: Analysis and Design. In: Abraham, A., Grosan, C., Pedrycz, W. (eds) Engineering Evolutionary Intelligent Systems. Studies in Computational Intelligence, vol 82. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75396-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-75396-4_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75395-7
Online ISBN: 978-3-540-75396-4
eBook Packages: EngineeringEngineering (R0)