Abstract
The paper introduces a new extension of the ontogenic Self-Optimizing Neural Networks (SONNs)[4] making possible to optimize a neural network (NN) topology for a whole training data (TR) set at once. The classical SONNs optimize a NN topology only for subnetworks related to trained classes. The described SONN extension enables to optimize topology for all classes at once. Moreover, this extension makes possible to compute a minimal SONN topology for given TD which can be sometimes insufficient in view of generalization. The SONN extension computes better discrimination coefficients and automatically develops the topology that reflects all well-discriminative data features into the NN topology in order to achieve a good generalization property. Furthermore, the SONN extension can also automatically reduce the input dimension space of any TD and automatically recognize and correctly classify inverted inputs (especially important for image classification). All extended SONN computations are fully automatic and deterministic. There is no need to use any parameters given by user. The SONNs are free from many training problems, e.i. initiation, convergence, overfitting. The extended SONNs can be also used to unsupervised training.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Duch, W., Korbicz, J., Rutkowski, L., Tadeusiewicz, R. (eds.): Biocybernetics and Biomedical Engineering. Neural Networks, EXIT Warsaw 6, 257–566 (2000)
Dudek-Dyduch, E., Horzyk, A.: Analytical Synthesis of Neural Networks for Selected Classes of Problems. In: Bubnicki, Z., Grzech, A. (eds.) Knowlege Engineering and Experts Systems. OWPN Wroclaw, pp. 194–206 (2003)
Fiesler, E., Beale, R. (eds.): Handbook of Neural Computation, B3–C1. IOP Publishing Ltd and Oxford University Press, Bristol & New York (1997)
Horzyk, A., Tadeusiewicz, R.: Self-Optimizing Neural Networks. In: Yin, F., Wang, J., Guo, C. (eds.) Advances in Neural Networks - ISNN 2004, pp. 150–155. Springer, Heidelberg (2004)
Tadeusiewicz, R., Ogiela, M.R.: Machine Perception and Automatic Understanding of Medical Visualization. In: Damczyk, M. (ed.) Automatic Image Processing in Production Process, Second Polish-German Seminar, CAMT, Wroclaw, pp. 39–48 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Horzyk, A. (2005). A New Extension of Self-optimizing Neural Networks for Topology Optimization. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds) Artificial Neural Networks: Biological Inspirations – ICANN 2005. ICANN 2005. Lecture Notes in Computer Science, vol 3696. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550822_65
Download citation
DOI: https://doi.org/10.1007/11550822_65
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28752-0
Online ISBN: 978-3-540-28754-4
eBook Packages: Computer ScienceComputer Science (R0)