Abstract
Interpretation of models induced by artificial neural networks is often a difficult task. In this paper we focus on a relatively novel neural network architecture and learning algorithm, bp-som that offers possibilities to overcome this difficulty. It is shown that networks trained with BP-SOM show interesting regularities, in that hidden-unit activations become restricted to discrete values, and that the som part can be exploited for automatic rule extraction.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Andrews, R., Diederich, J., and Tickle, A. B. (1995). A Survey And Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks. Knowledge Based System, 8:6, 373–389.
Hinton, G. E. (1986). Learning distributed representations of concepts. In Proceedings of the Eighth Annual Conference of the Cognitive Science Society, 1–12. Hillsdale, NJ: Erlbaum.
Kohonen, T. (1989). Self-organisation and Associative Memory. Berlin: Springer Verlag.
Rumelhart, D. E., Hinton, G. E., and Williams, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart and J. L. McClelland (Eds.), Parallel Distributed Processing, Vol. 1: Foundations (pp. 318–362). Cambridge, MA: The MIT Press.
Thrun, S. B., et. al (1991). The MONK's Problems: a performance comparison of different learning algorithms. Technical Report CMU-CS-91-197, Carnegie Mellon University.
Weijters, A. (1995). The BP-SOM architecture and learning rule. Neural Processing Letters, 2, 13–16.
Weijters, A., Van den Bosch, A., Van den Herik, H. J. (1997). Behavioural Aspects of Combining Backpropagation Learning and Self-organizing Maps. Connection Science, 9, 235–252.
Weijters, A., Van den Herik, H. J., Van den Bosch, A., and Postma, E. O. (1997). Avoiding overfitting with BP-SOM. Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, IJCAI'97, San Francisco, Morgan Kaufmann, 1140–1145.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Weijters, T., van den Bosch, A., van den Herik, J. (1998). Interpretable neural networks with BP-SOM. In: Nédellec, C., Rouveirol, C. (eds) Machine Learning: ECML-98. ECML 1998. Lecture Notes in Computer Science, vol 1398. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0026711
Download citation
DOI: https://doi.org/10.1007/BFb0026711
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64417-0
Online ISBN: 978-3-540-69781-7
eBook Packages: Springer Book Archive