Abstract
In the paper, we present the model of a context-dependent neural net - a net which may change the way it works according to the external conditions. The information about the environmental conditions is fed to the net through the context inputs, which are used to calculate the net’s weights, and as a consequence modify the way the net reacts to the traditional inputs.
We discuss the Vapnik-Chervonenkis dimension of such a neuron and show that the separating power of a context-dependent neuron and multilayer net grows with the number of adjustable parameters. We present the difference in the way traditional and context-dependent nets work and compare the input space transformations both of them are able to perform. We also show that context-dependent nets learn faster than traditional ones with the same VC-dimension.
Paper supported by Wrocław University of Technology grant no. 332291
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Turney P.: The Identification of Context-Sensitive Features: A Formal Definition of Context for Concept Learning, Proc. of 13th International Conference on Machine Learning (ICML96), Workshop on Learning in Context-Sensitive Domains, Bari, Italy, 1996
Turney P.: The Management of Context-Sensitive Features: A Review of Strategies, Proc. of ICML96, Bari, Italy, 1996
Turney P.: Exploiting context when learning to classify, Proc. of ICML93, Springer-Verlag
Harries M., Sammut C., Horn K.: Extracting hidden contexts, Machine Learning 32
Yeung D.T., Bekey G.A.: Using a context-sensitive learning to robot arm control, Proc. IEEE Int. Conf. on Robotics and Automation, pp 1441–1447, 1989
Anthony M., Bartlett P.L.: Neural Network Learning: Theoretical Foundations, Cambridge University Press, 1999, Cambridge
Rafajłowicz E.: Context Dependent Neural Nets-Problem Statement and Examples (Part 1), Learning (Part 2), Proc. of 3rd Conference Neural Networks and Their Applications, Zakopane, Poland, 1999
Ciskowski P., Rafajłowicz E.: Context Dependent Neural Nets-Structures and Learning, to be published in IEEE Trans. on Neural Networks
Watrous R.L., Towell G.: A Patient-Adaptive Neural Network ECG Patient Monitoring Algorithm. In Proc. Computers in Cardiology 1995, Vienna, Austria.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ciskowski, P. (2001). VC-Dimension of a Context-Dependent Perceptron. In: Akman, V., Bouquet, P., Thomason, R., Young, R. (eds) Modeling and Using Context. CONTEXT 2001. Lecture Notes in Computer Science(), vol 2116. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44607-9_36
Download citation
DOI: https://doi.org/10.1007/3-540-44607-9_36
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42379-9
Online ISBN: 978-3-540-44607-1
eBook Packages: Springer Book Archive