Abstract
Local learning methods approximate a target function (a posteriori probability) by partitioning the input space into a set of local regions, and modeling a simple input-output relationship in each one. In order for local learning to be effective for pattern classification in high dimensional settings, regions must be chosen judiciously to minimize bias. This paper presents a novel region partitioning criterion that attempts to minimize bias by capturing differential relevance in input variables in an efficient way. The efficacy of the method is validated using a variety of real and simulated data.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
R.E. Bellman, Adaptive Control Processes. Princeton Univ. Press, 1961.
L. Bottou and V. Vapnik, Local learning algorithms. Neural Computation, 4(6), 888–900, 1992.
L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone, Classification and Regression Trees. Wadsworth, 1984.
W.S. Cleveland and S.J. Devlin, Locally weighted regression: An approach to regression analysis by local fitting. J. Amer. Statist. Assoc. 83, 596–610, 1988.
J.H. Friedman, Flexible metric nearest neighbor classification. Tech. Report, Dept. of Statistics, Stanford University, Stanford, CA 94305, 1994.
J.H. Friedman, Local Learning Based on Recursive Covering. Tech. Report, Dept. of Statistics, Stanford University, Stanford, CA 94305, 1996.
M.I. Jordan and R.A. Jacobs, Hierarchical mixtures of experts and the EM algorithm. Neural Computation 6, 181, 1994.
P.M. Murphy and D.W. Aha, UCI repository of machine learning databases. http://www.cs.uci.edu/-mlearn/MLRepository.html, 1995.
J. Peng, Efficient Memory-Based Dynamic Programming. Proceedings of the 12th International Conference on Machine Learning, 438–446, 1995.
J.R. Quinlin, C4.5: Programs for Machine Learning. Morgan-Kaufmann Publishers, Inc., 1993.
L.E. Scales, Introduction to Non-Linear Optimization. New York: Springer-Verlag, 1985.
C.J. Stone, Nonparametric regression and its applications (with discussion). Ann. Statist. 5, 595, 1977.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Peng, J., Bhanu, B. (1998). Pattern classification based on local learning. In: Amin, A., Dori, D., Pudil, P., Freeman, H. (eds) Advances in Pattern Recognition. SSPR /SPR 1998. Lecture Notes in Computer Science, vol 1451. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0033315
Download citation
DOI: https://doi.org/10.1007/BFb0033315
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64858-1
Online ISBN: 978-3-540-68526-5
eBook Packages: Springer Book Archive