Synonyms
k-nearest neighbor classification; k-NN classification; NN classification
Definition
Nearest neighbor classification is a machine learning method that aims at labeling previously unseen query objects while distinguishing two or more destination classes. As any classifier, in general, it requires some training data with given labels and, thus, is an instance of supervised learning. In the simplest variant, the query object inherits the label from the closest sample object in the training set. Common variants extend the decision set from the single nearest neighbor within the training data to the set of k nearest neighbors for any k > 1. The decision rule combines the labels from these kdecision objects, either by simple majority voting or by any distance-based or frequency-based weighting scheme, to decide the predicted label for the query object. Mean-based nearest neighbor classifiers group the training data and work on the means of classes rather than on the individual...
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsRecommended Reading
Ankerst M, Kastenmuller G, Kriegel H-P, Seidl T. Nearest neighbor classification in 3D protein databases. In: Proceedings of the 7th International Conference on Intelligent Systems for Molecular Biology; 1999. p. 34–43.
Athistos V. Nearest neighbor retrieval and classification. 2007. Available at: http://cs-people.bu.edu/athitsos/nearest-neighbors/
Djouadi A, Bouktache E. A fast algorithm for the nearest-neighbor classifier. IEEE Trans Pattern Anal Mach Intell. 1997;19(3):277–82.
Duda RO, Hart PE, Stork DG. Pattern classification. 2nd ed. New York: Wiley; 2001.
Efros AA, Berg AC, Mori G, Malik J. Recognizing action at a distance. In: Proceedings of the 9th IEEE Conference on Computer Vision; 2003. p. 726–33.
Ghosh AK, Chaudhuri P, Murthy CA. On visualization and aggregation of nearest neighbor classifiers. IEEE Trans Pattern Anal Mach Intell. 2005;27(10):1592–602.
Han J, Kamber M. Data mining, concepts and techniques. 2nd ed. Amsterdam: Elsevier; 2006.
Hastie T, Tibshirami R, Friedman J. The elements of statistical learning: data mining. Inference and prediction. Springer series in statistics. New York: Springer; 2001.
Kriegel H-P, Pryakhin A, Schubert M. Multi-represented kNN-classification for large class sets. In: Proceedings of the 10th International Conference on Database Systems for Advanced Applications; 2005. p. 511–22.
Li Y, Yang J, Han J. 1Continuous K-nearest neighbor search for moving objects. In: Proceedings of the 16th International Conference on Scientific and Statistical Database Management; 2004. p. 123–6.
Shibata T, Kato T, Wada TK-D. Decision tree: an accelerated and memory efficient nearest neighbor classifier. In: Proceedings of the 2003 IEEE International Conference on Data Mining; 2003. p. 641–4.
Veenman CJ, Reinders MJT. The nearest subclass classifier: a compromise between the nearest mean and nearest neighbor classifier. IEEE Trans Pattern Anal Mach Intell. 2005;27(9):1417–29.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer Science+Business Media, LLC, part of Springer Nature
About this entry
Cite this entry
Seidl, T. (2018). Nearest Neighbor Classification. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_561
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8265-9_561
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8266-6
Online ISBN: 978-1-4614-8265-9
eBook Packages: Computer ScienceReference Module Computer Science and Engineering