Abstract
In K-nearest neighbor method (KNN), the test data is assigned to a class with the highest frequency in its nearest neighbors. One of KNN challenges is its insufficient accuracy especially for small or imbalance dataset. Recently, to tackle this challenge, extended nearest neighbor method (ENN) was proposed. ENN considers not only who the nearest neighbors of the test data are, but also who consider the test data as their nearest neighbors. KNN and ENN use hard voting to determine test data class label. In this paper, an ENN-based algorithm is proposed which uses soft or weighted voting to determine test data class label. Unlike ENN, our proposed method has no training phase, and test phase time complexity of our proposed method is better than ENN. Experiments on the real dataset show that the accuracy, test time and training time of our proposed method is better than those of ENN.
Similar content being viewed by others
References
Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13:21–27
Murphy OJ (1990) Nearest neighbor pattern classification perceptrons. Proc IEEE 78:1595–1598
Deng Z, Zhu X, Cheng D, Zong M, Zhang S (2016) Efficient kNN classification algorithm for big data. Neurocomputing 195:143–148
Dudani SA (1976) The distance-weighted k-nearest-neighbor rule. IEEE Trans Syst Man Cybern SMC-6:325–327
Gou J, Xiong T, Kuang Y (2011) A novel weighted voting for k-nearest neighbor rule. J Comput 6:833–840
Gou J, Du L, Zhang Y, Xiong T (2012) A new distance-weighted k-nearest neighbor classifier. J Inf Comput Sci 9:1429–1436
Kang P, Cho S (2008) Locally linear reconstruction for instance-based learning. Pattern Recogn 41(11):3507–3518
Jóźwik A (1983) A learning scheme for a fuzzy k-NN rule. Pattern Recogn Lett 1:287–289
Keller JM, Gray MR, Givens JA (1985) A fuzzy K-nearest neighbor algorithm. IEEE Trans Syst Man Cybern SMC-15:580–585
Bian H, Mazlack L (2003) Fuzzy-rough nearest neighbor classification approach. In: International conference of the North American fuzzy information processing society, Chicago, Illinois, USA, 2003, pp 500–505
Sarkar M (2012) Fuzzy-rough nearest neighbor algorithms in classification. Fuzzy Sets Syst 158:2134–2152
Jensen R, Cornelis C (2011) Fuzzy-rough nearest neighbour classification. Trans Rough Sets 13:56–72
Qu Y, Shang C, Shen Q, Parthaláin NM, Wu W (2011) Kernel-based fuzzy-rough nearest neighbour classification. In: Presented at the IEEE international conference on fuzzy systems Taipei, Taiwan, 2011
Hadjitodorov S (2000) An intuitionistic fuzzy version of the nearest prototype classification method, based on a moving-of-pattern procedure. Int J Gen Syst 30:155–165
Hadjitodorov S (1995) An intuitionistic fuzzy sets application to the k-NN method. Notes Intuit Fuzzy Sets 1:66–69
Kuncheva LI (1995) An intuitionistic fuzzy k-nearest neighbors rule. Notes Intuit Fuzzy Sets 1:56–60
Denoeux T (1995) A k-nearest neighbor classification rule based on Dempster–Shafer theory. IEEE Trans Syst Man Cybern 25:804–813
Destercke S (2012) A k-nearest neighbours method based on imprecise probabilities. Soft Comput 16:833–844
Chung-Hoon CHF (2003) An interval type-2 fuzzy k-nearest neighbor. In: IEEE international conference on fuzzy systems, Missouri, USA, 2003, pp 802–807
Bedzek J, Chuah SK (1986) Generalized k-nearest neighbor rules. Fuzzy Sets Syst 18:237–256
Béreau M, Dubuisson B (1991) A fuzzy extended k-nearest neighbors rule. Fuzzy Sets Syst 44:17–32
Derrac J, García S, Herrera F (2014) Fuzzy nearest neighbor algorithms: taxonomy, experimental analysis and prospects. Inf Sci 260:98–119
Yang MS, Chen CH (1998) “On the edited fuzzy K-nearest neighbor rule. IEEE Trans Syst Man Cybern Part B (Cybern) 28:461–466
Arif M, Akram MU (2010) Pruned fuzzy k-nearest neighbor classifier for beat classification. J Biomed Sci Eng 3:380–389
Han JH, Kim YK (1999) A fuzzy K-NN algorithm using weights from the variance of membership values. In: Presented at the IEEE computer society conference on computer vision and pattern recognition, 1999
Zhai JH, Li N, Zhai MY (2011) The condensed fuzzy k-nearest neighbor rule based on sample fuzzy entropy. In: Presented at the IEEE international conference on machine learning and cybernetics, 2011
Hüllermeier E (2003) Possibilistic instance-based learning. Artif Intell 148:335–383
Nikdel H, Forghani Y, Moattar SMH (2017) Ultra fuzzy k-nearest neighbors. Expert Syst. https://doi.org/10.1111/exsy.12254
Tang B, He H (2015) ENN: extended nearest neighbor method for pattern recognition [research frontier]. IEEE Comput Intell Mag 10:52–60
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pourseyyedi, M., Forghani, Y. Weighted Version of Extended Nearest Neighbors. Neural Process Lett 49, 227–237 (2019). https://doi.org/10.1007/s11063-018-9813-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-018-9813-9