Abstract
In this paper we introduce the supervised classification algorithm called Box algorithm based on feature space partitioning. The construction of Box algorithm is closely linked to the solution of computational geometry problem involving heuristic maximal clique cover problem satisfying the k-nearest neighbor rule. We first apply a heuristic algorithm to partition a graph into a minimal number of maximal cliques and subsequently the cliques are merged by means of the k-nearest neighbor rule. The main advantage of the new approach is decomposition of the l-class problem (\(l > 2\)) into l single-class optimization problems. The performance of the Box algorithm is demonstrated to be significantly better than SVM in computer experiments involving real Monk’s dataset from UCI depository and simulated normal data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bentley J (1975) Multidimensional binary search trees used for associative searching. Commun ACM 18:509–517
Cheng H, Vua K, Huaa K (2009) Subspace projection: a unified framework for a class of partition-based dimension reduction techniques. Inf Sci 179:1234–1248
Güvenir H, Emeksiz N, Ikizler N, Ormeci N (2004) Diagnosis of gastric carcinoma by classification on feature projections. Artif Intell Med 23:231–240
Güvenir H, Sirin I (1966) Classification by feature partitioning. Mach Learn 23:47–67
Iovanella A, Scoppola B, Scoppola E (2007) Some spin glass ideas applied to the clique problem. J Stat Phys 126:895–915
Kumar K, Negi A (2007) A feature partitioning approach to subspace classification. In: Proceedings of the TENCON IEEE conference, pp 1–4
Kumar K, Negi A (2007) A novel approach to eigenpalm features using feature-partitioning framework. In: Proceedings of the international conference on machine vision applications, Tokyo, pp 29–32
Kumar K, Negi A (2008) Novel approaches to principal component analysis of image data based on feature partitioning framework. Pattern Recogn Lett 29:254–264
Kumar K, Negi A (2008) SubXPCA and a generalized feature partitioning approach to principal component analysis. Pattern Recogn 41:1398–1409
Kumlander D (2005) Problems of optimization: an exact algorithm for finding a maximum clique optimized for dense graphs. In: Proceedings of the Estonian academy of sciences, physics, mathematics, vol 54, pp 79–86
Nene S, Nayar S (1997) A simple algorithm for nearest neighbor search in high dimensions. IEEE Trans Pattern Anal Mach Intell 19:989–1003
Pelillo M, Torsello A (2006) Payoff-monotonic game dynamics and the maximum clique problem. Neural Comput 18:1215–1258
Valev V (2004) Supervised pattern recognition by parallel feature partitioning. Pattern Recogn 37:463–467
Valev V (2004) Supervised pattern recognition with heterogeneous features. Int J Mach Graph Vis 13:345–353
Valev V (2011) Machine learning of syndromes for different types of features. In: Proceedings of the international conference on high performance computing and simulation, pp 504–509
Valev V (2014) From binary features to non-reducible descriptors in supervised pattern recognition problems. Pattern Recogn Lett 45:106–114
Valev V, Yanev N (2012) Classification using graph partitioning. In: Proceedings of the 21st international conference on pattern recognition. IEEE Xplore, Tsukuba, Japan, pp 1261–1264
Valev V, Yanev N, Krzyżak A (2016) A new geometrical approach for solving the supervised pattern recognition problem. In: Proceedings of the 23rd international conference on pattern recognition. IEEE Xplore, Cancun, Mexico, pp 1648–1652
Wang H, Obremski T, Alidaee B, Kochenberger G (2008) Clique partitioning for clustering. Commun Stat - Simul Comput 37:1–13
Wang R, Tang Z, Cao Q (2003) An efficient approximation algorithm for finding a maximum clique using hopfield network learning. Neural Comput 15:1605–1619
Yanev N, Balev S (1999) A combinatorial approach to the classification problem. Eur J Oper Res 115:339–350
Yang G, Tang Z, Zhang Z, Zhu Y (2007) A flexible annealing chaotic neural network to maximum clique problem. Int J Neural Syst 17:183–192
Acknowledgments
Research of N. Yanev was partially supported by the French-Bulgarian contract “RILA”, 01/4, 2018. Research of A. Krzyżak was supported by the Natural Sciences and Engineering Research Council under Grant RGPIN-2015-06412. K. Ben Suliman research was supported by the Libyan Government.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Valev, V., Yanev, N., Krzyżak, A., Ben Suliman, K. (2020). Supervised Classification Box Algorithm Based on Graph Partitioning. In: Burduk, R., Kurzynski, M., Wozniak, M. (eds) Progress in Computer Recognition Systems. CORES 2019. Advances in Intelligent Systems and Computing, vol 977. Springer, Cham. https://doi.org/10.1007/978-3-030-19738-4_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-19738-4_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-19737-7
Online ISBN: 978-3-030-19738-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)