Abstract
The classification problem is of major importance to a plethora of research fields. The outgrowth in the development of classification methods has led to the development of several techniques. The objective of this research is to provide some insight on the relative performance of some well-known classification methods, through an experimental analysis covering data sets with different characteristics. The methods used in the analysis include statistical techniques, machine learning methods and multicriteria decision aid. The results of the study can be used to support the design of classification systems and the identification of the proper methods that could be used given the data characteristics.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Breiman L., Friedman J., Olshen R., Stone and C.J. (1984). Classification and Regression Trees. Chapman and Hall, New York
Cohen J. (1988). Statistical Power Analysis for the Behavioral Sciences, second edition. Academic Press, New York
Dietterich, T.G. (2000), Ensemble methods in machine learning. In: First International Workshop on Multiple Classifier Systems (Lecture Notes in Computer Science). Kittler, J. and Roli, F. (eds.), Springer Verlag, New York, pp. 1–15
Dietterich T.G. and Bakiri G. (1995). Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 2: 263–286
Doumpos M. and Zopounidis C. (2002). Multicriteria Decision Aid Classification Methods. Kluwer Academic Plublishers, Dordrecht
Duda R.O., Hart P.E. and Stork D.G. (2001). Pattern Classification, second edition. John Wiley, New York
Freed N. and Glover F. (1986). Evaluating alternative linear programming models to solve the two-group discriminant problem. Decision Sciences 17: 151–162
Joachimsthaler E.A., Stam and A. (1988). Four approaches to the classification problem in discriminant analysis: An experimental study. Decision Sciences 19: 322–333
John, G.E., Kohavi, R. and Pfleger, K. (1994), Irrelevant attributes and the subset selection problem. In: Machine Learning: Proceedings of the 11th International Conference. Cohen, W.W. and Hirsh, H. (eds.), Morgan Kaufmann, San Francisco, 121–129.
Lam K.F. and Moy J.W. (1997). An experimental comparison of some recently developed linear programming approaches to the discriminant problem. Computer and Operations Research 24: 593–599
Östermark R. and Höglund R. (1998). Addressing the multigroup discriminant problem using multivariate statistics and mathematical programming. European Journal of Operational Research 108: 224–237
Pawlak Z. (1982). Rough sets. International Journal of Information and Computer Sciences 11: 341–356
Ripley B.D. (1996). Pattern Recognition and Neural Networks. Cambridge University Press, Cambridge
Rubin P.A. (1990). A comparison of linear programming and parametric approaches to the two-group discriminant problem. Decision Sciences 21: 373–386
Sandri L. and Marzocchi W. (2004). Testing the performance of some nonparametric pattern recognition algorithms in realistic cases. Pattern Recognition 37: 447–461
Schölkopf B. and Smola A.J. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, Cambridge
Stam A. (1997). Nontraditional approaches to statistical classification: Some perspectives on L p -norm methods. Annals of Operations Research 74: 1–36
Specht D. (1990). Probabilistic neural networks. Neural Networks 3: 109–118
Sueyoshi T. (2006). DEA discriminant analysis: methodological comparison among eight discriminant. European Journal of Operational Research 169: 247–272
Vapnik V.N. (1998). Statistical Learning Theory. John Wiley, New York
Wong M.A. and Lane T. (1983). A kth nearest neighbor clustering procedure. Journal of the Royal Statistical Society B 45: 362–368
Yandell B.S. (1977). Practical Data Analysis for Designed Experiments. Chapman and Hall, London
Zopounidis C. and Doumpos M. (2002). Multicriteria classification and sorting methods: a literature review. European Journal of Operational Research 138: 229–246
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Doumpos, M., Chatzi, E. & Zopounidis, C. An Experimental Evaluation of Some Classification Methods. J Glob Optim 36, 33–50 (2006). https://doi.org/10.1007/s10898-005-6152-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-005-6152-y