Abstract
In many applications of neural networks, the performance of the network is given by the classification accuracy. While obtaining the classification accuracies, the total true classification is computed, but the number of classification rates of the classes and fault classification rates are not given. This would not be enough for a problem having fatal importance. As an implementation example, a dataset having fatal importance is classified by MLP, RBF, GRNN, PNN and LVQ networks and the real performances of these networks are found by applying ROC analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Murphy, P.M., Aha, D.W.: UCI Repository of Machine Learning Databases. University of California, Department of Information and Computer Science (ics.uci.edu), Irvine, CA
Flach, P.A.: Tutorial on The Many Faces of ROC Analysis in Machine Learning. In: The Twenty-First International Conference on Machine Learning, Banff Canada (2004)
Sboner, A., Eccher, C., Blanzieri, E., Bauer, P., Cristofolini, M., Zumiani, G., Forti, S.: A Multiple Classifier System for Early Melanoma Diagnosis. AI in Medicine 27, 29–44 (2003)
Metz, C.E.: Basic Principles of ROC Analysis. Sem. Nuc. Med., 283–298 (1978)
Pinna-Pintor, P., Bobbio, M., Colangelo, S., Veglia, F., Giammaria, M., Cuni, D., Maisano, F., Alfieri, O.: Inaccuracy of Four Coronary Surgery Risk-Adjusted Models to Predict Mortality in Individual Patients. Eur. J. Cardiothorac. Surg., 199–204 (2002)
Karabulut, H., Toraman, F., Alhan, C., Camur, G., Evrenkaya, S., Dagdelen, S., Tarcan, S.: EuroSCORE Overestimates the Cardiac Operative Risk. Cardiovasc. Surg., 295–298 (2003)
Gefeller, O., Brenner, H.: How to Correct for Chance Agreement in the Estimation of Sensitivity and Specificity of Diagnostic Tests. Methods Inf. Med., 180–186 (1994)
Gennari, J.H., Langley, P., Fisher, D.: Models of Incremental Concept Formation. Artificial Intelligence, 11-61 (1989)
Li, T., Zhu, S., Ogihara, M.: A New Distributed Data Mining Model Based on Similarity. In: Proceedings of the 2003 ACM symposium on Applied computing, Melbourne Florida, pp. 432–436 (2003)
Wei, L., Altman, R.B.: An Automated System for Generating Comparative Disease Profiles and Making Diagnoses. IEEE Transactions on Neural Networks 15, 597 (2004)
Poirazi, P., Neocleous, C., Pattichis, C.S., Schizas, C.N.: Classification Capacity of a Modular Neural Network Implementing Neurally Inspired Architecture and Training Rules. IEEE Transactıons On Neural Networks 5, 597–612 (2004)
Prechelt, L.: Summary of Usenet Discussion on Unknown Input Values in Neural Networks (1994)
Vamplew, P., Adams, A.: Missing Values in Backpropagation Neural Net. Technical Report Department of Computer Science, University of Tasmania (1993)
Efron, B.: Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation. Journal of the American Statistical Association, 316-331 (1983)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tokan, F., Türker, N., Yıldırım, T. (2006). ROC Analysis as a Useful Tool for Performance Evaluation of Artificial Neural Networks. In: Kollias, S., Stafylopatis, A., Duch, W., Oja, E. (eds) Artificial Neural Networks – ICANN 2006. ICANN 2006. Lecture Notes in Computer Science, vol 4132. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11840930_96
Download citation
DOI: https://doi.org/10.1007/11840930_96
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-38871-5
Online ISBN: 978-3-540-38873-9
eBook Packages: Computer ScienceComputer Science (R0)