Abstract
Receiver Operating Characteristic (ROC) analysis is a powerful tool to evaluate, view and compare diagnostic tests by a discriminating way. Currently there several ROC analysis tools, but none is known, by containing all the features necessary for a full investigation.
In this work we determined the performance of Comp2ROC package (R package) and its functionality by performing comparative diagnostic systems based on empirical ROC curves for unpaired and paired samples. We compare this package with the functionality of IBM® SPSS® Statistics to analyse ROC curve, in order to determine whether it has better ability to execute both the level of performance as a result.
For illustrative purpose we use a random sample of clinical indexes used in neonatal intensive care to evaluate the risk of death for newborns with very low birth weight (VLBW) (\(<1500\)g) and/or gestational age \(<32\) weeks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Egan, J.P.: Signal detection theory and ROC analysis. Academic Press, New York (1975)
Metz, C.E.: Statistical analysis of ROC Data in evaluating diagnostic performance in multiple regression analysis: applications in the health sciences. In: Herbert, D.E., Myers, R.H. (eds.), vol. 13, pp. 365–384. American Institute of Physics (1986)
Gastwirth, J.L.: A general definition of the Lorenzcurve. Econometrica 39(6), 1037–1039 (1971)
Mylne, K.R.: Decision-making from probability forecasts based on forecast value. Meteorological Applications 9, 307–315 (2002)
Hanley, J.A., McNeil, B.J.: The Meaning and Use of the Area under a Receiver Operating Characteristic ROC Curve. Radiology 143, 29–36 (1982)
Hanley, J.A., McNeil, B.J.: A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148, 839–843 (1983)
Robin, X., Turk, N., Heinard, A., Tibertini, N., Lisacek, F., Sanchez, J.C., Müller, M.: pROC: an open-source package for R and S\(+\) to analyze and compare ROC curves. BMC Bioinformatics 12, 77 (2011)
Stephan, C., Wesseling, S., Schink, T., Jung, K.: Comparison of eight computer programs for receiver-operating characteristic analysis. Clinical Chemistry 49(3), 4331–7439 (2003)
Brown, C.D., Davis, H.T.: Receiver operating characteristics curves and related decision measures: A tutorial. Chemometrics and Intelligent Laboratory Systems 80, 241–738 (2006)
Braga, A., Costa, L., Oliveira, P.: An alternative method for global and partial comparasion of two diagnostic system based on ROC curves. Journal of Statistical Computation and Simulation 83(2), 307–325 (2013)
Frade, H., Braga, A.C.: Comp2ROC: R package to compare two ROC curves. In: Mohamad, M.S., Nanni, L., Rocha, M.P., Fdez-Riverola, F. (eds.) 7th International Conference on Practical Applications of Computational Biology & Bioinformatics. AISC, vol. 222, pp. 127–135. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Coelho, S., Braga, A.C. (2015). Performance Evaluation of Two Software for Analysis Through ROC Curves: Comp2ROC vs SPSS. In: Gervasi, O., et al. Computational Science and Its Applications -- ICCSA 2015. ICCSA 2015. Lecture Notes in Computer Science(), vol 9156. Springer, Cham. https://doi.org/10.1007/978-3-319-21407-8_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-21407-8_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-21406-1
Online ISBN: 978-3-319-21407-8
eBook Packages: Computer ScienceComputer Science (R0)