Inferential Procedures for Comparing the Accuracy and Intrinsic Measures of Multivariate Receiver Operating Characteristic (MROC) Curve
DOI:
https://doi.org/10.6000/1929-6029.2015.04.01.10Keywords:
Multivariate Receiver Operating Characteristic Curve, Area Under the Curve, testing procedures.Abstract
A number of classification techniques are prevailing in literature. Of them, one of the most important techniques is the Receiver Operating Characteristic (ROC) curve. A multivariate extension of this technique is proposed in the recent years. This technique helps in classifying the objects/individuals into one of the two classes by considering two or more markers. The most important measure of an ROC curve is the Area Under the Curve (AUC) and it explains the accuracy and discriminating ability of the test under study. There are two intrinsic measures of ROC namely sensitivity (Sn) and specificity (Sp). Further, two ROC curves can be compared by comparing their measures. The practical application of the proposed inferential procedures is explained with the help of two real datasets namely, Indian Liver Patient (ILP) Dataset and Intra Uterine Growth Restricted Fetal Doppler Study (IUGRFDS) dataset. These inferential procedures are developed based on the measures of multivariate ROC (MROC) curve proposed by Sameera G, R Vishnu Vardhan and KVS Sarma [1].
References
Sameera G, Vishnu Vardhan R, Sarma KVS. Binary Classification using Multivariate Receiver Operating Characteristic Curve for Continuous Data. J Biopharm Stat 2014; Accepted for publication. DOI: https://doi.org/10.1080/10543406.2015.1052479
Green DM, Swets JA. Signal Detection theory and Psychophysics. Wiley, New York 1966.
Lusted LB. Signal detectability and medical decision making. Science 1971; 171: 1217-1219. http://dx.doi.org/10.1126/science.171.3977.1217 DOI: https://doi.org/10.1126/science.171.3977.1217
Swets JA. The Relative Operating Characteristic in psychology. Science 1973; 182: 990-1000. http://dx.doi.org/10.1126/science.182.4116.990 DOI: https://doi.org/10.1126/science.182.4116.990
Ross A, Govindarajan R. F eature Level F usion Using Hand and Face Biometrics. Appeared in Proc. of SPIE Conference on Biometric Technology for Human Identification II, (Orlando, USA) 2005; Vol. 5779: pp. 196-204. DOI: https://doi.org/10.1117/12.606093
Sinha AP, May JH. Evaluating and Tuning Predictive Data Mining Models Using Receiver Operating Characteristic Curves. Journal of Management Information Systems 2005; 21(3): 249-280. DOI: https://doi.org/10.1080/07421222.2004.11045815
Cook NR. ScD. Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction. Circulation 2007; 115: 928-935. http://dx.doi.org/10.1161/CIRCULATIONAHA.106.672402 DOI: https://doi.org/10.1161/CIRCULATIONAHA.106.672402
Krzanowski WJ, Hand DJ. ROC curves for continuous data, Monographs on Statistics and Applied Probability. CRC Press, Taylor and Francis Group. New York, NY 2009. DOI: https://doi.org/10.1201/9781439800225
Greenhouse S, Mantel N. The evaluation of diagnostic tests. Biometrics 1950; 6: 399-412. http://dx.doi.org/10.2307/3001784 DOI: https://doi.org/10.2307/3001784
Galanter G. A significance test for one parameter isosensitivity functions. Psychometrika 1967; 32: 25-33. http://dx.doi.org/10.1007/BF02289402 DOI: https://doi.org/10.1007/BF02289402
Marascuilo LA. Extensions of significance test for one-parameter signal detection hypotheses. Psychometrika 1970; 35: 237-243. http://dx.doi.org/10.1007/BF02291265 DOI: https://doi.org/10.1007/BF02291265
Metz CE, Kronman HB. Statistical Significance Tests for Binormal ROC curves. J Math Psychol 1980; 22: 218-243. http://dx.doi.org/10.1016/0022-2496(80)90020-6 DOI: https://doi.org/10.1016/0022-2496(80)90020-6
Hanley JA, Mc Neil BJ. A Meaning and Use of the area under a Receiver Operating Characteristics (ROC) Curves. Radiology 1982; 143: 29-36. http://dx.doi.org/10.1148/radiology.143.1.7063747 DOI: https://doi.org/10.1148/radiology.143.1.7063747
Hanley JA, Mc Neil BJ. A method of Comparing the Areas under Receiver Operating Characteristics Analysis derived from the same cases. Radiology 1983; 148: 839-843. http://dx.doi.org/10.1148/radiology.148.3.6878708 DOI: https://doi.org/10.1148/radiology.148.3.6878708
McClish DK. Comparing the Areas Under More Than Two Independent ROC Curves. Medical Decision Making 1987; 7: 149-155. http://dx.doi.org/10.1177/0272989X8700700305 DOI: https://doi.org/10.1177/0272989X8700700305
McClish DK. Combining and Comparing Area Estimates across Studies or Strata. Medical Decision Making 1992; 12: 274-279. http://dx.doi.org/10.1177/0272989X9201200405 DOI: https://doi.org/10.1177/0272989X9201200405
Metz CE, Herman BA, Roe CA. Statistical Comparison of Two ROC Curve Estimates Obtained from Partially-Paired Datasets. Medical Decision Making 1998; 18: 110-121. http://dx.doi.org/10.1177/0272989X9801800118 DOI: https://doi.org/10.1177/0272989X9801800118
Ramana BV, Babu MSP, Venkateswarlu NB. ILPD (Indian Liver Patient Dataset) Data Set, https://archive.ics.uci.edu/ ml/datasets/ILPD+(Indian+Liver+Patient+Datset); 2012.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2015 R. Vishnu Vardhan, G. Sameera, P.A. Chandrasekharan, Thulasi Beere
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Policy for Journals/Articles with Open Access
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are permitted and encouraged to post links to their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work
Policy for Journals / Manuscript with Paid Access
Authors who publish with this journal agree to the following terms:
- Publisher retain copyright .
- Authors are permitted and encouraged to post links to their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work .
