Published by Oxford University Press 2005.
On criteria for evaluating models of absolute risk
Biostatistics Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Executive Plaza South, EPS 8032, Bethesda, MD 20892-7244, USA
* To whom correspondence should be addressed. gailm{at}mail.nih.gov
Absolute risk is the probability that an individual who is free of a given disease at an initial age, a, will develop that disease in the subsequent interval (a, t]. Absolute risk is reduced by mortality from competing risks. Models of absolute risk that depend on covariates have been used to design intervention studies, to counsel patients regarding their risks of disease and to inform clinical decisions, such as whether or not to take tamoxifen to prevent breast cancer. Several general criteria have been used to evaluate models of absolute risk, including how well the model predicts the observed numbers of events in subsets of the population (‘calibration’), and ‘discriminatory power,’ measured by the concordance statistic. In this paper we review some general criteria and develop specific loss function-based criteria for two applications, namely whether or not to screen a population to select subjects for further evaluation or treatment and whether or not to use a preventive intervention that has both beneficial and adverse effects. We find that high discriminatory power is much more crucial in the screening application than in the preventive intervention application. These examples indicate that the usefulness of a general criterion such as concordance depends on the application, and that using specific loss functions can lead to more appropriate assessments.
Keywords: Absolute risk model; Accuracy; Loss functions for clinical decisions; Negative predictive value; Positive predictive value; ROC curve
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  S. G. Baker Putting Risk Prediction in Perspective: Relative Utility Curves J Natl Cancer Inst, November 18, 2009; 101(22): 1538 - 1542. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. H. Gail Response J Natl Cancer Inst, November 9, 2009; (2009) djp393v2. [Full Text] [PDF]
|
|
|
|
 |
|
 S.F.P.J. Coppus, F. van der Veen, B.C. Opmeer, B.W.J. Mol, and P.M.M. Bossuyt Evaluating prediction models in reproductive medicine Hum. Reprod., August 1, 2009; 24(8): 1774 - 1778. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. H. Gail Value of Adding Single-Nucleotide Polymorphism Genotypes to a Breast Cancer Risk Model J Natl Cancer Inst, July 1, 2009; 101(13): 959 - 963. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Hippisley-Cox, C. Coupland, J. Robson, A. Sheikh, and P. Brindle Predicting risk of type 2 diabetes in England and Wales: prospective derivation and validation of QDScore BMJ, March 17, 2009; 338(mar17_2): b880 - b880. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. A. Beam, W. Gao, V. Macias, W. Liang, and A. Kajdacsy Balla Sequential Testing Approach As an Efficient and Easier Alternative for the Validation of New Predictive Technologies in the Clinic J. Clin. Oncol., March 1, 2009; 27(7): 1087 - 1090. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. S. Pepe and H. E. Janes Gauging the Performance of SNPs, Biomarkers, and Clinical Factors for Predicting Risk of Breast Cancer J Natl Cancer Inst, July 16, 2008; 100(14): 978 - 979. [Full Text] [PDF]
|
|
|
|
|
|
M. H. Gail Discriminatory Accuracy From Single-Nucleotide Polymorphisms in Models to Predict Breast Cancer Risk J Natl Cancer Inst, July 16, 2008; 100(14): 1037 - 1041. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Hippisley-Cox, C. Coupland, Y. Vinogradova, J. Robson, R. Minhas, A. Sheikh, and P. Brindle Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2 BMJ, June 28, 2008; 336(7659): 1475 - 1482. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. H. Gail, L. Bernstein, J. P. Costantino, D. Pee, and G. Ursin Response:Re: Projecting Individualized Absolute Invasive Breast Cancer Risk in African American Women J Natl Cancer Inst, May 7, 2008; 100(9): 684 - 684. [Full Text] [PDF]
|
|
|
|
 |
|
 M. S. Pepe, Z. Feng, Y. Huang, G. Longton, R. Prentice, I. M. Thompson, and Y. Zheng Integrating the Predictiveness of a Marker with Its Performance as a Classifier Am. J. Epidemiol., February 1, 2008; 167(3): 362 - 368. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J Hippisley-Cox, C Coupland, Y Vinogradova, J Robson, and P Brindle Performance of the QRISK cardiovascular risk prediction algorithm in an independent UK sample of patients from general practice: a validation study Heart, January 1, 2008; 94(1): 34 - 39. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. H. Gail, J. P. Costantino, D. Pee, M. Bondy, L. Newman, M. Selvan, G. L. Anderson, K. E. Malone, P. A. Marchbanks, W. McCaskill-Stevens, et al. Projecting Individualized Absolute Invasive Breast Cancer Risk in African American Women J Natl Cancer Inst, December 5, 2007; 99(23): 1782 - 1792. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. M Ridker, J. E. Buring, N. Rifai, and N. R. Cook Development and Validation of Improved Algorithms for the Assessment of Global Cardiovascular Risk in Women: The Reynolds Risk Score JAMA, February 14, 2007; 297(6): 611 - 619. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Chen, D. Pee, R. Ayyagari, B. Graubard, C. Schairer, C. Byrne, J. Benichou, and M. H. Gail Projecting absolute invasive breast cancer risk in white women with a model that includes mammographic density. J Natl Cancer Inst, September 6, 2006; 98(17): 1215 - 1226. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 N. R. Cook, J. E. Buring, and P. M Ridker The Effect of Including C-Reactive Protein in Cardiovascular Risk Prediction Models for Women Ann Intern Med, July 4, 2006; 145(1): 21 - 29. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. A. Cronin, M. H. Gail, Z. Zou, P. B. Bach, J. Virtamo, and D. Albanes Validation of a model of lung cancer risk prediction among smokers. J Natl Cancer Inst, May 3, 2006; 98(9): 637 - 640. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. H. Gail and R. M. Pfeiffer Response to Rockhill's letter to the editor Biostat., July 1, 2005; 6(3): 503 - 504. [Full Text] [PDF]
|
|
|
|
|
|
B. Rockhill Letter to the editor Biostat., July 1, 2005; 6(3): 500 - 502. [Full Text] [PDF]
|
|