Seminars in Roentgenology
Volume 44, Issue 3 , Pages 170-179 , July 2009

Evidence-based Radiology: Step 3—Diagnostic Systematic Review and Meta-analysis (Critical Appraisal)

  • Ben A. Dwamena, MD

      Affiliations

    • Department of Radiology, Division of Nuclear Medicine, University of Michigan, Medical Center. Ann Arbor, MI
    • Nuclear Medicine Service, Veterans Administration Medical Center, Ann Arbor, MI
    • Corresponding Author InformationAddress reprint requests to Ben A. Dwamena, MD, Department of Radiology, Division of Nuclear Medicine, University of Michigan, Medical Center, 1500 E Medical Center Drive, Room B1G505, Ann Arbor, MI

References 

  1. Leeflang M, Deeks J, Gatsonis C, et al. Systematic reviews of diagnostic test accuracy. Ann Intern Med. 2008;149:889–897
  2. Bachmann LM, Coray R, Estermann P, et al. Identifying diagnostic studies in MEDLINE: reducing the number needed to read. J Am Med Inform Assoc. 2002;9:653–658
  3. Haynes R, Wilczynski N. Optimal search strategies for retrieving scientifically strong studies of diagnosis from MEDLINE: Analytical survey. BMJ. 2004;328:1040
  4. Doust J, Pietrzak E, Sanders S, et al. Identifying studies for systematic reviews of diagnostic tests was difficult due to the poor sensitivity and precision of methodologic filters and the lack of information in the abstract. J Clin Epidemiol. 2005;58:444–449
  5. Leeflang M, Scholten R, Rutjes A, et al. Use of methodological search filters to identify diagnostic accuracy studies can lead to the omission of relevant studies. J Clin Epidemiol. 2006;59:234–240
  6. Whiting P, Rutjes A, Reitsma J, et al. Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med. 2004;140:189–202
  7. Whiting P, Rutjes AWS, Reitsma JB, et al. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003;3:25
  8. Whiting P, Rutjes AWS, Dinnes J, et al. Development and validation of methods for assessing the quality of diagnostic accuracy studies. Health Technol Assess. 2004;8:iii1–iii234
  9. Lijmer JG, Bossuyt PM, Heisterkamp SH. Exploring sources of heterogeneity in systematic reviews of diagnostic tests. Stat Med. 2002;21:1525–1537
  10. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005;58:882–893
  11. Alderson P, Green S, Higgins JP. Cochrane Reviewers' Handbook 4.2.2. The Cochrane Library, Issue 1. Bloomfield, UK: John Wiley & Sons; 2004;
  12. Richardson WSM, Wilson MCM, Nishikawa JM, et al. The well-built clinical question: a key to evidence-based decisions. ACP J Club. 1995;123:A12–A13
  13. Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. Ann Intern Med. 2003;138:40–44
  14. Glasziou P. Which methods for bedside Bayes?. ACP J Club. 2001;135:A11–A12
  15. Hopewell S, Clarke M, Stewart L, et al. Time to publication for results of clinical trials (The Cochrane Library no 4). Chinchester, UK: Cochrane Library; 2003;
  16. Simes RJ. Publication bias: the case for an international registry of clinical trials. J Clin Oncol. 1986;4:1529–1541
  17. Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests. [Comment] [erratum appears in, JAMA 283:1963, 2000] JAMA. 1999;282:1061–1066
  18. British Library Net. http://www.britishlibrary.net/medicine.html
  19. United States National Library of Medicine: GATEWAY. http://gateway.nlm.nih.gov/gw/Cmd
  20. Deville WL, Buntinx F. Guidelines for conducting systematic reviews of studies evaluating the accuracy of diagnostic tests. In:  Knottnerus JA editors. The Evidence Base of Clinical Diagnosis. London, UK: BMJ Books Publishing; 2002;p. 145–166
  21. Deville WL, Buntinx F, Bouter LM, et al. Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol. 2002;2:9–10
  22. Richie G, Glanville T, Lefebvre C. Do published search filters to identify diagnostic test accuracy studies perform adequately?. Health Info Libr J. 2007;24:188–192
  23. Bayliss SE, Davenport C. Locating systematic reviews of test accuracy studies: how five specialist review databases measure up. Int J Technol Assess Health Care. 2008;24:403–411
  24. Egger M, Smith GD, Phillips AN. Meta-analysis: principles and procedures. BMJ. 1997;315:1533–1537
  25. Whiting P, Harbord R, Kleijnen J. No role for quality scores in systematic reviews of diagnostic accuracy studies. BMC Med Res Methodol. 2005;5:19
  26. Whiting PF, Weswood ME, Rutjes AWS, et al. Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Med Res Methodol. 2006;6:9
  27. Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993;12:1293–1316
  28. Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Mak. 1993;13:313–321
  29. Arends LR, Hamza TH, Houwelingen JC, et al. Bivariate random effects Meta-analysis of ROC curves. Med Decis Mak. 2008;28:621–628
  30. Rutter CM, Gatsonis CA. Regression methods for meta-analysis of diagnostic test data. Acad Radiol. 1995;2(suppl 1):S48–S56
  31. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20:2865–2884
  32. Macaskill P. Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. J Clin Epidemiol. 2004;57:925–932
  33. Reitsma JB, Glas AS, Rutjes AWS, et al. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58:982–990
  34. Riley RD, Abrams KR, Lambert PC, et al. An evaluation of bivariate random-effects meta-analysis for the joint synthesis of two correlated outcomes. Stat Med. 2007;26:78–97
  35. Riley RD, Abrams KR, Sutton AJ, et al. Bivariate random-effects meta-analysis and the estimation of between-study correlation. BMC Med Res Methodol. 2007;7:3
  36. Riley RD, Thompson JR, Abrams KR. An alternative model for bivariate random-effects meta-analysis when the within-study correlations are unknown. Biostatistics. 2008;9:172–186
  37. Chu H, Cole SR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. 2006;59:1331–1332
  38. Harbord RM, Deeks JJ, Egger M, et al. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics. 2007;8:239–251
  39. van Houwelingen HC, Zwinderman KH, Stijnen T. A bivariate approach to meta-analysis. Stat Med. 1993;12:2273–2284
  40. van Houwelingen HC, Arends LR, Stijnen T. Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med. 2002;21:589–624
  41. Rabe-Hesketh S. GLLAMM manual (Working Paper Number 160). University of California–Berkeley: Division of Biostatistics; 2004;
  42. Rabe-Hesketh S, Skrondal A, Pickles A. Reliable estimation of generalized linear mixed models using adaptive quadrature. Stata J. 2002;2:1–21
  43. Swets JA. Measuring the accuracy of diagnostic systems. Science. 1988;240:1285–1293
  44. Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21:1539–1558
  45. Light L, Pillemer D. Summing Up: The Science of Reviewing research. Cambridge, MA: Harvard University Publishing; 1984;
  46. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50:1088–1101
  47. Egger M, Smith GD. Bias in location and selection of studies. BMJ. 1998;316:61–66
  48. Harbord RM, Egger M, Sterne JAC. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med. 2006;25:3443–3457
  49. Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Stat Med. 2001;20:641–654
  50. Peters JL, Sutton AJ, Jones DR, et al. Comparison of two methods to detect publication bias in meta-analysis. JAMA. 2006;295:676–680
  51. Rucker G, Schwarzer G, Carpenter J. Arcsine test for publication bias in meta-analyses with binary outcomes. Stat Med. 2008;27:746–763
  52. Schwarzer G. A test for publication bias in meta-analysis with sparse binary data. Stat Med. 2007;26:721–733
  53. Schwarzer G, Antes G, Schumacher M. Inflation of type I error rate in two statistical tests for the detection of publication bias in meta-analyses with binary outcomes. Stat Med. 2002;21:2465–2477
  54. Song F, Khan KS, Dinnes J, et al. Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol. 2002;31:88–95
  55. Fagan TJ. Letter: Nomogram for Bayes theorem. N Engl J Med. 1975;293:257
  56. Stengel D, Bauwens K, Sehouli J, et al. A likelihood ratio approach to meta-analysis of diagnostic studies. J Med Screen. 2003;10:47–51
  57. Li J, Fine J, Safdar N. Prevalence-dependent diagnostic accuracy measures. Stat Med. 2007;26:3258–3273

PII: S0037-198X(09)00024-8

doi: 10.1053/j.ro.2009.03.007

Seminars in Roentgenology
Volume 44, Issue 3 , Pages 170-179 , July 2009

Article Tools

* Image Usage & Resolution