How well do health professionals interpret diagnostic information? A systematic review

Penny F Whiting, Clare Davenport, Catherine Jameson, Margaret Burke, Jonathan A C Sterne, Chris Hyde, Yoav Ben-Shlomo

Research output: Contribution to journalArticle (Academic Journal)peer-review

53 Citations (Scopus)
400 Downloads (Pure)

Abstract

OBJECTIVE: To evaluate whether clinicians differ in how they evaluate and interpret diagnostic test information.

DESIGN: Systematic review.

DATA SOURCES: MEDLINE, EMBASE and PsycINFO from inception to September 2013; bibliographies of retrieved studies, experts and citation search of key included studies.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES: Primary studies that provided information on the accuracy of any diagnostic test (eg, sensitivity, specificity, likelihood ratios) to health professionals and that reported outcomes relating to their understanding of information on or implications of test accuracy.

RESULTS: We included 24 studies. 6 assessed ability to define accuracy metrics: health professionals were less likely to identify the correct definition of likelihood ratios than of sensitivity and specificity. -25 studies assessed Bayesian reasoning. Most assessed the influence of a positive test result on the probability of disease: they generally found health professionals' estimation of post-test probability to be poor, with a tendency to overestimation. 3 studies found that approaches based on likelihood ratios resulted in more accurate estimates of post-test probability than approaches based on estimates of sensitivity and specificity alone, while 3 found less accurate estimates. 5 studies found that presenting natural frequencies rather than probabilities improved post-test probability estimation and speed of calculations.

CONCLUSIONS: Commonly used measures of test accuracy are poorly understood by health professionals. Reporting test accuracy using natural frequencies and visual aids may facilitate improved understanding and better estimation of the post-test probability of disease.

Original languageEnglish
Article numbere008155
Number of pages8
JournalBMJ Open
Volume5
Issue number7
Early online date28 Jul 2015
DOIs
Publication statusPublished - Jul 2015

Fingerprint

Dive into the research topics of 'How well do health professionals interpret diagnostic information? A systematic review'. Together they form a unique fingerprint.

Cite this