Skip to content

Label-invariant models for the analysis of meta-epidemiological data

Research output: Contribution to journalArticle

Standard

Label-invariant models for the analysis of meta-epidemiological data. / Rhodes, K. M.; Mawdsley, D.; Turner, R. M.; Jones, H. E.; Savović, J.; Higgins, J. P.T.

In: Statistics in Medicine, Vol. 37, No. 1, 7491, 15.01.2018, p. 60-70.

Research output: Contribution to journalArticle

Harvard

APA

Vancouver

Author

Rhodes, K. M. ; Mawdsley, D. ; Turner, R. M. ; Jones, H. E. ; Savović, J. ; Higgins, J. P.T. / Label-invariant models for the analysis of meta-epidemiological data. In: Statistics in Medicine. 2018 ; Vol. 37, No. 1. pp. 60-70.

Bibtex

@article{028e41c711ba41538599dc023eeae4cb,
title = "Label-invariant models for the analysis of meta-epidemiological data",
abstract = "Rich meta-epidemiological data sets have been collected to explore associations between intervention effect estimates and study-level characteristics. Welton et al proposed models for the analysis of meta-epidemiological data, but these models are restrictive because they force heterogeneity among studies with a particular characteristic to be at least as large as that among studies without the characteristic. In this paper we present alternative models that are invariant to the labels defining the 2 categories of studies. To exemplify the methods, we use a collection of meta-analyses in which the Cochrane Risk of Bias tool has been implemented. We first investigate the influence of small trial sample sizes (less than 100 participants), before investigating the influence of multiple methodological flaws (inadequate or unclear sequence generation, allocation concealment, and blinding). We fit both the Welton et al model and our proposed label-invariant model and compare the results. Estimates of mean bias associated with the trial characteristics and of between-trial variances are not very sensitive to the choice of model. Results from fitting a univariable model show that heterogeneity variance is, on average, 88{\%} greater among trials with less than 100 participants. On the basis of a multivariable model, heterogeneity variance is, on average, 25{\%} greater among trials with inadequate/unclear sequence generation, 51{\%} greater among trials with inadequate/unclear blinding, and 23{\%} lower among trials with inadequate/unclear allocation concealment, although the 95{\%} intervals for these ratios are very wide. Our proposed label-invariant models for meta-epidemiological data analysis facilitate investigations of between-study heterogeneity attributable to certain study characteristics.",
keywords = "Bayesian methods, Cochrane, heterogeneity, meta-epidemiology, randomised trials",
author = "Rhodes, {K. M.} and D. Mawdsley and Turner, {R. M.} and Jones, {H. E.} and J. Savović and Higgins, {J. P.T.}",
year = "2018",
month = "1",
day = "15",
doi = "10.1002/sim.7491",
language = "English",
volume = "37",
pages = "60--70",
journal = "Statistics in Medicine",
issn = "0277-6715",
publisher = "John Wiley & Sons, Ltd.",
number = "1",

}

RIS - suitable for import to EndNote

TY - JOUR

T1 - Label-invariant models for the analysis of meta-epidemiological data

AU - Rhodes, K. M.

AU - Mawdsley, D.

AU - Turner, R. M.

AU - Jones, H. E.

AU - Savović, J.

AU - Higgins, J. P.T.

PY - 2018/1/15

Y1 - 2018/1/15

N2 - Rich meta-epidemiological data sets have been collected to explore associations between intervention effect estimates and study-level characteristics. Welton et al proposed models for the analysis of meta-epidemiological data, but these models are restrictive because they force heterogeneity among studies with a particular characteristic to be at least as large as that among studies without the characteristic. In this paper we present alternative models that are invariant to the labels defining the 2 categories of studies. To exemplify the methods, we use a collection of meta-analyses in which the Cochrane Risk of Bias tool has been implemented. We first investigate the influence of small trial sample sizes (less than 100 participants), before investigating the influence of multiple methodological flaws (inadequate or unclear sequence generation, allocation concealment, and blinding). We fit both the Welton et al model and our proposed label-invariant model and compare the results. Estimates of mean bias associated with the trial characteristics and of between-trial variances are not very sensitive to the choice of model. Results from fitting a univariable model show that heterogeneity variance is, on average, 88% greater among trials with less than 100 participants. On the basis of a multivariable model, heterogeneity variance is, on average, 25% greater among trials with inadequate/unclear sequence generation, 51% greater among trials with inadequate/unclear blinding, and 23% lower among trials with inadequate/unclear allocation concealment, although the 95% intervals for these ratios are very wide. Our proposed label-invariant models for meta-epidemiological data analysis facilitate investigations of between-study heterogeneity attributable to certain study characteristics.

AB - Rich meta-epidemiological data sets have been collected to explore associations between intervention effect estimates and study-level characteristics. Welton et al proposed models for the analysis of meta-epidemiological data, but these models are restrictive because they force heterogeneity among studies with a particular characteristic to be at least as large as that among studies without the characteristic. In this paper we present alternative models that are invariant to the labels defining the 2 categories of studies. To exemplify the methods, we use a collection of meta-analyses in which the Cochrane Risk of Bias tool has been implemented. We first investigate the influence of small trial sample sizes (less than 100 participants), before investigating the influence of multiple methodological flaws (inadequate or unclear sequence generation, allocation concealment, and blinding). We fit both the Welton et al model and our proposed label-invariant model and compare the results. Estimates of mean bias associated with the trial characteristics and of between-trial variances are not very sensitive to the choice of model. Results from fitting a univariable model show that heterogeneity variance is, on average, 88% greater among trials with less than 100 participants. On the basis of a multivariable model, heterogeneity variance is, on average, 25% greater among trials with inadequate/unclear sequence generation, 51% greater among trials with inadequate/unclear blinding, and 23% lower among trials with inadequate/unclear allocation concealment, although the 95% intervals for these ratios are very wide. Our proposed label-invariant models for meta-epidemiological data analysis facilitate investigations of between-study heterogeneity attributable to certain study characteristics.

KW - Bayesian methods

KW - Cochrane

KW - heterogeneity

KW - meta-epidemiology

KW - randomised trials

UR - http://www.scopus.com/inward/record.url?scp=85030107203&partnerID=8YFLogxK

U2 - 10.1002/sim.7491

DO - 10.1002/sim.7491

M3 - Article

VL - 37

SP - 60

EP - 70

JO - Statistics in Medicine

JF - Statistics in Medicine

SN - 0277-6715

IS - 1

M1 - 7491

ER -