Skip to main navigation Skip to search Skip to main content

The application of ROBINS-I guidance in systematic reviews of non-randomised studies: a descriptive study

Research output: Contribution to journal › Article (Academic Journal) › peer-review

6 Citations (Scopus)

Abstract

The ROBINS-I tool is a commonly-used tool to assess risk of bias in non-randomised studies of interventions (NRSI) included in systematic reviews. The reporting of ROBINS-I results is important for decision makers using systematic reviews to understand the weaknesses of the evidence. In particular, systematic review authors should apply the tool according to the guidance provided. This study aims to describe how ROBINS-I guidance is currently applied by review authors. In January 2023 we undertook a citation search, and screened titles and abstracts of records published in the previous six months. We included systematic reviews of non-randomised studies of intervention where ROBINS-I had been used for risk of bias assessment. Based on ten criteria, we summarised the diverse ways in which reviews deviated from or reported the use of ROBINS-I.

In total, 492 reviews met our inclusion criteria. Only one review met all the expectations of the ROBINS-I guidance. A small proportion of reviews deviated from the seven standard domains (3%), judgments (13%) or in other ways (1%). Of the 476 (97%) reviews that reported some ROBINS-I results, only 57 (12%) reviews reported ROBINS-I results at outcome level compared with 203 reviews that reported ROBINS-I results at study level alone.
Most systematic reviews of NRSIs do not fully apply the ROBINS-I guidance. This raises concerns around the validity of the ROBINS-I results reported and the use of the evidence from these reviews in decision making.
Original languageEnglish
Number of pages12
JournalResearch Synthesis Methods
Early online date22 Oct 2025
DOIs
Publication statusE-pub ahead of print - 22 Oct 2025

Bibliographical note

Publisher Copyright:
© The Author(s), 2025. Published by Cambridge University Press on behalf of The Society for Research Synthesis Methodology.

Fingerprint

Dive into the research topics of 'The application of ROBINS-I guidance in systematic reviews of non-randomised studies: a descriptive study'. Together they form a unique fingerprint.

Cite this