Protecting against researcher bias in secondary data analysis: Challenges and potential solutions

Jessie Baldwin*, Jean-Baptiste Pingault, Tabea Schoeler, Hannah M Sallis, Marcus R Munafo

*Corresponding author for this work

Research output: Contribution to journalArticle (Academic Journal)peer-review

40 Citations (Scopus)
1048 Downloads (Pure)

Abstract

Analysis of secondary data sources (such as cohort studies, survey data, and administrative records) has the potential to provide answers to science and society’s most pressing questions. However, researcher biases can lead to questionable research practices in secondary data analysis, which can distort the evidence base. While pre-registration can help to protect against researcher biases, it presents challenges for secondary data analysis. In this article, we describe these challenges and propose novel solutions and alternative approaches. Proposed solutions include approaches to (1) address bias linked to prior knowledge of the data, (2) enable pre-registration of non-hypothesis-driven research, (3) help ensure that pre-registered analyses will be appropriate for the data, and (4) address difficulties arising from reduced analytic flexibility in pre-registration. For each solution, we provide guidance on implementation for researchers and data guardians. The adoption of these practices can help to protect against researcher bias in secondary data analysis, to improve the robustness of research based on existing data.
Original languageEnglish
Pages (from-to)1–10
JournalEuropean Journal of Epidemiology
Volume37
Issue number1
Early online date13 Jan 2022
DOIs
Publication statusE-pub ahead of print - 13 Jan 2022

Bibliographical note

Funding Information:
J.R.B is funded by a Wellcome Trust Sir Henry Wellcome fellowship (grant 215917/Z/19/Z). J.B.P is a supported by the Medical Research Foundation 2018 Emerging Leaders 1 Prize in Adolescent Mental Health (MRF-160–0002-ELP-PINGA). M.R.M and H.M.S work in a unit that receives funding from the University of Bristol and the UK Medical Research Council (MC_UU_00011/5, MC_UU_00011/7), and M.R.M is also supported by the National Institute for Health Research (NIHR) Biomedical Research Centre at the University Hospitals Bristol National Health Service Foundation Trust and the University of Bristol. st

Publisher Copyright:
© 2022, The Author(s).

Keywords

  • Secondary data analysis
  • Pre-registration
  • Open science
  • Researcher bias

Fingerprint

Dive into the research topics of 'Protecting against researcher bias in secondary data analysis: Challenges and potential solutions'. Together they form a unique fingerprint.

Cite this