The importance of adjusting for pupil background in school value added models: A study of Progress 8 and school accountability in England

George Leckie*, Harvey Goldstein

*Corresponding author for this work

Research output: Contribution to journalArticle (Academic Journal)

8 Citations (Scopus)
233 Downloads (Pure)

Abstract

In the UK, USA and elsewhere, school accountability systems increasingly compare schools using value-added measures of school performance derived from pupil scores in high-stakes standardised tests. Rather than naïvely comparing school average scores, which largely reflect school intake differences in prior attainment, these measures attempt to compare the average progress or improvement pupils make during a year or phase of schooling. Schools, however, also differ in terms of their pupil demographic and socioeconomic characteristics and these factors also predict why some schools subsequently score higher than others. Many therefore argue that value-added measures unadjusted for pupil background are biased in favour of schools with more ‘educationally advantaged’ intakes. But others worry that adjusting for pupil background entrenches socioeconomic inequities and excuses low-performing schools. In this article we explore these theoretical arguments and their practical importance in the context of the ‘Progress 8’ secondary school accountability system in England, which has chosen to ignore pupil background. We reveal how the reported low or high performance of many schools changes dramatically once adjustments are made for pupil background, and these changes also affect the reported differential performances of regions and of different school types. We conclude that accountability systems which choose to ignore pupil background are likely to reward and punish the wrong schools and this will likely have detrimental effects on pupil learning. These findings, especially when coupled with more general concerns surrounding high-stakes testing and school value-added models, raise serious doubts about their use in school accountability systems.

Original languageEnglish
Pages (from-to)518-537
Number of pages20
JournalBritish Educational Research Journal
Volume45
Issue number3
Early online date6 Mar 2019
DOIs
Publication statusPublished - 1 Jun 2019

Structured keywords

  • SoE Centre for Multilevel Modelling

Keywords

  • Attainment 8
  • national pupil database
  • Progress 8
  • school accountability
  • school league tables
  • school performance measures
  • value-added

Fingerprint Dive into the research topics of 'The importance of adjusting for pupil background in school value added models: A study of Progress 8 and school accountability in England'. Together they form a unique fingerprint.

Cite this