Training Structural Awareness with StatHand: A 1 Year Follow-Up

Peter J Allen*, Jessica L Fielding, Annabel Westermann, Amelia Lafratta

*Corresponding author for this work

Research output: Contribution to journalArticle (Academic Journal)peer-review

12 Downloads (Pure)

Abstract

Background: Allen, Fielding, East, et al. (2020) demonstrated experimentally that structural awareness, or the ability to disregard a research problem’s topic and instead focus on its structural features, can be trained using StatHand (https://stathand.net). Most training benefits persisted for one week.

Objective: The objective was to assess the longer-term effects of training.

Method: One year after training (or control activities), 54 participants were re-administered five measures of structural awareness and one statistic selection measure.

Results: Trained participants continued to reliably out-perform control participants on four measures of structural awareness, though no longer on the fifth. Over the year, decrements in trained participants’ performance on the five structural awareness measures were mostly small. However, one year after training, the trained participants’ statistic selection advantage had largely disappeared.

Conclusion: Brief structural awareness training can have long-term benefits, though selecting an appropriate statistical test for common research scenarios without assistance remains a difficult task.

Teaching Implications: Structural awareness can be trained. However, even structurally aware students cannot reliably select appropriate statistics without assistance. Training plus easy access to a decision-making aid should maximize statistic selection accuracy. Our evidence-based training methods and materials, including StatHand, can be freely used and adapted for these purposes.
Original languageEnglish
Number of pages8
JournalTeaching of Psychology
Early online date21 Jan 2021
DOIs
Publication statusE-pub ahead of print - 21 Jan 2021

Keywords

  • instructional technology
  • statistics
  • research methods

Cite this