Benchmarks provide common ground for model development: Reply to Logie (2018) and Vandierendonck (2018)

Klaus Oberauer*, Stephan Lewandowsky, Edward Awh, Gordon D. A. Brown, Andrew Conway, Nelson Cowan, Christopher Donkin, Simon Farrell, Graham J Hitch, Mark J. Hurlstone, Wei Ji Ma, Candice C Morey, Derek Evan Nee, Judith Schweppe, Evie Vergauwe, Geoff Ward

*Corresponding author for this work

Research output: Contribution to journalArticle (Academic Journal)peer-review

669 Downloads (Pure)

Abstract

We respond to the comments of Logie and Vandierendonck to our article proposing benchmark findings for evaluating theories and models of short-term and working memory. The response focuses on the two main points of criticism: (a) Logie and Vandierendonck argue that the scope of the set of benchmarks is too narrow. We explain why findings on how working memory is used in complex cognition, findings on executive functions, and findings from neuropsychological case studies are currently not included in the benchmarks, and why findings with visual and spatial materials are less prevalent among them. (b) The critics question the usefulness of the benchmarks and their ratings for advancing theory development. We explain why selecting and rating benchmarks is important and justifiable, and acknowledge that the present selection and rating decisions are in need of continuous updating. The usefulness of the benchmarks of all ratings is also enhanced by our concomitant online posting of data for many of these benchmarks.

Original languageEnglish
Pages (from-to)972-977
Number of pages6
JournalPsychological Bulletin
Volume144
Issue number9
DOIs
Publication statusPublished - 1 Sep 2018

Structured keywords

  • Memory

Keywords

  • Working memory
  • short-term memory
  • executive functions
  • benchmarks
  • commentary

Fingerprint

Dive into the research topics of 'Benchmarks provide common ground for model development: Reply to Logie (2018) and Vandierendonck (2018)'. Together they form a unique fingerprint.
  • Benchmarks for models of short-term and working memory

    Oberauer, K., Lewandowsky, S., Awh, E., Brown, G. D. A., Conway, A., Cowan, N., Donkin, C., Farrell, S. A., Hitch, G. J., Hurlstone, M. J., Ma, W. J., Morey, C. C., Nee, D. E., Schweppe, J., Vergauwe, E. & Ward, G., 1 Sep 2018, In: Psychological Bulletin. 144, 9, p. 885-958 74 p.

    Research output: Contribution to journalArticle (Academic Journal)peer-review

    Open Access
    File
    77 Citations (Scopus)
    1872 Downloads (Pure)

Cite this