Reviewing peer review, an eye tracking experiment of review behaviour

Duncan Boa, Ben Hicks

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

1 Citation (Scopus)
54 Downloads (Pure)

Abstract

The quality of peer reviews is a longstanding issue within the Design Society with concerns over the consistency and transparency of reviews raised frequently. Previous research has sought to qualify these concerns by describing the variability of review scores and correlating them with academic s backgrounds. This paper aims to update and advance the current understanding of peer review within the Design Society by characterising review behaviour through the addition of eye tracking. Seventeen academics attending Design 2014 took part in an experiment. The results of the experiment are discussed in this paper with the aim of answering two research questions: do different review strategies exist and what are they? And, do character traits of reviewers affect reviewer strategy? Results confirm findings from previous research, suggesting little has changed since the topic was last reported and that inconsistency remains a problem. However, some of the cause of review inconsistency is potentially explainable through identified review strategies evident from eye tracking data.
Original languageEnglish
Title of host publicationDS 80-2 Proceedings of the 20th International Conference on Engineering Design (ICED 15) Vol 2
Subtitle of host publicationDesign Theory and Research Methodology Design Processes, Milan, Italy, 27-30.07.15
EditorsChristian Weber, Stephan Husung, Marco Cantamessa, Gaetano Cascini, Dorian Marjanovic, Srinivasan Venkataraman
PublisherThe Design Society
Pages369-378
Number of pages10
Volume2
ISBN (Electronic) 978-1-904670-65-0
Publication statusPublished - 30 Jul 2015
Event20th International Conference on Engineering Design, ICED 2015 - Milan, Italy
Duration: 27 Jul 201530 Jul 2015

Publication series

NameICED
ISSN (Print)2220-4334

Conference

Conference20th International Conference on Engineering Design, ICED 2015
CountryItaly
CityMilan
Period27/07/1530/07/15

Keywords

  • Review
  • Peer review
  • Eye tracking
  • Engineering
  • Design
  • Information processing

Fingerprint Dive into the research topics of 'Reviewing peer review, an eye tracking experiment of review behaviour'. Together they form a unique fingerprint.

  • Cite this

    Boa, D., & Hicks, B. (2015). Reviewing peer review, an eye tracking experiment of review behaviour. In C. Weber, S. Husung, M. Cantamessa, G. Cascini, D. Marjanovic, & S. Venkataraman (Eds.), DS 80-2 Proceedings of the 20th International Conference on Engineering Design (ICED 15) Vol 2: Design Theory and Research Methodology Design Processes, Milan, Italy, 27-30.07.15 (Vol. 2, pp. 369-378). (ICED). The Design Society. https://www.designsociety.org/publication/37709/reviewing_peer_review_an_eye_tracking_experiment_of_review_behaviour