Artificial intelligence outperforms human students in conducting neurosurgical audits

Maksymilian A. Brzezicki, Nicholas E. Bridger, Matthew D. Kobetić, Maciej Ostrowski, Waldemar Grabowski, Simran S. Gill, Sandra Neumann

Research output: Contribution to journalArticle (Academic Journal)

Abstract

ObjectivesNeurosurgical audits are an important part of improving the safety, efficiency and quality of care but require considerable resources, time, and funding. To that end, the advent of the Artificial Intelligence-based algorithms offered a novel, more economically viable solution. The aim of the study was to evaluate whether the algorithm can indeed outperform humans in that task.
Patients & methodsForty-six human students were invited to inspect the clinical notes of 45 medical outliers on a neurosurgical ward. The aim of the task was to produce a report containing a quantitative analysis of the scale of the problem (e.g. time to discharge) and a qualitative list of suggestions on how to improve the patient flow, quality of care, and healthcare costs. The Artificial Intelligence-based Frideswide algorithm (FwA) was used to analyse the same dataset.
ResultsThe FwA produced 44 recommendations whilst human students reported an average of 3.89. The mean time to deliver the final report was 5.80 s for the FwA and 10.21 days for humans. The mean relative error for factual inaccuracy for humans was 14.75 % for total waiting times and 81.06 % for times between investigations. The report produced by the FwA was entirely factually correct. 13 out of 46 students submitted an unfinished audit, 3 out of 46 made an overdue submission. Thematic analysis revealed numerous internal contradictions of the recommendations given by human students.
ConclusionThe AI-based algorithm can produce significantly more recommendations in shorter time. The audits conducted by the AI are more factually accurate (0 % error rate) and logically consistent (no thematic contradictions). This study shows that the algorithm can produce reliable neurosurgical audits for a fraction of the resources required to conduct it by human means.
Original languageEnglish
Article number105732
JournalClinical Neurology and Neurosurgery
Volume192
Early online date10 Feb 2020
DOIs
Publication statusPublished - 1 May 2020

Keywords

  • neurosurgery audits
  • artificial intelligence
  • computational neuroscience
  • medical audits

Fingerprint Dive into the research topics of 'Artificial intelligence outperforms human students in conducting neurosurgical audits'. Together they form a unique fingerprint.

  • Cite this