Elicitation in the classical model

John Quigley*, Abigail Colson, Willy Aspinall, Roger M. Cooke

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapter in a book

15 Citations (Scopus)

Abstract

The Classical Model (CM) is a performance-based approach for mathematically aggregating judgements from multiple experts, when reasoning about target questions under uncertainty. Individual expert performance is assessed against a set of seed questions, items from their field, for which the analyst knows or will know the true values, but the experts do not; the experts are, however, expected to provide accurate and informative distributional judgements that capture these values reliably. Performance is measured according to metrics for each expert’s statistical accuracy and informativeness, and the two metrics are convolved to determine a weight for each expert, with which to modulate their contribution when pooling them together for a final combined assessment of the desired target values. This chapter provides mathematical and practical details of the CM, including describing the method for measuring expert performance and discussing approaches for devising good seed questions.

Original languageEnglish
Title of host publicationInternational Series in Operations Research and Management Science
PublisherSpringer, New York, NY
Pages15-36
Number of pages22
Volume261
DOIs
Publication statusPublished - 2018

Publication series

NameInternational Series in Operations Research and Management Science
Volume261
ISSN (Print)0884-8289

Fingerprint Dive into the research topics of 'Elicitation in the classical model'. Together they form a unique fingerprint.

Cite this