A Response to Webb and Ting's On the Application of ROC Analysis to Predict Classification Performance Under Varying Class Distributions

T Fawcett, PA Flach

Research output: Contribution to journalArticle (Academic Journal)peer-review

52 Citations (Scopus)

Abstract

In an article in this issue, Webb and Ting criticize ROC analysis for its inability to handle certain changes in class distributions. They imply that the ability of ROC graphs to depict performance in the face of changing class distributions has been overstated. In this editorial response, we describe two general types of domains and argue that Webb and Ting's concerns apply primarily to only one of them. Furthermore, we show that there are interesting real-world domains of the second type, in which ROC analysis may be expected to hold in the face of changing class distributions.
Translated title of the contributionA Response to Webb and Ting's On the Application of ROC Analysis to Predict Classification Performance Under Varying Class Distributions
Original languageEnglish
Pages (from-to)33 - 38
Number of pages5
JournalMachine Learning
Volume58(1)
Publication statusPublished - Jan 2005

Fingerprint Dive into the research topics of 'A Response to Webb and Ting's On the Application of ROC Analysis to Predict Classification Performance Under Varying Class Distributions'. Together they form a unique fingerprint.

Cite this