Estimating the Arc Length of the Optimal ROC Curve and Lower Bounding the Maximal AUC

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

Abstract

In this paper, we show the arc length of the optimal ROC curve is an f-divergence. By leveraging this result, we express the arc length using a variational objective and estimate it accurately using positive and negative samples. We show this estimator has a non-parametric convergence rate Op(n−β/4) (β∈(0,1] depends on the smoothness). Using the same technique, we show the surface area sandwiched between the optimal ROC curve and the diagonal can be expressed via a similar variational objective. These new insights lead to a novel two-step classification procedure that maximizes an approximate lower bound of the maximal AUC. Experiments on CIFAR-10 datasets show the proposed two-step procedure achieves good AUC performance in imbalanced binary classification tasks.
Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems 35 (NeurIPS 2022)
EditorsS. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, A. Oh
PublisherCurran Associates, Inc
ISBN (Print)9781713871088
Publication statusPublished - 9 Dec 2022
EventNeurIPS 2022: The Thirty-Sixth Annual Conference on Neural Information Processing Systems - New Orleans Convention Center, New Orleans
Duration: 28 Nov 20229 Dec 2022
https://neurips.cc/Conferences/2022

Publication series

NameAdvances in Neural Information Processing Systems
PublisherCurran Associates, Inc.
ISSN (Print)1049-5258

Conference

ConferenceNeurIPS 2022
CityNew Orleans
Period28/11/229/12/22
Internet address

Fingerprint

Dive into the research topics of 'Estimating the Arc Length of the Optimal ROC Curve and Lower Bounding the Maximal AUC'. Together they form a unique fingerprint.

Cite this