Skip navigation
Full metadata record
DC FieldValueLanguage
dc.contributor.authorMacskassy, Sofus A.-
dc.contributor.authorProvost, Foster-
dc.contributor.authorLittman, Michael L.-
dc.description.abstractWe address the problem of comparing the performance of classifiers. In this paper we study techniques for generating and evaluating bands on ROC curves. Historically this has been done using one-dimensional confidence intervals by freezing one variable - false-positive rate, or threshold on the classification scoring function. We adapt two prior methods and introduce a new radial sweep method to generate confidence bands. We show, through empirical studies, that the bands are too tight and introduce a general optimization methodology for creating bands that better fit the data, as well as methods for evaluating confidence bands. We show empirically that the optimized confidence bands fit much better and that, using our new evaluation method, it is possible to gauge the relative fit of different confidence bands.en
dc.format.extent2868990 bytes-
dc.publisherStern School of Business, New York Universityen
dc.titleConfidence Bands for ROC Curvesen
dc.typeWorking Paperen
dc.description.seriesInformation Systems Working Papers SeriesEN
Appears in Collections:IOMS: Information Systems Working Papers

Files in This Item:
File Description SizeFormat 
IS-03-04.pdf2.8 MBAdobe PDFView/Open

Items in FDA are protected by copyright, with all rights reserved, unless otherwise indicated.