Can multi-label classification networks know what they don’t know?
Estimating out-of-distribution (OOD) uncertainty is a major challenge for safely deploying machine learning models in the open-world environment. Improved methods for OOD detection in multi-class classification have emerged, while OOD detection methods for multi-label classification remain underexplored and use rudimentary techniques. We propose JointEnergy, a simple and effective method, which estimates the OOD indicator scores by aggregating label-wise energy scores from multiple labels. We show that JointEnergy can be mathematically interpreted from a joint likelihood perspective. Our results show consistent improvement over previous methods that are based on the maximum-valued scores, which fail to capture joint information from multiple labels. We demonstrate the effectiveness of our method on three common multi-label classification benchmarks, including MS-COCO, PASCAL-VOC, and NUS-WIDE. We show that JointEnergy can reduce the FPR95 by up to 10.05% compared to the previous best baseline, establishing state-of-the-art performance.
Code (1)
Tasks
ClassificationMulti-class ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONOut of Distribution (OOD) DetectionSimilar Papers 제목 키워드 기반
Can multi-label classification networks know what they don't know?
Estimating out-of-distribution (OOD) uncertainty is a central challenge for safely deploying machine learning models in the open-world environment. Improved methods for OOD detection in multi-class classification have em…
ClassificationMulti-class ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1Encoding Video and Label Priors for Multi-label Video Classification on YouTube-8M dataset
YouTube-8M is the largest video dataset for multi-label video classification. In order to tackle the multi-label classification on this challenging dataset, it is necessary to solve several issues such as temporal modeli…
ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1Knowing what you know: valid and validated confidence sets in multiclass and multilabel prediction
We develop conformal prediction methods for constructing valid predictive confidence sets in multiclass and multilabel problems without assumptions on the data generating distribution. A challenge here is that typical co…
Conformal PredictionPredictionquantile regressionvalidDeep learning for understanding multilabel imbalanced Chest X-ray datasets
Over the last few years, convolutional neural networks (CNNs) have dominated the field of computer vision thanks to their ability to extract features and their outstanding performance in classification problems, for exam…
Deep LearningMultilabel reductions: what is my loss optimising?
Multilabel classification is a challenging problem arising in applications ranging from information retrieval to image tagging. A popular approach to this problem is to employ a reduction to a suitable series of binary o…
General ClassificationInformation RetrievalRetrieval