paper-with-me

홈 › Papers

Can multi-label classification networks know what they don’t know?

2021-05-21 · NeurIPS 2021 12 · Haoran Wang, Weitang Liu, Alex Bocchieri, Yixuan Li

Estimating out-of-distribution (OOD) uncertainty is a major challenge for safely deploying machine learning models in the open-world environment. Improved methods for OOD detection in multi-class classification have emerged, while OOD detection methods for multi-label classification remain underexplored and use rudimentary techniques. We propose JointEnergy, a simple and effective method, which estimates the OOD indicator scores by aggregating label-wise energy scores from multiple labels. We show that JointEnergy can be mathematically interpreted from a joint likelihood perspective. Our results show consistent improvement over previous methods that are based on the maximum-valued scores, which fail to capture joint information from multiple labels. We demonstrate the effectiveness of our method on three common multi-label classification benchmarks, including MS-COCO, PASCAL-VOC, and NUS-WIDE. We show that JointEnergy can reduce the FPR95 by up to 10.05% compared to the previous best baseline, establishing state-of-the-art performance.

📄 PDF Abstract BibTeX

Code (1)

deeplearning-wisc/multi-label-ood 공식 구현 pytorch

Tasks

ClassificationMulti-class ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONOut of Distribution (OOD) Detection

Similar Papers 제목 키워드 기반

Can multi-label classification networks know what they don't know?

2021-09-29 · NeurIPS 2021 12 · Haoran Wang, Weitang Liu, Alex Bocchieri, Yixuan Li

Estimating out-of-distribution (OOD) uncertainty is a central challenge for safely deploying machine learning models in the open-world environment. Improved methods for OOD detection in multi-class classification have em…

ClassificationMulti-class ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1

Encoding Video and Label Priors for Multi-label Video Classification on YouTube-8M dataset

2017-06-24 · Seil Na, Youngjae Yu, Sang-ho Lee, Ji-Sung Kim 외

YouTube-8M is the largest video dataset for multi-label video classification. In order to tackle the multi-label classification on this challenging dataset, it is necessary to solve several issues such as temporal modeli…

ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1

Knowing what you know: valid and validated confidence sets in multiclass and multilabel prediction

2020-04-21 · Maxime Cauchois, Suyash Gupta, John Duchi

We develop conformal prediction methods for constructing valid predictive confidence sets in multiclass and multilabel problems without assumptions on the data generating distribution. A challenge here is that typical co…

Conformal PredictionPredictionquantile regressionvalid

Deep learning for understanding multilabel imbalanced Chest X-ray datasets

2022-07-28 · Helena Liz, Javier Huertas-Tato, Manuel Sánchez-Montañés, Javier Del Ser 외

Over the last few years, convolutional neural networks (CNNs) have dominated the field of computer vision thanks to their ability to extract features and their outstanding performance in classification problems, for exam…

Deep Learning

Multilabel reductions: what is my loss optimising?

2019-12-01 · NeurIPS 2019 12 · Aditya K. Menon, Ankit Singh Rawat, Sashank Reddi, Sanjiv Kumar

Multilabel classification is a challenging problem arising in applications ranging from information retrieval to image tagging. A popular approach to this problem is to employ a reduction to a suitable series of binary o…

General ClassificationInformation RetrievalRetrieval