Simple and Robust Loss Design for Multi-Label Learning with Missing Labels
Multi-label learning in the presence of missing labels (MLML) is a challenging problem. Existing methods mainly focus on the design of network structures or training schemes, which increase the complexity of implementation. This work seeks to fulfill the potential of loss function in MLML without increasing the procedure and complexity. Toward this end, we propose two simple yet effective methods via robust loss design based on an observation that a model can identify missing labels during training with a high precision. The first is a novel robust loss for negatives, namely the Hill loss, which re-weights negatives in the shape of a hill to alleviate the effect of false negatives. The second is a self-paced loss correction (SPLC) method, which uses a loss derived from the maximum likelihood criterion under an approximate distribution of missing labels. Comprehensive experiments on a vast range of multi-label image classification datasets demonstrate that our methods can remarkably boost the performance of MLML and achieve new state-of-the-art loss functions in MLML.
Code (2)
Tasks
image-classificationImage ClassificationMissing LabelsMulti-Label Image ClassificationMulti-Label LearningSimilar Papers 제목 키워드 기반
Addressing Missing Labels in Large-Scale Sound Event Recognition Using a Teacher-Student Framework With Loss Masking
The study of label noise in sound event recognition has recently gained attention with the advent of larger and noisier datasets. This work addresses the problem of missing labels, one of the big weaknesses of large audi…
Missing LabelsLarge-scale Multi-label Learning with Missing Labels
The multi-label classification problem has generated significant interest in recent years. However, existing approaches do not adequately address two key challenges: (a) the ability to tackle problems with a large number…
Missing LabelsMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONMulti-Label LearningLabel Structure Preserving Contrastive Embedding for Multi-Label Learning with Missing Labels
Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted …
Contrastive Learningimage-classificationImage ClassificationMissing Labels+4MIRRAMS: Learning Robust Tabular Models under Unseen Missingness Shifts
The presence of missing values often reflects variations in data collection policies, which may shift across time or locations, even when the underlying feature distribution remains stable. Such shifts in the missingness…
The Dice loss in the context of missing or empty labels: Introducing $Φ$ and $ε$
Albeit the Dice loss is one of the dominant loss functions in medical image segmentation, most research omits a closer look at its derivative, i.e. the real motor of the optimization when using gradient descent. In this …
Image SegmentationMedical Image SegmentationMissing LabelsSegmentation+1