paper-with-me

홈 › Papers

Pushing One Pair of Labels Apart Each Time in Multi-Label Learning: From Single Positive to Full Labels

2023-02-28 · Xiang Li, Xinrui Wang, Songcan Chen

In Multi-Label Learning (MLL), it is extremely challenging to accurately annotate every appearing object due to expensive costs and limited knowledge. When facing such a challenge, a more practical and cheaper alternative should be Single Positive Multi-Label Learning (SPMLL), where only one positive label needs to be provided per sample. Existing SPMLL methods usually assume unknown labels as negatives, which inevitably introduces false negatives as noisy labels. More seriously, Binary Cross Entropy (BCE) loss is often used for training, which is notoriously not robust to noisy labels. To mitigate this issue, we customize an objective function for SPMLL by pushing only one pair of labels apart each time to prevent the domination of negative labels, which is the main culprit of fitting noisy labels in SPMLL. To further combat such noisy labels, we explore the high-rankness of label matrix, which can also push apart different labels. By directly extending from SPMLL to MLL with full labels, a unified loss applicable to both settings is derived. Experiments on real datasets demonstrate that the proposed loss not only performs more robustly to noisy labels for SPMLL but also works well for full labels. Besides, we empirically discover that high-rankness can mitigate the dramatic performance drop in SPMLL. Most surprisingly, even without any regularization or fine-tuned label correction, only adopting our loss defeats state-of-the-art SPMLL methods on CUB, a dataset that severely lacks labels.

📄 PDF Abstract BibTeX arXiv:2302.14695

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Label Learning

Similar Papers 제목 키워드 기반

Twin Contrastive Learning for Online Clustering

2022-10-21 · Yunfan Li, Mouxing Yang, Dezhong Peng, Taihao Li 외

This paper proposes to perform online clustering by conducting twin contrastive learning (TCL) at the instance and cluster level. Specifically, we find that when the data is projected into a feature space with a dimensio…

ClusteringContrastive LearningDeep ClusteringImage Clustering+2

Boosting Contrastive Self-Supervised Learning with False Negative Cancellation

2020-11-23 · Tri Huynh, Simon Kornblith, Matthew R. Walter, Michael Maire 외

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far…

Contrastive LearningRepresentation LearningSelf-Supervised Image ClassificationSelf-Supervised Learning+1

ViLReF: An Expert Knowledge Enabled Vision-Language Retinal Foundation Model

2024-08-20 · Shengzhu Yang, Jiawei Du, Jia Guo, Weihang Zhang 외

Subtle semantic differences in retinal image and text data present great challenges for pre-training visual-language models. Moreover, false negative samples, i.e., image-text pairs having the same semantics but incorrec…

DiagnosticTransfer Learning

Linguistics-Vision Monotonic Consistent Network for Sign Language Production

2024-12-22 · Xu Wang, Shengeng Tang, Peipei Song, Shuo Wang 외

Sign Language Production (SLP) aims to generate sign videos corresponding to spoken language sentences, where the conversion of sign Glosses to Poses (G2P) is the key step. Due to the cross-modal semantic gap and the lac…

Sign Language Production

Pair-Level Supervised Contrastive Learning for Natural Language Inference

2022-01-26 · Shu'ang Li, Xuming Hu, Li Lin, Lijie Wen

Natural language inference (NLI) is an increasingly important task for natural language understanding, which requires one to infer the relationship between the sentence pair (premise and hypothesis). Many recent works ha…

Contrastive LearningNatural Language InferenceNatural Language UnderstandingSentence+2