Channel-Wise Contrastive Learning for Learning with Noisy Labels
In real-world datasets, noisy labels are pervasive. The challenge of learning with noisy labels (LNL) is to train a classifier that discerns the actual classes from given instances. For this, the model must identify features indicative of the authentic labels. While research indicates that genuine label information is embedded in the learned features of even inaccurately labeled data, it's often intertwined with noise, complicating its direct application. Addressing this, we introduce channel-wise contrastive learning (CWCL). This method distinguishes authentic label information from noise by undertaking contrastive learning across diverse channels. Unlike conventional instance-wise contrastive learning (IWCL), CWCL tends to yield more nuanced and resilient features aligned with the authentic labels. Our strategy is twofold: firstly, using CWCL to extract pertinent features to identify cleanly labeled samples, and secondly, progressively fine-tuning using these samples. Evaluations on several benchmark datasets validate our method's superiority over existing approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningLearning with noisy labelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Class2Simi: A Noise Reduction Perspective on Learning with Noisy Labels
Learning with noisy labels has attracted a lot of attention in recent years, where the mainstream approaches are in pointwise manners. Meanwhile, pairwise manners have shown great potential in supervised metric learning …
Contrastive LearningLearning with noisy labelsMetric LearningSelective-Supervised Contrastive Learning with Noisy Labels
Deep networks have strong capacities of embedding data into latent representations and finishing following tasks. However, the capacities largely come from high-quality annotated labels, which are expensive to collect. N…
Contrastive LearningImage ClassificationLearning with noisy labelsRepresentation LearningNoise-robust Graph Learning by Estimating and Leveraging Pairwise Interactions
Teaching Graph Neural Networks (GNNs) to accurately classify nodes under severely noisy labels is an important problem in real-world graph learning applications, but is currently underexplored. Although pairwise training…
Contrastive LearningGraph LearningMetric LearningNode ClassificationTruncate-Split-Contrast: A Framework for Learning from Mislabeled Videos
Learning with noisy label (LNL) is a classic problem that has been extensively studied for image tasks, but much less for video in the literature. A straightforward migration from images to videos without considering the…
channel selectionContrastive LearningVideo ClassificationContrastive and Consistency Learning for Neural Noisy-Channel Model in Spoken Language Understanding
Recently, deep end-to-end learning has been studied for intent classification in Spoken Language Understanding (SLU). However, end-to-end models require a large amount of speech data with intent labels, and highly optimi…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)intent-classificationIntent Classification+6