Towards Harnessing Feature Embedding for Robust Learning with Noisy Labels
The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of DNNs in the early stage of learning to correct noisy labels. However, we observe that the model will make mistakes during label prediction, resulting in unsatisfactory performance. By contrast, the produced features in the early stage of learning show better robustness. Inspired by this observation, in this paper, we propose a novel feature embedding-based method for deep learning with label noise, termed LabEl NoiseDilution (LEND). To be specific, we first compute a similarity matrix based on current embedded features to capture the local structure of training data. Then, the noisy supervision signals carried by mislabeled data are overwhelmed by nearby correctly labeled ones (\textit{i.e.}, label noise dilution), of which the effectiveness is guaranteed by the inherent robustness of feature embedding. Finally, the training data with diluted labels are further used to train a robust classifier. Empirically, we conduct extensive experiments on both synthetic and real-world noisy datasets by comparing our LEND with several representative robust learning approaches. The results verify the effectiveness of our LEND.
Code (0)
등록된 구현이 없습니다.
Tasks
Learning with noisy labelsMemorizationSimilar Papers 제목 키워드 기반
Harnessing Geometric Constraints from Emotion Labels to improve Face Verification
For the task of face verification, we explore the utility of harnessing auxiliary facial emotion labels to impose explicit geometric constraints on the embedding space when training deep embedding models. We introduce se…
Face VerificationMulti-Task LearningOne-Shot LearningTripletMixed Blessing: Class-Wise Embedding guided Instance-Dependent Partial Label Learning
In partial label learning (PLL), every sample is associated with a candidate label set comprising the ground-truth label and several noisy labels. The conventional PLL assumes the noisy labels are randomly generated (ins…
Partial Label LearningIncomplete Multi-View Weak-Label Learning with Noisy Features and Imbalanced Labels
A variety of modern applications exhibit multi-view multi-label learning, where each sample has multi-view features, and multiple labels are correlated via common views. Current methods usually fail to directly deal with…
Multi-Label LearningCRoF: CLIP-based Robust Few-shot Learning on Noisy Labels
Noisy labels threaten the robustness of few-shot learning (FSL) due to the inexact features in a new domain. CLIP, a large-scale vision-language model, performs well in FSL on image-text embedding similarities, but it is…
Domain GeneralizationFew-Shot Learningzero-shot-classificationZero-Shot LearningDyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modeling
Learning from noisy labels is a challenge that arises in many real-world applications where training data can contain incorrect or corrupted labels. When fine-tuning language models with noisy labels, models can easily o…
Denoising