Friends and Foes in Learning from Noisy Labels
Learning from examples with noisy labels has attracted increasing attention recently. But, this paper will show that the commonly used CIFAR-based datasets and the accuracy evaluation metric used in the literature are both inappropriate in this context. An alternative valid evaluation metric and new datasets are proposed in this paper to promote proper research and evaluation in this area. Then, friends and foes are identified from existing methods as technical components that are either beneficial or detrimental to deep learning from noisy labeled examples, respectively, and this paper improves and combines technical components from the friends category, including self-supervised learning, new warmup strategy, instance filtering and label correction. The resulting F&F method significantly outperforms existing methods on the proposed nCIFAR datasets and the real-world Clothing1M dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Self-Supervised LearningvalidSimilar Papers 제목 키워드 기반
Leveraging Trust and Distrust in Recommender Systems via Deep Learning
The data scarcity of user preferences and the cold-start problem often appear in real-world applications and limit the recommendation accuracy of collaborative filtering strategies. Leveraging the selections of social fr…
Collaborative FilteringDeep LearningRecommendation SystemsModeling Friends and Foes
How can one detect friendly and adversarial behavior from raw data? Detecting whether an environment is a friend, a foe, or anything in between, remains a poorly understood yet desirable ability for safe and robust agent…
Learning to Share and Hide Intentions using Information Regularization
Learning to cooperate with friends and compete with foes is a key component of multi-agent reinforcement learning. Typically to do so, one requires access to either a model of or interaction with the other agent(s). Here…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)False Friends Are Not Foes: Investigating Vocabulary Overlap in Multilingual Language Models
Subword tokenizers trained on multilingual corpora naturally produce overlapping tokens across languages. Does token overlap facilitate cross-lingual transfer or instead introduce interference between languages? Prior wo…
Cross-Lingual TransferSemantic SimilaritySocial Science Guided Feature Engineering: A Novel Approach to Signed Link Analysis
Many real-world relations can be represented by signed networks with positive links (e.g., friendships and trust) and negative links (e.g., foes and distrust). Link prediction helps advance tasks in social network analys…
Feature EngineeringLink PredictionRecommendation Systems