paper-with-me

홈 › Papers

Do We Really Need Gold Samples for Sample Weighting Under Label Noise?

2021-04-19 · Aritra Ghosh, Andrew Lan

Learning with labels noise has gained significant traction recently due to the sensitivity of deep neural networks under label noise under common loss functions. Losses that are theoretically robust to label noise, however, often makes training difficult. Consequently, several recently proposed methods, such as Meta-Weight-Net (MW-Net), use a small number of unbiased, clean samples to learn a weighting function that downweights samples that are likely to have corrupted labels under the meta-learning framework. However, obtaining such a set of clean samples is not always feasible in practice. In this paper, we analytically show that one can easily train MW-Net without access to clean samples simply by using a loss function that is robust to label noise, such as mean absolute error, as the meta objective to train the weighting network. We experimentally show that our method beats all existing methods that do not use clean samples and performs on-par with methods that use gold samples on benchmark datasets across various noise types and noise rates.

📄 PDF Abstract BibTeX arXiv:2104.09045

Code (2)

arghosh/RobustMW-Net 공식 구현 pytorch
subeeshvasu/Awesome-Learning-with-Label-Noise 공식 구현 tf

Tasks

Meta-Learning

Similar Papers 제목 키워드 기반

Mining GOLD Samples for Conditional GANs

2019-10-21 · NeurIPS 2019 12 · Sangwoo Mo, Chiheon Kim, Sungwoong Kim, Minsu Cho 외

Conditional generative adversarial networks (cGANs) have gained a considerable attention in recent years due to its class-wise controllability and superior quality for complex generation tasks. We introduce a simple yet …

Active Learning

Agent Retrieval Bench: Evaluating Repository Context Retrieval for Coding Agents

2026-07-27 · Bowen Qin, Yi Xie hf

Modern coding agents are usually evaluated by whether they eventually produce a correct patch, but patch generation depends on an earlier context-acquisition stage: finding the repository files needed for the task. We in…

Semantic Similarity

Reweighting samples under covariate shift using a Wasserstein distance criterion

2020-10-19 · Julien Reygner, Adrien Touboul

Considering two random variables with different laws to which we only have access through finite size iid samples, we address how to reweight the first sample so that its empirical distribution converges towards the true…

Uncertainty Quantification

Text Generation by Learning from Demonstrations

2020-09-16 · ICLR 2021 1 · Richard Yuanzhe Pang, He He

Current approaches to text generation largely rely on autoregressive models and maximum likelihood estimation. This paradigm leads to (i) diverse but low-quality samples due to mismatched learning objective and evaluatio…

Machine TranslationQuestion GenerationQuestion-GenerationReinforcement Learning (RL)+2

The General Pair-based Weighting Loss for Deep Metric Learning

2019-05-30 · Haijun Liu, Jian Cheng, Wen Wang, Yanzhou Su

Deep metric learning aims at learning the distance metric between pair of samples, through the deep neural networks to extract the semantic feature embeddings where similar samples are close to each other while dissimila…

Image RetrievalMetric LearningRetrieval