paper-with-me

홈 › Papers

Instance-dependent Label-noise Learning under a Structural Causal Model

2021-09-07 · NeurIPS 2021 12 · Yu Yao, Tongliang Liu, Mingming Gong, Bo Han, Gang Niu, Kun Zhang

Label noise will degenerate the performance of deep learning algorithms because deep neural networks easily overfit label errors. Let X and Y denote the instance and clean label, respectively. When Y is a cause of X, according to which many datasets have been constructed, e.g., SVHN and CIFAR, the distributions of P(X) and P(Y|X) are entangled. This means that the unsupervised instances are helpful to learn the classifier and thus reduce the side effect of label noise. However, it remains elusive on how to exploit the causal information to handle the label noise problem. In this paper, by leveraging a structural causal model, we propose a novel generative approach for instance-dependent label-noise learning. In particular, we show that properly modeling the instances will contribute to the identifiability of the label noise transition matrix and thus lead to a better classifier. Empirically, our method outperforms all state-of-the-art methods on both synthetic and real-world label-noise datasets.

📄 PDF Abstract BibTeX arXiv:2109.02986

Code (2)

a5507203/idln pytorch
arpit2412/Noisy_Labels_IDNL pytorch

Similar Papers 제목 키워드 기반

Rethinking the Value of Labels for Instance-Dependent Label Noise Learning

2023-05-10 · Hanwen Deng, Weijia Zhang, Min-Ling Zhang

Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existin…

Representation Learning

NoisyAG-News: A Benchmark for Addressing Instance-Dependent Noise in Text Classification

2024-07-09 · Hongfei Huang, TingTing Liang, Xixi Sun, Zikang Jin 외

Existing research on learning with noisy labels predominantly focuses on synthetic label noise. Although synthetic noise possesses well-defined structural properties, it often fails to accurately replicate real-world noi…

image-classificationImage ClassificationLearning with noisy labelstext-classification+1

Confidence Scores Make Instance-dependent Label-noise Learning Possible

2020-01-11 · Antonin Berthon, Bo Han, Gang Niu, Tongliang Liu 외

In learning with noisy labels, for every instance, its label can randomly walk to other classes following a transition distribution which is named a noise model. Well-studied noise models are all instance-independent, na…

Learning with noisy labels

A Second-Order Approach to Learning with Instance-Dependent Label Noise

2020-12-22 · CVPR 2021 1 · Zhaowei Zhu, Tongliang Liu, Yang Liu

The presence of label noise often misleads the training of deep neural networks. Departing from the recent literature which largely assumes the label noise rate is only determined by the true label class, the errors in h…

Image ClassificationImage Classification with Label Noise

Part-dependent Label Noise: Towards Instance-dependent Label Noise

2020-06-14 · NeurIPS 2020 12 · Xiaobo Xia, Tongliang Liu, Bo Han, Nannan Wang 외

Learning with the \textit{instance-dependent} label noise is challenging, because it is hard to model such real-world noise. Note that there are psychological and physiological evidences showing that we humans perceive i…