Instance-dependent Label-noise Learning under a Structural Causal Model
Label noise will degenerate the performance of deep learning algorithms because deep neural networks easily overfit label errors. Let X and Y denote the instance and clean label, respectively. When Y is a cause of X, according to which many datasets have been constructed, e.g., SVHN and CIFAR, the distributions of P(X) and P(Y|X) are entangled. This means that the unsupervised instances are helpful to learn the classifier and thus reduce the side effect of label noise. However, it remains elusive on how to exploit the causal information to handle the label noise problem. In this paper, by leveraging a structural causal model, we propose a novel generative approach for instance-dependent label-noise learning. In particular, we show that properly modeling the instances will contribute to the identifiability of the label noise transition matrix and thus lead to a better classifier. Empirically, our method outperforms all state-of-the-art methods on both synthetic and real-world label-noise datasets.
Code (2)
Similar Papers 제목 키워드 기반
Rethinking the Value of Labels for Instance-Dependent Label Noise Learning
Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existin…
Representation LearningNoisyAG-News: A Benchmark for Addressing Instance-Dependent Noise in Text Classification
Existing research on learning with noisy labels predominantly focuses on synthetic label noise. Although synthetic noise possesses well-defined structural properties, it often fails to accurately replicate real-world noi…
image-classificationImage ClassificationLearning with noisy labelstext-classification+1Confidence Scores Make Instance-dependent Label-noise Learning Possible
In learning with noisy labels, for every instance, its label can randomly walk to other classes following a transition distribution which is named a noise model. Well-studied noise models are all instance-independent, na…
Learning with noisy labelsA Second-Order Approach to Learning with Instance-Dependent Label Noise
The presence of label noise often misleads the training of deep neural networks. Departing from the recent literature which largely assumes the label noise rate is only determined by the true label class, the errors in h…
Image ClassificationImage Classification with Label NoisePart-dependent Label Noise: Towards Instance-dependent Label Noise
Learning with the \textit{instance-dependent} label noise is challenging, because it is hard to model such real-world noise. Note that there are psychological and physiological evidences showing that we humans perceive i…