Class2Simi: A New Perspective on Learning with Label Noise
Label noise is ubiquitous in the era of big data. Deep learning algorithms can easily fit the noise and thus cannot generalize well without properly modeling the noise. In this paper, we propose a new perspective on dealing with label noise called ``\textit{Class2Simi}''. Specifically, we transform the training examples with noisy class labels into pairs of examples with noisy similarity labels, and propose a deep learning framework to learn robust classifiers with the noisy similarity labels. Note that a class label shows the class that an instance belongs to; while a similarity label indicates whether or not two instances belong to the same class. It is worthwhile to perform the transformation: We prove that the noise rate for the noisy similarity labels is lower than that of the noisy class labels, because similarity labels themselves are robust to noise. For example, given two instances, even if both of their class labels are incorrect, their similarity label could be correct. Due to the lower noise rate, Class2Simi achieves remarkably better classification accuracy than its baselines that directly deals with the noisy class labels.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Class2Simi: A Noise Reduction Perspective on Learning with Noisy Labels
Learning with noisy labels has attracted a lot of attention in recent years, where the mainstream approaches are in pointwise manners. Meanwhile, pairwise manners have shown great potential in supervised metric learning …
Contrastive LearningLearning with noisy labelsMetric LearningInput Similarity from the Neural Network Perspective
We first exhibit a multimodal image registration task, for which a neural network trained on a dataset with noisy labels reaches almost perfect accuracy, far beyond noise variance. This surprising auto-denoising phenomen…
DenoisingImage RegistrationA Survey of Label-noise Representation Learning: Past, Present and Future
Classical machine learning implicitly assumes that labels of the training data are sampled from a clean distribution, which can be too restrictive for real-world scenarios. However, statistical-learning-based methods may…
BIG-bench Machine LearningLearning TheoryRepresentation LearningGraph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detection
Video anomaly detection under weak labels is formulated as a typical multiple-instance learning problem in previous works. In this paper, we provide a new perspective, i.e., a supervised learning task under noisy labels.…
Anomaly DetectionAnomaly Detection In Surveillance VideosMultiple Instance LearningSupervised Anomaly Detection+2Kalman Filter-based Heuristic Ensemble (KFHE): A new perspective on multi-class ensemble classification using Kalman filters
This paper introduces a new perspective on multi-class ensemble classification that considers training an ensemble as a state estimation problem. The new perspective considers the final ensemble classifier model as a sta…
ClassificationGeneral ClassificationState Estimation