paper-with-me

Papers

Bootstrapping the Relationship Between Images and Their Clean and Noisy Labels

2022-10-17 · Brandon Smart, Gustavo Carneiro

Many state-of-the-art noisy-label learning methods rely on learning mechanisms that estimate the samples' clean labels during training and discard their original noisy labels. However, this approach prevents the learning of the relationship between images, noisy labels and clean labels, which has been shown to be useful when dealing with instance-dependent label noise problems. Furthermore, methods that do aim to learn this relationship require cleanly annotated subsets of data, as well as distillation or multi-faceted models for training. In this paper, we propose a new training algorithm that relies on a simple model to learn the relationship between clean and noisy labels without the need for a cleanly labelled subset of data. Our algorithm follows a 3-stage process, namely: 1) self-supervised pre-training followed by an early-stopping training of the classifier to confidently predict clean labels for a subset of the training set; 2) use the clean set from stage (1) to bootstrap the relationship between images, noisy labels and clean labels, which we exploit for effective relabelling of the remaining training set using semi-supervised learning; and 3) supervised training of the classifier with all relabelled samples from stage (2). By learning this relationship, we achieve state-of-the-art performance in asymmetric and instance-dependent label noise problems.

📄 PDF Abstract BibTeX arXiv:2210.08826

Code (1)

btsmart/bootstrapping-label-noise 공식 구현 pytorch

Tasks

Image ClassificationLearning with noisy labels

Similar Papers 제목 키워드 기반

Interference and Generalization in Temporal Difference Learning

2020-03-13 · ICML 2020 1 · Emmanuel Bengio, Joelle Pineau, Doina Precup

We study the link between generalization and interference in temporal-difference (TD) learning. Interference is defined as the inner product of two different gradients, representing their alignment. This quantity emerges…

Consistency-guided Meta-Learning for Bootstrapping Semi-Supervised Medical Image Segmentation

2023-07-21 · Qingyue Wei, Lequan Yu, Xianhang Li, Wei Shao 외

Medical imaging has witnessed remarkable progress but usually requires a large amount of high-quality annotated data which is time-consuming and costly to obtain. To alleviate this burden, semi-supervised learning has ga…

Image SegmentationMedical Image SegmentationMeta-LearningPseudo Label+3

Causal bootstrapping

2019-10-21 · Max A. Little, Reham Badawy

To draw scientifically meaningful conclusions and build reliable models of quantitative phenomena, cause and effect must be taken into consideration (either implicitly or explicitly). This is particularly challenging whe…

BIG-bench Machine LearningCausal Inference

Joint Bootstrapping Machines for High Confidence Relation Extraction

2018-05-01 · NAACL 2018 6 · Pankaj Gupta, Benjamin Roth, Hinrich Schütze

Semi-supervised bootstrapping techniques for relationship extraction from text iteratively expand a set of initial seed instances. Due to the lack of labeled data, a key challenge in bootstrapping is semantic drift: if a…

RelationRelation ExtractionRelationship Extraction (Distant Supervised)Vocal Bursts Intensity Prediction

Unsupervised Hierarchical Domain Adaptation for Adverse Weather Optical Flow

2023-03-24 · Hanyu Zhou, Yi Chang, Gang Chen, Luxin Yan

Optical flow estimation has made great progress, but usually suffers from degradation under adverse weather. Although semi/full-supervised methods have made good attempts, the domain shift between the synthetic and real …

Domain AdaptationOptical Flow Estimation