paper-with-me

Papers

Confidence Regularized Self-Training

2019-08-26 · ICCV 2019 10 · Yang Zou, Zhiding Yu, Xiaofeng Liu, B. V. K. Vijaya Kumar, Jinsong Wang

Recent advances in domain adaptation show that deep self-training presents a powerful means for unsupervised domain adaptation. These methods often involve an iterative process of predicting on target domain and then taking the confident predictions as pseudo-labels for retraining. However, since pseudo-labels can be noisy, self-training can put overconfident label belief on wrong classes, leading to deviated solutions with propagated errors. To address the problem, we propose a confidence regularized self-training (CRST) framework, formulated as regularized self-training. Our method treats pseudo-labels as continuous latent variables jointly optimized via alternating optimization. We propose two types of confidence regularization: label regularization (LR) and model regularization (MR). CRST-LR generates soft pseudo-labels while CRST-MR encourages the smoothness on network output. Extensive experiments on image classification and semantic segmentation show that CRSTs outperform their non-regularized counterpart with state-of-the-art performance. The code and models of this work are available at https://github.com/yzou2/CRST.

📄 PDF Abstract BibTeX arXiv:1908.09822

Code (2)

yzou2/CRST 공식 구현 pytorch
yzou2/CBST mxnet

Tasks

Domain Adaptationimage-classificationImage ClassificationSemantic SegmentationSynthetic-to-Real TranslationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
Residual Connection 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Batch Normalization 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…

Similar Papers 제목 키워드 기반

Revisiting Self-Training with Regularized Pseudo-Labeling for Tabular Data

2023-02-27 · Minwook Kim, Juseong Kim, Giltae Song

Recent progress in semi- and self-supervised learning has caused a rift in the long-held belief about the need for an enormous amount of labeled data for machine learning and the irrelevancy of unlabeled data. Although i…

Self-Supervised Learning

Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach

2020-10-15 · NAACL 2021 4 · Yue Yu, Simiao Zuo, Haoming Jiang, Wendi Ren 외

Fine-tuned pre-trained language models (LMs) have achieved enormous success in many natural language processing (NLP) tasks, but they still require excessive labeled data in the fine-tuning stage. We study the problem of…

Language ModelingLanguage ModellingSentenceSentence-Pair Classification+3

End-to-End Multi-Object Detection with a Regularized Mixture Model

2022-05-18 · Jaeyoung Yoo, Hojun Lee, Seunghyeon Seo, Inseop Chung 외

Recent end-to-end multi-object detectors simplify the inference pipeline by removing hand-crafted processes such as non-maximum suppression (NMS). However, during training, they still heavily rely on heuristics and hand-…

Density EstimationObjectobject-detectionObject Detection

CAST: Cluster-Aware Self-Training for Tabular Data via Reliable Confidence

2023-10-10 · Minwook Kim, Juseong Kim, Ki Beom Kim, Giltae Song

Tabular data is one of the most widely used data modalities, encompassing numerous datasets with substantial amounts of unlabeled data. Despite this prevalence, there is a notable lack of simple and versatile methods for…

Pseudo Label

Regret Bounds for LQ Adaptive Control Under Database Attacks (Extended Version)

2020-04-01 · Jafar Abbaszadeh Chekan, Cedric Langbort

This paper is concerned with understanding and countering the effects of database attacks on a learning-based linear quadratic adaptive controller. This attack targets neither sensors nor actuators, but just poisons the …