paper-with-me

Papers

Adversarial Dropout Regularization

2017-11-05 · ICLR 2018 1 · Kuniaki Saito, Yoshitaka Ushiku, Tatsuya Harada, Kate Saenko

We present a method for transferring neural representations from label-rich source domains to unlabeled target domains. Recent adversarial methods proposed for this task learn to align features across domains by fooling a special domain critic network. However, a drawback of this approach is that the critic simply labels the generated features as in-domain or not, without considering the boundaries between classes. This can lead to ambiguous features being generated near class boundaries, reducing target classification accuracy. We propose a novel approach, Adversarial Dropout Regularization (ADR), to encourage the generator to output more discriminative features for the target domain. Our key idea is to replace the critic with one that detects non-discriminative features, using dropout on the classifier network. The generator then learns to avoid these areas of the feature space and thus creates better features. We apply our ADR approach to the problem of unsupervised domain adaptation for image classification and semantic segmentation tasks, and demonstrate significant improvement over the state of the art. We also show that our approach can be used to train Generative Adversarial Networks for semi-supervised learning.

📄 PDF Abstract BibTeX arXiv:1711.01575

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGeneral Classificationimage-classificationImage ClassificationSemantic SegmentationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Neural SDE: Stabilizing Neural ODE Networks with Stochastic Noise

2019-06-05 · Xuanqing Liu, Tesi Xiao, Si Si, Qin Cao 외

Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g. dropout, Gauss…

Adversarial Robustness for Machine Learning Cyber Defenses Using Log Data

2020-07-29 · Kai Steverson, Jonathan Mullin, Metin Ahiskali

There has been considerable and growing interest in applying machine learning for cyber defenses. One promising approach has been to apply natural language processing techniques to analyze logs data for suspicious behavi…

Adversarial AttackAdversarial RobustnessBIG-bench Machine LearningDeep Reinforcement Learning

How Does Noise Help Robustness? Explanation and Exploration under the Neural SDE Framework

2020-06-01 · CVPR 2020 6 · Xuanqing Liu, Tesi Xiao, Si Si, Qin Cao 외

Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g., dropout, Gaus…

On the Inductive Bias of Dropout

2014-12-15 · David P. Helmbold, Philip M. Long

Dropout is a simple but effective technique for learning in neural networks and other settings. A sound theoretical understanding of dropout is needed to determine when dropout should be applied and how to use it most ef…

Inductive Bias

MaxMatch-Dropout: Subword Regularization for WordPiece

2022-09-09 · COLING 2022 10 · Tatsuya Hiraoka

We present a subword regularization method for WordPiece, which uses a maximum matching algorithm for tokenization. The proposed method, MaxMatch-Dropout, randomly drops words in a search using the maximum matching algor…

Machine TranslationText ClassificationTranslation