paper-with-me

홈 › Papers

Generative Robust Classification

2022-12-14 · Xuwang Yin

Training adversarially robust discriminative (i.e., softmax) classifier has been the dominant approach to robust classification. Building on recent work on adversarial training (AT)-based generative models, we investigate using AT to learn unnormalized class-conditional density models and then performing generative robust classification. Our result shows that, under the condition of similar model capacities, the generative robust classifier achieves comparable performance to a baseline softmax robust classifier when the test data is clean or when the test perturbation is of limited size, and much better performance when the test perturbation size exceeds the training perturbation size. The generative classifier is also able to generate samples or counterfactuals that more closely resemble the training data, suggesting that the generative classifier can better capture the class-conditional distributions. In contrast to standard discriminative adversarial training where advanced data augmentation techniques are only effective when combined with weight averaging, we find it straightforward to apply advanced data augmentation to achieve better robustness in our approach. Our result suggests that the generative classifier is a competitive alternative to robust classification, especially for problems with limited number of classes.

📄 PDF Abstract BibTeX arXiv:2212.07283

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationData AugmentationRobust classification

Methods 이 논문이 사용한 방법론

Counterfactuals 설명 없음
Test 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

On The Distribution of Penultimate Activations of Classification Networks

2021-07-05 · Minkyo Seo, Yoonho Lee, Suha Kwak

This paper studies probability distributions of penultimate activations of classification networks. We show that, when a classification network is trained with the cross-entropy loss, its final classification layer forms…

ClassificationConditional Image GenerationImage GenerationKnowledge Distillation

Generative and Discriminative Text Classification with Recurrent Neural Networks

2017-03-06 · Dani Yogatama, Chris Dyer, Wang Ling, Phil Blunsom

We empirically characterize the performance of discriminative and generative LSTM models for text classification. We find that although RNN-based generative models are more powerful than their bag-of-words ancestors (e.g…

ClassificationContinual LearningGeneral Classificationtext-classification+1

Distance Based Image Classification: A solution to generative classification's conundrum?

2022-10-04 · Wen-Yan Lin, Siying Liu, Bing Tian Dai, Hongdong Li

Most classifiers rely on discriminative boundaries that separate instances of each class from everything else. We argue that discriminative boundaries are counter-intuitive as they define semantics by what-they-are-not; …

image-classificationImage Classification

From Graph Generation to Graph Classification

2023-02-15 · Oliver Schulte

This note describes a new approach to classifying graphs that leverages graph generative models (GGM). Assuming a GGM that defines a joint probability distribution over graphs and their class labels, I derive classificat…

ClassificationGraph ClassificationGraph Generation

Generative-Discriminative Variational Model for Visual Recognition

2017-06-07 · Chih-Kuan Yeh, Yao-Hung Hubert Tsai, Yu-Chiang Frank Wang

The paradigm shift from shallow classifiers with hand-crafted features to end-to-end trainable deep learning models has shown significant improvements on supervised learning tasks. Despite the promising power of deep neu…

ClassificationGeneral ClassificationmodelMulti-class Classification+3