paper-with-me

Papers

Reject Illegal Inputs with Generative Classifier Derived from Any Discriminative Classifier

2020-01-02 · Xin Wang

Generative classifiers have been shown promising to detect illegal inputs including adversarial examples and out-of-distribution samples. Supervised Deep Infomax~(SDIM) is a scalable end-to-end framework to learn generative classifiers. In this paper, we propose a modification of SDIM termed SDIM-\emph{logit}. Instead of training generative classifier from scratch, SDIM-\emph{logit} first takes as input the logits produced any given discriminative classifier, and generate logit representations; then a generative classifier is derived by imposing statistical constraints on logit representations. SDIM-\emph{logit} could inherit the performance of the discriminative classifier without loss. SDIM-\emph{logit} incurs a negligible number of additional parameters, and can be efficiently trained with base classifiers fixed. We perform \emph{classification with rejection}, where test samples whose class conditionals are smaller than pre-chosen thresholds will be rejected without predictions. Experiments on illegal inputs, including adversarial examples, samples with common corruptions, and out-of-distribution~(OOD) samples show that allowed to reject a portion of test samples, SDIM-\emph{logit} significantly improves the performance on the left test sets.

📄 PDF Abstract BibTeX arXiv:2001.00483

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Reject Illegal Inputs: Scaling Generative Classifiers with Supervised Deep Infomax

2019-09-25 · Xin Wang, SiuMing Yiu

Deep Infomax~(DIM) is an unsupervised representation learning framework by maximizing the mutual information between the inputs and the outputs of an encoder, while probabilistic constraints are imposed on the outputs. I…

Representation Learning

Are Generative Classifiers More Robust to Adversarial Attacks?

2018-02-19 · Yingzhen Li, John Bradshaw, Yash Sharma

There is a rising interest in studying the robustness of deep neural network classifiers against adversaries, with both advanced attack and defence techniques being actively developed. However, most recent work focuses o…

Adversarial DefenseAdversarial Robustness

Stratified Adversarial Robustness with Rejection

2023-05-02 · Jiefeng Chen, Jayaram Raghuram, Jihye Choi, Xi Wu 외

Recently, there is an emerging interest in adversarially training a classifier with a rejection option (also known as a selective classifier) for boosting adversarial robustness. While rejection can incur a cost in many …

Adversarial RobustnessRobust classification

Generative Well-intentioned Networks

2019-10-28 · NeurIPS 2019 12 · Justin Cosentino, Jun Zhu

We propose Generative Well-intentioned Networks (GWINs), a novel framework for increasing the accuracy of certainty-based, closed-world classifiers. A conditional generative network recovers the distribution of observati…

Using Reed-Muller Codes for Classification with Rejection and Recovery

2023-09-12 · Daniel Fentham, David Parker, Mark Ryan

When deploying classifiers in the real world, users expect them to respond to inputs appropriately. However, traditional classifiers are not equipped to handle inputs which lie far from the distribution they were trained…