paper-with-me

Papers

Out-of-Distribution Detection with Reconstruction Error and Typicality-based Penalty

2022-12-24 · Genki Osada, Takahashi Tsubasa, Budrul Ahsan, Takashi Nishide

The task of out-of-distribution (OOD) detection is vital to realize safe and reliable operation for real-world applications. After the failure of likelihood-based detection in high dimensions had been shown, approaches based on the \emph{typical set} have been attracting attention; however, they still have not achieved satisfactory performance. Beginning by presenting the failure case of the typicality-based approach, we propose a new reconstruction error-based approach that employs normalizing flow (NF). We further introduce a typicality-based penalty, and by incorporating it into the reconstruction error in NF, we propose a new OOD detection method, penalized reconstruction error (PRE). Because the PRE detects test inputs that lie off the in-distribution manifold, it effectively detects adversarial examples as well as OOD examples. We show the effectiveness of our method through the evaluation using natural image datasets, CIFAR-10, TinyImageNet, and ILSVRC2012.

📄 PDF Abstract BibTeX arXiv:2212.12641

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Versatile Anomaly Detection with Outlier Preserving Distribution Mapping Autoencoders

2019-09-25 · Walter Gerych, Elke Rundensteiner, Emmanuel Agu

State-of-the-art deep learning methods for outlier detection make the assumption that anomalies will appear far away from inlier data in the latent space produced by distribution mapping deep networks. However, this ass…

Anomaly DetectionOutlier Detection

CULT: Continual Unsupervised Learning with Typicality-Based Environment Detection

2022-07-17 · Oliver Daniels-Koch

We introduce CULT (Continual Unsupervised Representation Learning with Typicality-Based Environment Detection), a new algorithm for continual unsupervised learning with variational auto-encoders. CULT uses a simple typic…

Representation Learning

SVD-Based Typicality Maps for Out-of-Distribution Detection in Vision Transformers

2026-08-24 · Aldo Sean Sartor, Leandro de Souza Rosa, Andriy Enttsel, Mauro Mangia 외 arxiv

We present a method for analyzing the internal representations of Vision Transformers (ViTs) exploiting the geometry of their learned parameters. Each affine layer's weight matrix is factored via Singular Value Decomposi…

Out-of-Distribution Detection

Model-agnostic out-of-distribution detection using combined statistical tests

2022-03-02 · Federico Bergamin, Pierre-Alexandre Mattei, Jakob D. Havtorn, Hugo Senetaire 외

We present simple methods for out-of-distribution detection using a trained generative model. These techniques, based on classical statistical tests, are model-agnostic in the sense that they can be applied to any differ…

Out-of-Distribution Detection

Outlier Preserving Distribution Mapping Autoencoders

2021-01-01 · Walter Gerych, Elke Rundensteiner, Emmanuel Agu

State-of-the-art deep outlier detection methods map data into a latent space with the aim of having outliers far away from inliers in this space. Unfortunately, this often fails as the divergence penalty they adopt pus…

Outlier Detection