paper-with-me

Papers

Detecting Out-Of-Distribution Samples Using Low-Order Deep Features Statistics

2019-05-01 · ICLR 2019 5 · Igor M. Quintanilha, Roberto de M. E. Filho, José Lezama, Mauricio Delbracio, Leonardo O. Nunes

The ability to detect when an input sample was not drawn from the training distribution is an important desirable property of deep neural networks. In this paper, we show that a simple ensembling of first and second order deep feature statistics can be exploited to effectively differentiate in-distribution and out-of-distribution samples. Specifically, we observe that the mean and standard deviation within feature maps differs greatly between in-distribution and out-of-distribution samples. Based on this observation, we propose a simple and efficient plug-and-play detection procedure that does not require re-training, pre-processing or changes to the model. The proposed method outperforms the state-of-the-art by a large margin in all standard benchmarking tasks, while being much simpler to implement and execute. Notably, our method improves the true negative rate from 39.6% to 95.3% when 95% of in-distribution (CIFAR-100) are correctly detected using a DenseNet and the out-of-distribution dataset is TinyImageNet resize. The source code of our method will be made publicly available.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Average Pooling 설명 없음
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Dense Block A Dense Block is a module used in convolutional neural networks that connects *all layers* (with matching feature-map sizes) directly with each other. It was originally…
Kaiming Initialization 설명 없음

Similar Papers 제목 키워드 기반

Neural Networks Learn Statistics of Increasing Complexity

2024-02-06 · Nora Belrose, Quintin Pope, Lucia Quirke, Alex Mallen 외

The distributional simplicity bias (DSB) posits that neural networks learn low-order moments of the data distribution first, before moving on to higher-order correlations. In this work, we present compelling new evidence…

Self-Supervised Anomaly Detection by Self-Distillation and Negative Sampling

2022-01-17 · Nima Rafiee, Rahil Gholamipoorfard, Nikolas Adaloglou, Simon Jaxy 외

Detecting whether examples belong to a given in-distribution or are Out-Of-Distribution (OOD) requires identifying features specific to the in-distribution. In the absence of labels, these features can be learned by self…

Anomaly DetectionOut of Distribution (OOD) DetectionSelf-Supervised Anomaly DetectionSupervised Anomaly Detection

DisCoPatch: Taming Adversarially-driven Batch Statistics for Improved Out-of-Distribution Detection

2025-01-14 · Francisco Caetano, Christiaan Viviers, Luis A. Zavala-Mondragón, Peter H. N. de With 외

Out-of-distribution (OOD) detection holds significant importance across many applications. While semantic and domain-shift OOD problems are well-studied, this work focuses on covariate shifts - subtle variations in the d…

AllOut-of-Distribution DetectionOut of Distribution (OOD) Detection

NEWMA: a new method for scalable model-free online change-point detection

2018-05-21 · Nicolas Keriven, Damien Garreau, Iacopo Poli

We consider the problem of detecting abrupt changes in the distribution of a multi-dimensional time series, with limited computing power and memory. In this paper, we propose a new, simple method for model-free online ch…

Change Point DetectionTime SeriesTime Series Analysis

Probabilistic Modeling of Deep Features for Out-of-Distribution and Adversarial Detection

2019-09-25 · Nilesh A. Ahuja, Ibrahima Ndiour, Trushant Kalyanpur, Omesh Tickoo

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametri…

Adversarial Attack