Novelty Detection Through Model-Based Characterization of Neural Networks
In this paper, we propose a model-based characterization of neural networks to detect novel input types and conditions. Novelty detection is crucial to identify abnormal inputs that can significantly degrade the performance of machine learning algorithms. Majority of existing studies have focused on activation-based representations to detect abnormal inputs, which limits the characterization of abnormality from a data perspective. However, a model perspective can also be informative in terms of the novelties and abnormalities. To articulate the significance of the model perspective in novelty detection, we utilize backpropagated gradients. We conduct a comprehensive analysis to compare the representation capability of gradients with that of activation and show that the gradients outperform the activation in novel class and condition detection. We validate our approach using four image recognition datasets including MNIST, Fashion-MNIST, CIFAR-10, and CURE-TSR. We achieve a significant improvement on all four datasets with an average AUROC of 0.953, 0.918, 0.582, and 0.746, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Novelty DetectionSimilar Papers 제목 키워드 기반
Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities
Much of the existing work on text novelty detection has been studied at the topic level, i.e., identifying whether the topic of a document or a sentence is novel or not. Little work has been done at the fine-grained sema…
Novelty DetectionSentenceOn Generation in Metric Spaces
We study generation in separable metric instance spaces. We extend the language generation framework from Kleinberg and Mullainathan [2024] beyond countable domains by defining novelty through metric separation and allow…
RaPP: Novelty Detection with Reconstruction along Projection Pathway
We propose RaPP, a new methodology for novelty detection by utilizing hidden space activation values obtained from a deep autoencoder. Precisely, RaPP compares input and its autoencoder reconstruction not only in the inp…
Anomaly DetectionNovelty DetectionOLED: One-Class Learned Encoder-Decoder Network with Adversarial Context Masking for Novelty Detection
Novelty detection is the task of recognizing samples that do not belong to the distribution of the target class. During training, the novelty class is absent, preventing the use of traditional classification approaches. …
Anomaly DetectionDecoderNovelty DetectionUniversal Novelty Detection Through Adaptive Contrastive Learning
Novelty detection is a critical task for deploying machine learning models in the open world. A crucial property of novelty detection methods is universality, which can be interpreted as generalization across various dis…
Contrastive LearningNovelty Detection