Ranked Activation Shift for Post-Hoc Out-of-Distribution Detection
State-of-the-art post-hoc out-of-distribution detection methods rely on intermediate layer activation editing. However, they exhibit inconsistent performance across datasets and models. We show that this instability is driven by differences in the activation distributions, and identify a failure mode of scaling-based methods that arises when penultimate layer activations are not rectified. Motivated by this analysis, we propose RAS, a hyperparameter-free post-hoc method that replaces sorted activation magnitudes with a fixed in-distribution reference profile. Our simple plug-and-play method shows strong and consistent performance across datasets and architectures without assumptions on the penultimate layer activation function, and without requiring any hyperparameter tuning, while empirically preserving in-distribution classification accuracy. We further analyze what drives the improvement, showing that both inhibiting and exciting activation shifts independently contribute to better out-of-distribution discrimination.
Code (0)
등록된 구현이 없습니다.
Tasks
Out-of-Distribution DetectionSimilar Papers 제목 키워드 기반
ADFQ-ViT: Activation-Distribution-Friendly Post-Training Quantization for Vision Transformers
Vision Transformers (ViTs) have exhibited exceptional performance across diverse computer vision tasks, while their substantial parameter size incurs significantly increased memory and computational demands, impeding eff…
Attributeimage-classificationImage ClassificationInstance Segmentation+4Solution for OOD-CV Workshop SSB Challenge 2024 (Open-Set Recognition Track)
This report provides a detailed description of the method we explored and proposed in the OSR Challenge at the OOD-CV Workshop during ECCV 2024. The challenge required identifying whether a test sample belonged to the se…
Open Set LearningSparse Autoencoders for Interpretable Out-of-Distribution Detection
Reliable detection of out-of-distribution (OOD) samples is crucial for the safe deployment of machine learning models. Neural networks often produce overconfident predictions for inputs that deviate from their training d…
Out-of-Distribution DetectionActivation-Space Uncertainty Quantification for Pretrained Networks
Reliable uncertainty estimates are crucial for deploying pretrained models; yet, many strong methods for quantifying uncertainty require retraining, Monte Carlo sampling, or expensive second-order computations and may al…
Out-of-Distribution DetectionImage SegmentationDistribution Shifts at Scale: Out-of-distribution Detection in Earth Observation
Training robust deep learning models is critical in Earth Observation, where globally deployed models often face distribution shifts that degrade performance, especially in low-data regions. Out-of-distribution (OOD) det…
Earth ObservationOut-of-Distribution DetectionOut of Distribution (OOD) Detection