paper-with-me

홈 › Papers

Shaping Parameter Contribution Patterns for Out-of-Distribution Detection

2026-03-07 · Haonan Xu, Yang Yang arxiv

Out-of-distribution (OOD) detection is a well-known challenge due to deep models often producing overconfident. In this paper, we reveal a key insight that trained classifiers tend to rely on sparse parameter contribution patterns, meaning that only a few dominant parameters drive predictions. This brittleness can be exploited by OOD inputs that anomalously trigger these parameters, resulting in overconfident predictions. To address this issue, we propose a simple yet effective method called Shaping Parameter Contribution Patterns (SPCP), which enhances OOD detection robustness by encouraging the classifier to learn boundary-oriented dense contribution patterns. Specifically, SPCP operates during training by rectifying excessively high parameter contributions based on a dynamically estimated threshold. This mechanism promotes the classifier to rely on a broader set of parameters for decision-making, thereby reducing the risk of overconfident predictions caused by anomalously triggered parameters, while preserving in-distribution (ID) performance. Extensive experiments under various OOD detection setups verify the effectiveness of SPCP.

📄 PDF Abstract BibTeX arXiv:2603.07195

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution Detection

Similar Papers 제목 키워드 기반

Gap junctions and synchronization clusters in the Thalamic Reticular Nuclei

2022-09-01 · Anca Radulescu, Michael Anderson

The Thalamic Reticular Nuclei (TRN) mediate processes like attentional modulation, sensory gating and sleep spindles. The GABAergic inter neurons in the TRN are know to exhibit widespread synchronized activity patterns. …

Clustering

Towards Optimal Feature-Shaping Methods for Out-of-Distribution Detection

2024-02-01 · Qinyu Zhao, Ming Xu, Kartik Gupta, Akshay Asthana 외

Feature shaping refers to a family of methods that exhibit state-of-the-art performance for out-of-distribution (OOD) detection. These approaches manipulate the feature representation, typically from the penultimate laye…

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Extremely Simple Activation Shaping for Out-of-Distribution Detection

2022-09-20 · Andrija Djurisic, Nebojsa Bozanic, Arjun Ashok, Rosanne Liu

The separation between training and deployment of machine learning models implies that not all scenarios encountered in deployment can be anticipated during training, and therefore relying solely on advancements in train…

Out-of-Distribution Detection

GDRQ: Group-based Distribution Reshaping for Quantization

2019-08-05 · Haibao Yu, Tuopu Wen, Guangliang Cheng, Jiankai Sun 외

Low-bit quantization is challenging to maintain high performance with limited model capacity (e.g., 4-bit for both weights and activations). Naturally, the distribution of both weights and activations in deep neural netw…

Quantization

From Context Shift to Stylistic Collapse: Why Training Objectives Matter More Than Scale

2026-04-08 · Rohan Mahapatra arxiv

In modern LLMs, linguistic features function not as stylistic artifacts but as probes of probability mass, allocated under training alignment objectives. Language models trained with contemporary pipelines exhibit severe…