paper-with-me

Papers

Your Classifier Can Be Secretly a Likelihood-Based OOD Detector

2024-08-09 · Jirayu Burapacheep, Yixuan Li

The ability to detect out-of-distribution (OOD) inputs is critical to guarantee the reliability of classification models deployed in an open environment. A fundamental challenge in OOD detection is that a discriminative classifier is typically trained to estimate the posterior probability p(y|z) for class y given an input z, but lacks the explicit likelihood estimation of p(z) ideally needed for OOD detection. While numerous OOD scoring functions have been proposed for classification models, these estimate scores are often heuristic-driven and cannot be rigorously interpreted as likelihood. To bridge the gap, we propose Intrinsic Likelihood (INK), which offers rigorous likelihood interpretation to modern discriminative-based classifiers. Specifically, our proposed INK score operates on the constrained latent embeddings of a discriminative classifier, which are modeled as a mixture of hyperspherical embeddings with constant norm. We draw a novel connection between the hyperspherical distribution and the intrinsic likelihood, which can be effectively optimized in modern neural networks. Extensive experiments on the OpenOOD benchmark empirically demonstrate that INK establishes a new state-of-the-art in a variety of OOD detection setups, including both far-OOD and near-OOD. Code is available at https://github.com/deeplearning-wisc/ink.

📄 PDF Abstract BibTeX arXiv:2408.04851

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Your VAR Model is Secretly an Efficient and Explainable Generative Classifier

2025-10-14 · Yi-Chung Chen, David I. Inouye, Jing Gao arxiv

Generative classifiers, which leverage conditional generative models for classification, have recently demonstrated desirable properties such as robustness to distribution shifts. However, recent progress in this area ha…

class-incremental learning

Your Diffusion Model is Secretly a Noise Classifier and Benefits from Contrastive Training

2024-07-12 · Yunshu Wu, Yingtao Luo, Xianghao Kong, Evangelos E. Papalexakis 외

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause o…

Denoising

Your Language Model Can Secretly Write Like Humans: Contrastive Paraphrase Attacks on LLM-Generated Text Detectors

2025-05-21 · Hao Fang, Jiawei Kong, Tianqu Zhuang, Yixiang Qiu 외

The misuse of large language models (LLMs), such as academic plagiarism, has driven the development of detectors to identify LLM-generated texts. To bypass these detectors, paraphrase attacks have emerged to purposely re…

Language ModelingLanguage Modelling

Your Classifier can Secretly Suffice Multi-Source Domain Adaptation

2021-03-20 · NeurIPS 2020 12 · Naveen Venkat, Jogendra Nath Kundu, Durgesh Kumar Singh, Ambareesh Revanur 외

Multi-Source Domain Adaptation (MSDA) deals with the transfer of task knowledge from multiple labeled source domains to an unlabeled target domain, under a domain-shift. Existing methods aim to minimize this domain-shift…

Domain AdaptationMulti-Source Unsupervised Domain Adaptation

Your Classifier is Secretly an Energy Based Model and You Should Treat it Like One

2019-12-06 · ICLR 2020 1 · Will Grathwohl, Kuan-Chieh Wang, Jörn-Henrik Jacobsen, David Duvenaud 외

We propose to reinterpret a standard discriminative classifier of p(y|x) as an energy based model for the joint distribution p(x,y). In this setting, the standard class probabilities can be easily computed as well as unn…