paper-with-me

홈 › Papers

EigenScore: OOD Detection using Covariance in Diffusion Models

2025-10-08 · Shirin Shoushtari, Yi Wang, Xiao Shi, M. Salman Asif, Ulugbek S. Kamilov arxiv

Out-of-distribution (OOD) detection is critical for the safe deployment of machine learning systems in safety-sensitive domains. Diffusion models have recently emerged as powerful generative models, capable of capturing complex data distributions through iterative denoising. Building on this progress, recent work has explored their potential for OOD detection. We propose EigenScore, a new OOD detection method that leverages the eigenvalue spectrum of the posterior covariance induced by a diffusion model. We argue that posterior covariance provides a consistent signal of distribution shift, leading to larger trace and leading eigenvalues on OOD inputs, yielding a clear spectral signature. We further provide analysis explicitly linking posterior covariance to distribution mismatch, establishing it as a reliable signal for OOD detection. To ensure tractability, we adopt a Jacobian-free subspace iteration method to estimate the leading eigenvalues using only forward evaluations of the denoiser. Empirically, EigenScore achieves SOTA performance, with up to 5% AUROC improvement over the best baseline. Notably, it remains robust in near-OOD settings such as CIFAR-10 vs CIFAR-100, where existing diffusion-based methods often fail.

📄 PDF Abstract BibTeX arXiv:2510.07206

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

INSIDE: LLMs' Internal States Retain the Power of Hallucination Detection

2024-02-06 · Chao Chen, Kai Liu, Ze Chen, Yi Gu 외

Knowledge hallucination have raised widespread concerns for the security and reliability of deployed LLMs. Previous efforts in detecting hallucinations have been employed at logit-level uncertainty estimation or language…

DiversityHallucinationQuestion Answering

Hallucination Detox: Sensitivity Dropout (SenD) for Large Language Model Training

2024-10-20 · Shahrad Mohammadzadeh, Juan David Guerra, Marco Bonizzato, Reihaneh Rabbany 외

As large language models (LLMs) are increasingly deployed across various industries, concerns regarding their reliability, particularly due to hallucinations - outputs that are factually inaccurate or irrelevant to user …

HallucinationLanguage ModelingLanguage ModellingLarge Language Model+1

A Spectral Method for Assessing and Combining Multiple Data Visualizations

2022-10-25 · Rong Ma, Eric D. Sun, James Zou

Dimension reduction and data visualization aim to project a high-dimensional dataset to a low-dimensional space while capturing the intrinsic structures in the data. It is an indispensable part of modern data science, an…

Data VisualizationDimensionality Reduction

Improving Probabilistic Diffusion Models With Optimal Covariance Matching

2024-06-16 · Zijing Ou, Mingtian Zhang, Andi Zhang, Tim Z. Xiao 외

The probabilistic diffusion model has become highly effective across various domains. Typically, sampling from a diffusion model involves using a denoising distribution characterized by a Gaussian with a learned mean and…

Denoising

Free Hunch: Denoiser Covariance Estimation for Diffusion Models Without Extra Costs

2024-10-15 · Severi Rissanen, Markus Heinonen, Arno Solin

The covariance for clean data given a noisy observation is an important quantity in many conditional generation methods for diffusion models. Current methods require heavy test-time computation, altering the standard dif…