paper-with-me

Papers

Score Combining for Contrastive OOD Detection

2025-01-21 · Edward T. Reehorst, Philip Schniter

In out-of-distribution (OOD) detection, one is asked to classify whether a test sample comes from a known inlier distribution or not. We focus on the case where the inlier distribution is defined by a training dataset and there exists no additional knowledge about the novelties that one is likely to encounter. This problem is also referred to as novelty detection, one-class classification, and unsupervised anomaly detection. The current literature suggests that contrastive learning techniques are state-of-the-art for OOD detection. We aim to improve on those techniques by combining/ensembling their scores using the framework of null hypothesis testing and, in particular, a novel generalized likelihood ratio test (GLRT). We demonstrate that our proposed GLRT-based technique outperforms the state-of-the-art CSI and SupCSI techniques from Tack et al. 2020 in dataset-vs-dataset experiments with CIFAR-10, SVHN, LSUN, ImageNet, and CIFAR-100, as well as leave-one-class-out experiments with CIFAR-10. We also demonstrate that our GLRT outperforms the score-combining methods of Fisher, Bonferroni, Simes, Benjamini-Hochwald, and Stouffer in our application.

📄 PDF Abstract BibTeX arXiv:2501.12204

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionContrastive LearningNovelty DetectionOne-Class ClassificationOut of Distribution (OOD) DetectionUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

Decoupled conditional contrastive learning with variable metadata for prostate lesion detection

2023-08-18 · Camille Ruppli, Pietro Gori, Roberto Ardon, Isabelle Bloch

Early diagnosis of prostate cancer is crucial for efficient treatment. Multi-parametric Magnetic Resonance Images (mp-MRI) are widely used for lesion detection. The Prostate Imaging Reporting and Data System (PI-RADS) ha…

Contrastive LearningLesion Detection

WDiscOOD: Out-of-Distribution Detection via Whitened Linear Discriminant Analysis

2023-03-14 · ICCV 2023 1 · Yiye Chen, Yunzhi Lin, Ruinian Xu, Patricio A. Vela

Deep neural networks are susceptible to generating overconfident yet erroneous predictions when presented with data beyond known concepts. This challenge underscores the importance of detecting out-of-distribution (OOD) …

Novel ConceptsOut-of-Distribution Detection

TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddings

2023-10-22 · Hans W. A. Hanley, Zakir Durumeric

Stance detection is important for understanding different attitudes and beliefs on the Internet. However, given that a passage's stance toward a given topic is often highly dependent on that topic, building a stance dete…

ArticlesContrastive LearningStance DetectionTAG

Direct Large Language Model Alignment Through Self-Rewarding Contrastive Prompt Distillation

2024-02-19 · Aiwei Liu, Haoping Bai, Zhiyun Lu, Xiang Kong 외

Aligning large language models (LLMs) with human expectations without human-annotated preference data is an important problem. In this paper, we propose a method to evaluate the response preference by using the output pr…

Language ModelingLanguage ModellingLarge Language Model

Understanding Hard Negatives in Noise Contrastive Estimation

2021-04-13 · NAACL 2021 4 · Wenzheng Zhang, Karl Stratos

The choice of negative examples is important in noise contrastive estimation. Recent works find that hard negatives -- highest-scoring incorrect examples under the model -- are effective in practice, but they are used wi…

Entity LinkingRetrievalText Retrieval