paper-with-me

홈 › Papers

Deep Metric Learning-Based Out-of-Distribution Detection with Synthetic Outlier Exposure

2024-05-01 · Assefa Seyoum Wahd

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where models are trained using a mixture of in-distribution (ID) samples and ``seen" OOD samples. For the OOD samples, the model is trained to minimize the KL divergence between the output probability and the uniform distribution while correctly classifying the in-distribution (ID) data. In this paper, we propose a label-mixup approach to generate synthetic OOD data using Denoising Diffusion Probabilistic Models (DDPMs). Additionally, we explore recent advancements in metric learning to train our models. In the experiments, we found that metric learning-based loss functions perform better than the softmax. Furthermore, the baseline models (including softmax, and metric learning) show a significant improvement when trained with the generated OOD data. Our approach outperforms strong baselines in conventional OOD detection metrics.

📄 PDF Abstract BibTeX arXiv:2405.00631

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingMetric LearningOut-of-Distribution DetectionOut of Distribution (OOD) DetectionSynthetic Data Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Energy-based Hopfield Boosting for Out-of-Distribution Detection

2024-05-14 · Claus Hofmann, Simon Schmid, Bernhard Lehner, Daniel Klotz 외

Out-of-distribution (OOD) detection is critical when deploying machine learning models in the real world. Outlier exposure methods, which incorporate auxiliary outlier data in the training process, can drastically improv…

Out-of-Distribution DetectionOut of Distribution (OOD) Detection

Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolation

2023-09-21 · NeurIPS 2023 11

Out-of-distribution (OOD) detection is important for deploying reliable machine learning models on real-world applications. Recent advances in outlier exposure have shown promising results on OOD detection via fine-tunin…

On the Powerfulness of Textual Outlier Exposure for Visual OoD Detection

2023-10-25 · NeurIPS 2023 11

Successful detection of Out-of-Distribution (OoD) data is becoming increasingly important to ensure safe deployment of neural networks. One of the main challenges in OoD detection is that neural networks output overconfi…

Towards Trustworthy Dataset Distillation

2023-07-18 · Shijie Ma, Fei Zhu, Zhen Cheng, Xu-Yao Zhang

Efficiency and trustworthiness are two eternal pursuits when applying deep learning in real-world applications. With regard to efficiency, dataset distillation (DD) endeavors to reduce training costs by distilling the la…

Dataset Distillation

BootOOD: Self-Supervised Out-of-Distribution Detection via Synthetic Sample Exposure under Neural Collapse

2025-11-17 · Yuanchao Wang, Tian Qin, Eduardo Valle, Bruno Abrahao arxiv

Out-of-distribution (OOD) detection is critical for deploying image classifiers in safety-sensitive environments, yet existing detectors often struggle when OOD samples are semantically similar to the in-distribution (ID…

Out-of-Distribution Detection