paper-with-me

Papers

Binary Noise for Binary Tasks: Masked Bernoulli Diffusion for Unsupervised Anomaly Detection

2024-03-18 · Julia Wolleb, Florentin Bieder, Paul Friedrich, Peter Zhang, Alicia Durrer, Philippe C. Cattin

The high performance of denoising diffusion models for image generation has paved the way for their application in unsupervised medical anomaly detection. As diffusion-based methods require a lot of GPU memory and have long sampling times, we present a novel and fast unsupervised anomaly detection approach based on latent Bernoulli diffusion models. We first apply an autoencoder to compress the input images into a binary latent representation. Next, a diffusion model that follows a Bernoulli noise schedule is employed to this latent space and trained to restore binary latent representations from perturbed ones. The binary nature of this diffusion model allows us to identify entries in the latent space that have a high probability of flipping their binary code during the denoising process, which indicates out-of-distribution data. We propose a masking algorithm based on these probabilities, which improves the anomaly detection scores. We achieve state-of-the-art performance compared to other diffusion-based unsupervised anomaly detection algorithms while significantly reducing sampling time and memory consumption. The code is available at https://github.com/JuliaWolleb/Anomaly_berdiff.

📄 PDF Abstract BibTeX arXiv:2403.11667

Code (1)

juliawolleb/anomaly_berdiff 공식 구현 pytorch

Tasks

Anomaly DetectionDenoisingGPUImage GenerationUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

A majorization-minimization algorithm for nonnegative binary matrix factorization

2022-04-20 · Paul Magron, Cédric Févotte

This paper tackles the problem of decomposing binary data using matrix factorization. We consider the family of mean-parametrized Bernoulli models, a class of generative models that are well suited for modeling binary da…

Bayesian InferenceMatrix Completionvalid

Learning Mixtures of Bernoulli Templates by Two-Round EM with Performance Guarantee

2013-05-02 · Adrian Barbu, Tianfu Wu, Ying Nian Wu

Dasgupta and Shulman showed that a two-round variant of the EM algorithm can learn mixture of Gaussian distributions with near optimal precision with high probability if the Gaussian distributions are well separated and …

Adversarial Online Learning with noise

2018-10-22 · Alon Resler, Yishay Mansour

We present and study models of adversarial online learning where the feedback observed by the learner is noisy, and the feedback is either full information feedback or bandit feedback. Specifically, we consider binary lo…

Conformal testing in a binary model situation

2021-04-05 · Vladimir Vovk

Conformal testing is a way of testing the IID assumption based on conformal prediction. The topic of this note is computational evaluation of the performance of conformal testing in a model situation in which IID binary …

Conformal Predictionmodel

Learning from Binary Multiway Data: Probabilistic Tensor Decomposition and its Statistical Optimality

2018-11-13 · Miaoyan Wang, Lexin Li

We consider the problem of decomposing a higher-order tensor with binary entries. Such data problems arise frequently in applications such as neuroimaging, recommendation system, topic modeling, and sensor network locali…

ClusteringTensor Decomposition