paper-with-me

홈 › Papers

DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection

2023-11-26 · Sergio Naval Marimont, Matthew Baugh, Vasilis Siomos, Christos Tzelepis, Bernhard Kainz, Giacomo Tarroni

Unsupervised Anomaly Detection (UAD) techniques aim to identify and localize anomalies without relying on annotations, only leveraging a model trained on a dataset known to be free of anomalies. Diffusion models learn to modify inputs $x$ to increase the probability of it belonging to a desired distribution, i.e., they model the score function $\nabla_x \log p(x)$. Such a score function is potentially relevant for UAD, since $\nabla_x \log p(x)$ is itself a pixel-wise anomaly score. However, diffusion models are trained to invert a corruption process based on Gaussian noise and the learned score function is unlikely to generalize to medical anomalies. This work addresses the problem of how to learn a score function relevant for UAD and proposes DISYRE: Diffusion-Inspired SYnthetic REstoration. We retain the diffusion-like pipeline but replace the Gaussian noise corruption with a gradual, synthetic anomaly corruption so the learned score function generalizes to medical, naturally occurring anomalies. We evaluate DISYRE on three common Brain MRI UAD benchmarks and substantially outperform other methods in two out of the three tasks.

📄 PDF Abstract BibTeX arXiv:2311.15453

Code (1)

snavalm/disyre pytorch

Tasks

Anomaly DetectionUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Ensembled Cold-Diffusion Restorations for Unsupervised Anomaly Detection

2024-07-09 · Sergio Naval Marimont, Vasilis Siomos, Matthew Baugh, Christos Tzelepis 외

Unsupervised Anomaly Detection (UAD) methods aim to identify anomalies in test samples comparing them with a normative distribution learned from a dataset known to be anomaly-free. Approaches based on generative models o…

Anomaly DetectionUnsupervised Anomaly Detection

Towards Unsupervised Blind Face Restoration using Diffusion Prior

2024-10-06 · Tianshu Kuai, Sina Honari, Igor Gilitschenski, Alex Levinshtein

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face im…

Blind Face Restoration

Taming Generative Diffusion Prior for Universal Blind Image Restoration

2024-08-21 · Siwei Tu, Weidong Yang, Ben Fei

Diffusion models have been widely utilized for image restoration. However, previous blind image restoration methods still need to assume the type of degradation model while leaving the parameters to be optimized, limitin…

Image RestorationMathematical Reasoning

Unsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Features

2023-04-28 · Nurislam Tursynbek, Marc Niethammer

Inspired by recent findings that generative diffusion models learn semantically meaningful representations, we use them to discover the intrinsic hierarchical structure in biomedical 3D images using unsupervised segmenta…

Segmentation

Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Models

2024-04-15 · Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund 외

Though diffusion models have been successfully applied to various image restoration (IR) tasks, their performance is sensitive to the choice of training datasets. Typically, diffusion models trained in specific datasets …

Image GenerationImage RestorationLanguage ModelingLanguage Modelling+1