paper-with-me

Papers

Tackling Hallucination from Conditional Models for Medical Image Reconstruction with DynamicDPS

2025-03-03 · Seunghoi Kim, Henry F. J. Tregidgo, Matteo Figini, Chen Jin, Sarang Joshi, Daniel C. Alexander

Hallucinations are spurious structures not present in the ground truth, posing a critical challenge in medical image reconstruction, especially for data-driven conditional models. We hypothesize that combining an unconditional diffusion model with data consistency, trained on a diverse dataset, can reduce these hallucinations. Based on this, we propose DynamicDPS, a diffusion-based framework that integrates conditional and unconditional diffusion models to enhance low-quality medical images while systematically reducing hallucinations. Our approach first generates an initial reconstruction using a conditional model, then refines it with an adaptive diffusion-based inverse problem solver. DynamicDPS skips early stage in the reverse process by selecting an optimal starting time point per sample and applies Wolfe's line search for adaptive step sizes, improving both efficiency and image fidelity. Using diffusion priors and data consistency, our method effectively reduces hallucinations from any conditional model output. We validate its effectiveness in Image Quality Transfer for low-field MRI enhancement. Extensive evaluations on synthetic and real MR scans, including a downstream task for tissue volume estimation, show that DynamicDPS reduces hallucinations, improving relative volume estimation by over 15% for critical tissues while using only 5% of the sampling steps required by baseline diffusion models. As a model-agnostic and fine-tuning-free approach, DynamicDPS offers a robust solution for hallucination reduction in medical imaging. The code will be made publicly available upon publication.

📄 PDF Abstract BibTeX arXiv:2503.01075

Code (0)

등록된 구현이 없습니다.

Tasks

HallucinationImage Reconstruction

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Tackling Structural Hallucination in Image Translation with Local Diffusion

2024-04-09 · Seunghoi Kim, Chen Jin, Tom Diethe, Matteo Figini 외

Recent developments in diffusion models have advanced conditioned image generation, yet they struggle with reconstructing out-of-distribution (OOD) images, such as unseen tumors in medical images, causing "image hallucin…

HallucinationImage GenerationTranslation

Triggering hallucinations in model-based MRI reconstruction via adversarial perturbations

2026-02-20 · Suna Buğday, Yvan Saeys, Jonathan Peck arxiv

Generative models are increasingly used to improve the quality of medical imaging, such as reconstruction of magnetic resonance images and computed tomography. However, it is well-known that such models are susceptible t…

Image ReconstructionMRI Reconstruction

Conditional Hallucinations for Image Compression

2024-10-25 · Till Aczel, Roger Wattenhofer

In lossy image compression, models face the challenge of either hallucinating details or generating out-of-distribution samples due to the information bottleneck. This implies that at times, introducing hallucinations is…

HallucinationImage Compression

MPFlow: Multi-modal Posterior-Guided Flow Matching for Zero-Shot MRI Reconstruction

2026-03-04 · Seunghoi Kim, Chen Jin, Henry F. J. Tregidgo, Matteo Figini 외 arxiv

Zero-shot MRI reconstruction relies on generative priors, but single-modality unconditional priors produce hallucinations under severe ill-posedness. In many clinical workflows, complementary MRI acquisitions (e.g. high-…

MRI Reconstruction

Uncertainty Estimation in Medical Image Denoising with Bayesian Deep Image Prior

2020-08-20 · Max-Heinrich Laves, Malte Tölle, Tobias Ortmaier

Uncertainty quantification in inverse medical imaging tasks with deep learning has received little attention. However, deep models trained on large data sets tend to hallucinate and create artifacts in the reconstructed …

DenoisingImage DenoisingMedical Image DenoisingUncertainty Quantification