paper-with-me

홈 › Papers

Step-Calibrated Diffusion for Biomedical Optical Image Restoration

2024-03-20 · Yiwei Lyu, Sung Jik Cha, Cheng Jiang, Asadur Chowdury, Xinhai Hou, Edward Harake, Akhil Kondepudi, Christian Freudiger, Honglak Lee, Todd C. Hollon

High-quality, high-resolution medical imaging is essential for clinical care. Raman-based biomedical optical imaging uses non-ionizing infrared radiation to evaluate human tissues in real time and is used for early cancer detection, brain tumor diagnosis, and intraoperative tissue analysis. Unfortunately, optical imaging is vulnerable to image degradation due to laser scattering and absorption, which can result in diagnostic errors and misguided treatment. Restoration of optical images is a challenging computer vision task because the sources of image degradation are multi-factorial, stochastic, and tissue-dependent, preventing a straightforward method to obtain paired low-quality/high-quality data. Here, we present Restorative Step-Calibrated Diffusion (RSCD), an unpaired diffusion-based image restoration method that uses a step calibrator model to dynamically determine the number of steps required to complete the reverse diffusion process for image restoration. RSCD outperforms other widely used unpaired image restoration methods on both image quality and perceptual evaluation metrics for restoring optical images. Medical imaging experts consistently prefer images restored using RSCD in blinded comparison experiments and report minimal to no hallucinations. Finally, we show that RSCD improves performance on downstream clinical imaging tasks, including automated brain tumor diagnosis and deep tissue imaging. Our code is available at https://github.com/MLNeurosurg/restorative_step-calibrated_diffusion.

📄 PDF Abstract BibTeX arXiv:2403.13680

Code (2)

mlneurosurg/restorative_step-calibrated_diffusion 공식 구현 pytorch
mlneurosurg/truncated_diffusion 공식 구현 pytorch

Tasks

DiagnosticImage GenerationImage Restoration

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Retinal OCT Synthesis with Denoising Diffusion Probabilistic Models for Layer Segmentation

2023-11-09 · Yuli Wu, Weidong He, Dennis Eschweiler, Ningxin Dou 외

Modern biomedical image analysis using deep learning often encounters the challenge of limited annotated data. To overcome this issue, deep generative models can be employed to synthesize realistic biomedical images. In …

DenoisingImage GenerationSegmentation

MDiff-FMT: Morphology-aware Diffusion Model for Fluorescence Molecular Tomography with Small-scale Datasets

2024-10-09 · Peng Zhang, Qianqian Xue, Xingyu Liu, Guanglei Zhang 외

Fluorescence molecular tomography (FMT) is a sensitive optical imaging technology widely used in biomedical research. However, the ill-posedness of the inverse problem poses a huge challenge to FMT reconstruction. Althou…

Denoising

LLaDA-MedV: Exploring Large Language Diffusion Models for Biomedical Image Understanding

2025-08-03 · Xuanzhao Dong, Wenhui Zhu, Xiwen Chen, Zhipeng Wang 외 arxiv

Autoregressive models (ARMs) have long dominated the landscape of biomedical vision-language models (VLMs). Recently, masked diffusion models such as LLaDA have emerged as promising alternatives, yet their application in…

Optical Diffusion Models for Image Generation

2024-07-15 · Ilker Oguz, Niyazi Ulas Dinc, Mustafa Yıldırım, Junjie Ke 외

Diffusion models generate new samples by progressively decreasing the noise from the initially provided random distribution. This inference procedure generally utilizes a trained neural network numerous times to obtain t…

DenoisingImage Generation

Super-resolution of biomedical volumes with 2D supervision

2024-04-15 · Cheng Jiang, Alexander Gedeon, Yiwei Lyu, Eric Landgraf 외

Volumetric biomedical microscopy has the potential to increase the diagnostic information extracted from clinical tissue specimens and improve the diagnostic accuracy of both human pathologists and computational patholog…

DiagnosticSuper-Resolution