Fundus image enhancement through direct diffusion bridges
We propose FD3, a fundus image enhancement method based on direct diffusion bridges, which can cope with a wide range of complex degradations, including haze, blur, noise, and shadow. We first propose a synthetic forward model through a human feedback loop with board-certified ophthalmologists for maximal quality improvement of low-quality in-vivo images. Using the proposed forward model, we train a robust and flexible diffusion-based image enhancement network that is highly effective as a stand-alone method, unlike previous diffusion model-based approaches which act only as a refiner on top of pre-trained models. Through extensive experiments, we show that FD3 establishes \add{superior quality} not only on synthetic degradations but also on in vivo studies with low-quality fundus photos taken from patients with cataracts or small pupils. To promote further research in this area, we open-source all our code and data used for this research at https://github.com/heeheee888/FD3
Code (1)
Tasks
Image EnhancementMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Enhancement From Degradation: A Diffusion Model For Fundus Image Enhancement
The quality of a fundus image can be compromised by numerous factors, many of which are challenging to be appropriately and mathematically modeled. In this paper, we introduce a novel diffusion model based framework, nam…
Image EnhancementSGW-GAN: Sliced Gromov-Wasserstein Guided GANs for Retinal Fundus Image Enhancement
Retinal fundus photography is indispensable for ophthalmic screening and diagnosis, yet image quality is often degraded by noise, artifacts, and uneven illumination. Recent GAN- and diffusion-based enhancement methods im…
Diabetic Retinopathy GradingMedical Image EnhancementFundus Image Quality Assessment and Enhancement: a Systematic Review
As an affordable and convenient eye scan, fundus photography holds the potential for preventing vision impairment, especially in resource-limited regions. However, fundus image degradation is common under intricate imagi…
Image Quality AssessmentModeling and Enhancing Low-quality Retinal Fundus Images
Retinal fundus images are widely used for the clinical screening and diagnosis of eye diseases. However, fundus images captured by operators with various levels of experience have a large variation in quality. Low-qualit…
Image EnhancementMedical Image AnalysisRetinal Vessel SegmentationA Generic Fundus Image Enhancement Network Boosted by Frequency Self-supervised Representation Learning
Fundus photography is prone to suffer from image quality degradation that impacts clinical examination performed by ophthalmologists or intelligent systems. Though enhancement algorithms have been developed to promote fu…
Image EnhancementRepresentation Learning