paper-with-me

Papers

Diffusion Enhancement for Cloud Removal in Ultra-Resolution Remote Sensing Imagery

2024-01-25 · Jialu Sui, Yiyang Ma, Wenhan Yang, Xiaokang Zhang, Man-on Pun, Jiaying Liu

The presence of cloud layers severely compromises the quality and effectiveness of optical remote sensing (RS) images. However, existing deep-learning (DL)-based Cloud Removal (CR) techniques encounter difficulties in accurately reconstructing the original visual authenticity and detailed semantic content of the images. To tackle this challenge, this work proposes to encompass enhancements at the data and methodology fronts. On the data side, an ultra-resolution benchmark named CUHK Cloud Removal (CUHK-CR) of 0.5m spatial resolution is established. This benchmark incorporates rich detailed textures and diverse cloud coverage, serving as a robust foundation for designing and assessing CR models. From the methodology perspective, a novel diffusion-based framework for CR called Diffusion Enhancement (DE) is proposed to perform progressive texture detail recovery, which mitigates the training difficulty with improved inference accuracy. Additionally, a Weight Allocation (WA) network is developed to dynamically adjust the weights for feature fusion, thereby further improving performance, particularly in the context of ultra-resolution image generation. Furthermore, a coarse-to-fine training strategy is applied to effectively expedite training convergence while reducing the computational complexity required to handle ultra-resolution images. Extensive experiments on the newly established CUHK-CR and existing datasets such as RICE confirm that the proposed DE framework outperforms existing DL-based methods in terms of both perceptual quality and signal fidelity.

📄 PDF Abstract BibTeX arXiv:2401.15105

Code (1)

littlebeen/Diffusion-Enhancement-for-CR 공식 구현 pytorch

Tasks

Cloud RemovalImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-sensing Images

2024-03-18 · Meilin Wang, Yexing Song, Pengxu Wei, Xiaoyu Xian 외

Deep learning technologies have demonstrated their effectiveness in removing cloud cover from optical remote-sensing images. Convolutional Neural Networks (CNNs) exert dominance in the cloud removal tasks. However, const…

Cloud RemovalImage GenerationImage Reconstruction

Multimodal Diffusion Bridge with Attention-Based SAR Fusion for Satellite Image Cloud Removal

2025-04-04 · Yuyang Hu, Suhas Lohit, Ulugbek S. Kamilov, Tim K. Marks

Deep learning has achieved some success in addressing the challenge of cloud removal in optical satellite images, by fusing with synthetic aperture radar (SAR) images. Recently, diffusion models have emerged as powerful …

Cloud RemovalImage Restoration

Ultrasound Image Enhancement with the Variance of Diffusion Models

2024-09-17 · Yuxin Zhang, Clément Huneau, Jérôme Idier, Diana Mateus

Ultrasound imaging, despite its widespread use in medicine, often suffers from various sources of noise and artifacts that impact the signal-to-noise ratio and overall image quality. Enhancing ultrasound images requires …

DenoisingImage Enhancement

Multi-Modal and Multi-Resolution Data Fusion for High-Resolution Cloud Removal: A Novel Baseline and Benchmark

2023-01-09 · Fang Xu, Yilei Shi, Patrick Ebel, Wen Yang 외

Cloud removal is a significant and challenging problem in remote sensing, and in recent years, there have been notable advancements in this area. However, two major issues remain hindering the development of cloud remova…

Cloud RemovalImage ReconstructionSemantic Segmentation

Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement

2023-02-23 · Chongyi Li, Chun-Le Guo, Man Zhou, Zhexin Liang 외

Ultra-High-Definition (UHD) photo has gradually become the standard configuration in advanced imaging devices. The new standard unveils many issues in existing approaches for low-light image enhancement (LLIE), especiall…

4kImage EnhancementLow-Light Image EnhancementVocal Bursts Intensity Prediction