Unpaired Learning for Deep Image Deraining With Rain Direction Regularizer
We present a simple yet effective unpaired learning based image rain removal method from an unpaired set of synthetic images and real rainy images by exploring the properties of rain maps. The proposed algorithm mainly consists of a semi-supervised learning part and a knowledge distillation part. The semi-supervised part estimates the rain map and reconstructs the derained image based on the well-established layer separation principle. To facilitate rain removal, we develop a rain direction regularizer to constrain the rain estimation network in the semi-supervised learning part. With the estimated rain maps from the semi-supervised learning part, we first synthesize a new paired set by adding to rain-free images based on the superimposition model. The real rainy images and the derained results constitute another paired set. Then we develop an effective knowledge distillation method to explore such two paired sets so that the deraining model in the semi-supervised learning part is distilled. We propose two new rainy datasets, named RainDirection and Real3000, to validate the effectiveness of the proposed method. Both quantitative and qualitative experimental results demonstrate that the proposed method achieves favorable results against state-of-the-art methods in benchmark datasets and real-world images.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationRain RemovalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unpaired Deep Image Deraining Using Dual Contrastive Learning
Learning single image deraining (SID) networks from an unpaired set of clean and rainy images is practical and valuable as acquiring paired real-world data is almost infeasible. However, without the paired data as the su…
Contrastive LearningImage RestorationRain RemovalSingle Image DerainingRethinking Real-world Image Deraining via An Unpaired Degradation-Conditioned Diffusion Model
Recent diffusion models have exhibited great potential in generative modeling tasks. Part of their success can be attributed to the ability of training stable on huge sets of paired synthetic data. However, adapting thes…
Rain RemovalTranslationUnpaired Photo-realistic Image Deraining with Energy-informed Diffusion Model
Existing unpaired image deraining approaches face challenges in accurately capture the distinguishing characteristics between the rainy and clean domains, resulting in residual degradation and color distortion within the…
Rain RemovalUnpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategy
Unsupervised deraining has attracted attention for its ability to learn the real-world distribution of rain without paired supervision. However, the lack of strong constraints makes it difficult for the network to conver…
Image Quality AssessmentChannel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Deraining
Recently, deep image deraining models based on paired datasets have made a series of remarkable progress. However, they cannot be well applied in real-world applications due to the difficulty of obtaining real paired dat…
Rain Removal