Deep Single Image Deraining using An Asymetric Cycle Generative and Adversarial Framework
In reality, rain and fog are often present at the same time, which can greatly reduce the clarity and quality of the scene image. However, most unsupervised single image deraining methods mainly focus on rain streak removal by disregarding the fog, which leads to low-quality deraining performance. In addition, the samples are rather homogeneous generated by these methods and lack diversity, resulting in poor results in the face of complex rain scenes. To address the above issues, we propose a novel Asymetric Cycle Generative and Adversarial framework (ACGF) for single image deraining that trains on both synthetic and real rainy images while simultaneously capturing both rain streaks and fog features. ACGF consists of a Rain-fog2Clean (R2C) transformation block and a Clean2Rain-fog (C2R) transformation block. The former consists of parallel rain removal path and rain-fog feature extraction path by the rain and derain-fog network and the attention rain-fog feature extraction network (ARFE) , while the latter only contains a synthetic rain transformation path. In rain-fog feature extraction path, to better characterize the rain-fog fusion feature, we employ an ARFE to exploit the self-similarity of global and local rain-fog information by learning the spatial feature correlations. Moreover, to improve the translational capacity of C2R and the diversity of models, we design a rain-fog feature decoupling and reorganization network (RFDR) by embedding a rainy image degradation model and a mixed discriminator to preserve richer texture details in synthetic rain conversion path. Extensive experiments on benchmark rain-fog and rain datasets show that ACGF outperforms state-of-the-art deraining methods. We also conduct defogging performance evaluation experiments to further demonstrate the effectiveness of ACGF.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityRain RemovalSingle Image DerainingSimilar Papers 제목 키워드 기반
DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking
Single image deraining (SID) is an important and challenging topic in emerging vision applications, and most of emerged deraining methods are supervised relying on the ground truth (i.e., paired images) in recent years. …
Rain RemovalSingle Image DerainingCycle Contrastive Adversarial Learning for Unsupervised image Deraining
To tackle the difficulties in fitting paired real-world data for single image deraining (SID), recent unsupervised methods have achieved notable success. However, these methods often struggle to generate high-quality, ra…
Contrastive LearningGenerative Adversarial NetworkImage ReconstructionRain Removal+1Single Image Deraining: From Model-Based to Data-Driven and Beyond
The goal of single-image deraining is to restore the rain-free background scenes of an image degraded by rain streaks and rain accumulation. The early single-image deraining methods employ a cost function, where various …
Rain RemovalSingle Image DerainingRethinking Real-world Image Deraining via An Unpaired Degradation-Conditioned Diffusion Model
Recent diffusion models have exhibited great potential in generative modeling tasks. Part of their success can be attributed to the ability of training stable on huge sets of paired synthetic data. However, adapting thes…
Rain RemovalTranslationUnfairGAN: An Enhanced Generative Adversarial Network for Raindrop Removal from A Single Image
Image deraining is a new challenging problem in real-world applications, such as autonomous vehicles. In a bad weather condition of heavy rainfall, raindrops, mainly hitting glasses or windshields, can significantly redu…
Autonomous VehiclesGenerative Adversarial NetworkRaindrop RemovalRain Removal