Single Image Reflection Separation with Perceptual Losses
We present an approach to separating reflection from a single image. The approach uses a fully convolutional network trained end-to-end with losses that exploit low-level and high-level image information. Our loss function includes two perceptual losses: a feature loss from a visual perception network, and an adversarial loss that encodes characteristics of images in the transmission layers. We also propose a novel exclusion loss that enforces pixel-level layer separation. We create a dataset of real-world images with reflection and corresponding ground-truth transmission layers for quantitative evaluation and model training. We validate our method through comprehensive quantitative experiments and show that our approach outperforms state-of-the-art reflection removal methods in PSNR, SSIM, and perceptual user study. We also extend our method to two other image enhancement tasks to demonstrate the generality of our approach.
Code (3)
Tasks
Image EnhancementReflection RemovalSSIMSimilar Papers 제목 키워드 기반
ReflexSplit: Single Image Reflection Separation via Layer Fusion-Separation
Single Image Reflection Separation (SIRS) disentangles mixed images into transmission and reflection layers. Existing methods suffer from transmission-reflection confusion under nonlinear mixing, particularly in deep dec…
Unsupervised Single-Image Reflection Separation Using Perceptual Deep Image Priors
Reflections often degrade the quality of the image by obstructing the background scene. This is not desirable for everyday users, and it negatively impacts the performance of multimedia applications that process images w…
Learning to Jointly Generate and Separate Reflections
Existing learning-based single image reflection removal methods using paired training data have fundamental limitations about the generalization capability on real-world reflections due to the limited variations in train…
Multi-Task LearningReflection RemovalWeakly-supervised LearningReflection Separation from a Single Image via Joint Latent Diffusion
Single-image reflection separation is highly challenging under extreme conditions like glare or weak reflections. Existing methods often struggle to recover both layers in glare or weak-reflection scenarios because of in…
PRISM: Latent Composition Consistency for Single-Image Reflection Removal
Single-image reflection removal (SIRR) seeks to recover the transmission layer from a mixture corrupted by reflections -- a severely ill-posed problem. Existing methods operate in pixel space, where the nonlinear sRGB fo…
Contrastive LearningReflection Removal