FreeShadow: Training-Free Shadow Removal via Illumination Transfer and Selective Content Preservation in Diffusion Models
Existing supervised and unsupervised shadow removal methods often suffer from limited generalization due to the insufficient diversity of available training datasets, while zero-shot methods tend to produce artifacts and require time-consuming test-time optimization. To address these issues, we propose FreeShadow, a training-free shadow removal method built upon pretrained diffusion models, which exploits diffusion priors for shadow removal without any training or optimization. For illumination recovery, we propose an illumination transfer attention (ITA), which re-weights the self-attention maps in diffusion model to transfer illumination cues from non-shadow to shadow regions. For content preservation, we analyze the effects of illumination variations on self-attention maps and latent high-frequency features in diffusion model, and selectively preserve illumination-invariant components to maintain content fidelity while suppressing residual shadows. We further propose local texture-preserving relighting (LTPR) to mitigate local texture misalignment caused by VAE compression. Extensive experiments demonstrate that our method achieves strong generalization and produces realistic shadow-free images.
Code (0)
등록된 구현이 없습니다.
Tasks
Shadow RemovalSimilar Papers 제목 키워드 기반
OmniSR: Shadow Removal under Direct and Indirect Lighting
Shadows can originate from occlusions in both direct and indirect illumination. Although most current shadow removal research focuses on shadows caused by direct illumination, shadows from indirect illumination are often…
Image Shadow RemovalShadow RemovalRIS-GAN: Explore Residual and Illumination with Generative Adversarial Networks for Shadow Removal
Residual images and illumination estimation have been proved very helpful in image enhancement. In this paper, we propose a general and novel framework RIS-GAN which explores residual and illumination with Generative Adv…
Image EnhancementShadow RemovalRetinex-guided Histogram Transformer for Mask-free Shadow Removal
While deep learning methods have achieved notable progress in shadow removal, many existing approaches rely on shadow masks that are difficult to obtain, limiting their generalization to real-world scenes. In this work, …
Shadow RemovalEfficient Model-Driven Network for Shadow Removal
Abstract: Deep Convolutional Neural Networks (CNNs)-based methods have achieved significant breakthroughs in the task of single image shadow removal. However, the performance of these methods remains limited for several …
Image Shadow RemovalmodelShadow RemovalPhysics-based Shadow Image Decomposition for Shadow Removal
We propose a novel deep learning method for shadow removal. Inspired by physical models of shadow formation, we use a linear illumination transformation to model the shadow effects in the image that allows the shadow ima…
Shadow Removal