Retinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theory
This paper introduces a novel approach to illumination manipulation in diffusion models, addressing the gap in conditional image generation with a focus on lighting conditions. We conceptualize the diffusion model as a black-box image render and strategically decompose its energy function in alignment with the image formation model. Our method effectively separates and controls illumination-related properties during the generative process. It generates images with realistic illumination effects, including cast shadow, soft shadow, and inter-reflections. Remarkably, it achieves this without the necessity for learning intrinsic decomposition, finding directions in latent space, or undergoing additional training with new datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Conditional Image GenerationImage GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model
In this paper, we rethink the low-light image enhancement task and propose a physically explainable and generative diffusion model for low-light image enhancement, termed as Diff-Retinex. We aim to integrate the advantag…
Conditional Image GenerationImage EnhancementImage GenerationLow-Light Image EnhancementLightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models
In this paper, we propose a diffusion-based unsupervised framework that incorporates physically explainable Retinex theory with diffusion models for low-light image enhancement, named LightenDiffusion. Specifically, we p…
Image EnhancementLow-Light Image EnhancementReti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model
Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination. Among these algorithms, diffusion model (DM)-ba…
Image RestorationA Novel Retinex-Based Fractional-Order Variational Model for Image with Severely Low Light
In this paper, we propose a novel Retinex-based fractional-order variational model for severely low-light images. The proposed method is more flexible in controlling the reg- ularization extent than the existing integ…
Retinexmamba: Retinex-based Mamba for Low-light Image Enhancement
In the field of low-light image enhancement, both traditional Retinex methods and advanced deep learning techniques such as Retinexformer have shown distinct advantages and limitations. Traditional Retinex methods, desig…
Computational EfficiencyDeep LearningImage EnhancementLow-Light Image Enhancement+3