paper-with-me

홈 › Papers

Retinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theory

2024-07-29 · Xiaoyan Xing, Vincent Tao Hu, Jan Hendrik Metzen, Konrad Groh, Sezer Karaoglu, Theo Gevers

This paper introduces a novel approach to illumination manipulation in diffusion models, addressing the gap in conditional image generation with a focus on lighting conditions. We conceptualize the diffusion model as a black-box image render and strategically decompose its energy function in alignment with the image formation model. Our method effectively separates and controls illumination-related properties during the generative process. It generates images with realistic illumination effects, including cast shadow, soft shadow, and inter-reflections. Remarkably, it achieves this without the necessity for learning intrinsic decomposition, finding directions in latent space, or undergoing additional training with new datasets.

📄 PDF Abstract BibTeX arXiv:2407.20785

Code (0)

등록된 구현이 없습니다.

Tasks

Conditional Image GenerationImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model

2023-08-25 · ICCV 2023 1 · Xunpeng Yi, Han Xu, Hao Zhang, Linfeng Tang 외

In this paper, we rethink the low-light image enhancement task and propose a physically explainable and generative diffusion model for low-light image enhancement, termed as Diff-Retinex. We aim to integrate the advantag…

Conditional Image GenerationImage EnhancementImage GenerationLow-Light Image Enhancement

LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models

2024-07-12 · Hai Jiang, Ao Luo, Xiaohong Liu, Songchen Han 외

In this paper, we propose a diffusion-based unsupervised framework that incorporates physically explainable Retinex theory with diffusion models for low-light image enhancement, named LightenDiffusion. Specifically, we p…

Image EnhancementLow-Light Image Enhancement

Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model

2023-11-20 · Chunming He, Chengyu Fang, Yulun Zhang, Tian Ye 외

Illumination degradation image restoration (IDIR) techniques aim to improve the visibility of degraded images and mitigate the adverse effects of deteriorated illumination. Among these algorithms, diffusion model (DM)-ba…

Image Restoration

A Novel Retinex-Based Fractional-Order Variational Model for Image with Severely Low Light

2020-11-02 · Zhihao Gu, Fang Li, Faming Fang, and Guixu Zhang

In this paper, we propose a novel Retinex-based fractional-order variational model for severely low-light images. The proposed method is more flexible in controlling the reg- ularization extent than the existing integ…

Retinexmamba: Retinex-based Mamba for Low-light Image Enhancement

2024-05-06 · Jiesong Bai, Yuhao Yin, Qiyuan He, Yuanxian Li 외

In the field of low-light image enhancement, both traditional Retinex methods and advanced deep learning techniques such as Retinexformer have shown distinct advantages and limitations. Traditional Retinex methods, desig…

Computational EfficiencyDeep LearningImage EnhancementLow-Light Image Enhancement+3