Intrinsic Image Transfer for Illumination Manipulation
This paper presents a novel intrinsic image transfer (IIT) algorithm for illumination manipulation, which creates a local image translation between two illumination surfaces. This model is built on an optimization-based framework consisting of three photo-realistic losses defined on the sub-layers factorized by an intrinsic image decomposition. We illustrate that all losses can be reduced without the necessity of taking an intrinsic image decomposition under the well-known spatial-varying illumination illumination-invariant reflectance prior knowledge. Moreover, with a series of relaxations, all of them can be directly defined on images, giving a closed-form solution for image illumination manipulation. This new paradigm differs from the prevailing Retinex-based algorithms, as it provides an implicit way to deal with the per-pixel image illumination. We finally demonstrate its versatility and benefits to the illumination-related tasks such as illumination compensation, image enhancement, and high dynamic range (HDR) image compression, and show the high-quality results on natural image datasets.
Code (1)
Tasks
Image CompressionImage EnhancementIntrinsic Image DecompositionTranslationSimilar Papers 제목 키워드 기반
Intrinsic Image Harmonization
Compositing an image usually inevitably suffers from inharmony problem that is mainly caused by incompatibility of foreground and background from two different images with distinct surfaces and lights, corresponding …
BenchmarkingImage HarmonizationIntrinsicEdit: Precise generative image manipulation in intrinsic space
Generative diffusion models have advanced image editing with high-quality results and intuitive interfaces such as prompts and semantic drawing. However, these interfaces lack precise control, and the associated methods …
Image ManipulationRetinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theory
This paper introduces a novel approach to illumination manipulation in diffusion models, addressing the gap in conditional image generation with a focus on lighting conditions. We conceptualize the diffusion model as a b…
Conditional Image GenerationImage GenerationVIDIT: Virtual Image Dataset for Illumination Transfer
Deep image relighting is gaining more interest lately, as it allows photo enhancement through illumination-specific retouching without human effort. Aside from aesthetic enhancement and photo montage, image relighting is…
Domain AdaptationImage RelightingSimulating Makeup Through Physics-Based Manipulation of Intrinsic Image Layers
We present a method for simulating makeup in a face image. To generate realistic results without detailed geometric and reflectance measurements of the user, we propose to separate the image into intrinsic image layers a…