paper-with-me

홈 › Papers

Latent Intrinsics Emerge from Training to Relight

2024-05-31 · Xiao Zhang, William Gao, Seemandhar Jain, Michael Maire, David. A. Forsyth, Anand Bhattad

Image relighting is the task of showing what a scene from a source image would look like if illuminated differently. Inverse graphics schemes recover an explicit representation of geometry and a set of chosen intrinsics, then relight with some form of renderer. However error control for inverse graphics is difficult, and inverse graphics methods can represent only the effects of the chosen intrinsics. This paper describes a relighting method that is entirely data-driven, where intrinsics and lighting are each represented as latent variables. Our approach produces SOTA relightings of real scenes, as measured by standard metrics. We show that albedo can be recovered from our latent intrinsics without using any example albedos, and that the albedos recovered are competitive with SOTA methods.

📄 PDF Abstract BibTeX arXiv:2405.21074

Code (0)

등록된 구현이 없습니다.

Tasks

Image Relighting

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Relighting as a Probe of Visual Priors via Augmented Latent Intrinsics

2026-02-01 · Xiaoyan Xing, Xiao Zhang, Sezer Karaoglu, Theo Gevers 외 arxiv

Image-to-image relighting requires representations that separate illumination from scene properties while preserving dense geometry, material, and photometric cues. We use this task as a probe of visual priors: unlike re…

Image Relighting

LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relighting

2024-11-29 · CVPR 2025 1 · Xiaoyan Xing, Konrad Groh, Sezer Karaoglu, Theo Gevers 외

We introduce LumiNet, a novel architecture that leverages generative models and latent intrinsic representations for effective lighting transfer. Given a source image and a target lighting image, LumiNet synthesizes a re…

Seeing a Rose in Five Thousand Ways

2022-12-09 · CVPR 2023 1 · Yunzhi Zhang, Shangzhe Wu, Noah Snavely, Jiajun Wu

What is a rose, visually? A rose comprises its intrinsics, including the distribution of geometry, texture, and material specific to its object category. With knowledge of these intrinsic properties, we may render roses …

Image GenerationIntrinsic Image DecompositionObject

Toward Real-World Adoption of Portrait Relighting via Hybrid Domain Knowledge Fusion

2026-04-25 · Qian Huang, Mayoore Selvarasa Jaiswal, Zhen Zhong, Rochelle Pereira 외 arxiv

The real-world adoption of portrait relighting is hindered by dataset domain gaps, camera sensitivity, and computational costs. We address these challenges with Hybrid Domain Knowledge Fusion, a paradigm that fuses the s…

Knowledge Distillation

Complementary Intrinsics From Neural Radiance Fields and CNNs for Outdoor Scene Relighting

2023-01-01 · CVPR 2023 1 · Siqi Yang, Xuanning Cui, Yongjie Zhu, Jiajun Tang 외

Relighting an outdoor scene is challenging due to the diverse illuminations and salient cast shadows. Intrinsic image decomposition on outdoor photo collections could partly solve this problem by weakly supervised la…

Intrinsic Image Decomposition