paper-with-me

Papers

PI-Light: Physics-Inspired Diffusion for Full-Image Relighting

2026-01-29 · Zhexin Liang, Zhaoxi Chen, Yongwei Chen, Tianyi Wei, Tengfei Wang, Xingang Pan arxiv

Full-image relighting remains a challenging problem due to the difficulty of collecting large-scale structured paired data, the difficulty of maintaining physical plausibility, and the limited generalizability imposed by data-driven priors. Existing attempts to bridge the synthetic-to-real gap for full-scene relighting remain suboptimal. To tackle these challenges, we introduce Physics-Inspired diffusion for full-image reLight ($π$-Light, or PI-Light), a two-stage framework that leverages physics-inspired diffusion models. Our design incorporates (i) batch-aware attention, which improves the consistency of intrinsic predictions across a collection of images, (ii) a physics-guided neural rendering module that enforces physically plausible light transport, (iii) physics-inspired losses that regularize training dynamics toward a physically meaningful landscape, thereby enhancing generalizability to real-world image editing, and (iv) a carefully curated dataset of diverse objects and scenes captured under controlled lighting conditions. Together, these components enable efficient finetuning of pretrained diffusion models while also providing a solid benchmark for downstream evaluation. Experiments demonstrate that $π$-Light synthesizes specular highlights and diffuse reflections across a wide variety of materials, achieving superior generalization to real-world scenes compared with prior approaches.

📄 PDF Abstract BibTeX arXiv:2601.22135

Code (0)

등록된 구현이 없습니다.

Tasks

Image RelightingImage Editing

Similar Papers 제목 키워드 기반

Physics-Inspired Generative Models in Medical Imaging: A Review

2024-07-15 · Dennis Hein, Afshin Bozorgpour, Dorit Merhof, Ge Wang

Physics-inspired Generative Models (GMs), in particular Diffusion Models (DMs) and Poisson Flow Models (PFMs), enhance Bayesian methods and promise great utility in medical imaging. This review examines the transformativ…

DenoisingImage GenerationImage Reconstruction

Diffusion-Based Material Regularization for Physics-Based Inverse Rendering

2026-06-30 · Jingwang Ling, Lifan Wu, Feng Xu, Shuang Zhao arxiv

Reconstructing physics-based 3D assets -- geometry, materials, and illumination -- from multi-view images is a core problem in computer graphics and vision, and a prerequisite for realistic relighting and editing. Physic…

Inverse Rendering

Immiscible Diffusion: Accelerating Diffusion Training with Noise Assignment

2024-06-18 · Yiheng Li, Heyang Jiang, Akio Kodaira, Masayoshi Tomizuka 외

In this paper, we point out that suboptimal noise-data mapping leads to slow training of diffusion models. During diffusion training, current methods diffuse each image across the entire noise space, resulting in a mixtu…

Denoising

SpotLight: Shadow-Guided Object Relighting via Diffusion

2024-11-27 · Frédéric Fortier-Chouinard, Zitian Zhang, Louis-Etienne Messier, Mathieu Garon 외

Recent work has shown that diffusion models can serve as powerful neural rendering engines that can be leveraged for inserting virtual objects into images. However, unlike typical physics-based renderers, these neural re…

Image RelightingNeural RenderingObject

Bayesian Methods for Media Mix Modelling with shape and funnel effects

2023-11-09 · Javier Marin

In recent years, significant progress in generative AI has highlighted the important role of physics-inspired models that utilize advanced mathematical concepts based on fundamental physics principles to enhance artifici…

Marketing