paper-with-me

Papers

RelightVid: Temporal-Consistent Diffusion Model for Video Relighting

2025-01-27 · Ye Fang, Zeyi Sun, Shangzhan Zhang, Tong Wu, Yinghao Xu, Pan Zhang, Jiaqi Wang, Gordon Wetzstein, Dahua Lin

Diffusion models have demonstrated remarkable success in image generation and editing, with recent advancements enabling albedo-preserving image relighting. However, applying these models to video relighting remains challenging due to the lack of paired video relighting datasets and the high demands for output fidelity and temporal consistency, further complicated by the inherent randomness of diffusion models. To address these challenges, we introduce RelightVid, a flexible framework for video relighting that can accept background video, text prompts, or environment maps as relighting conditions. Trained on in-the-wild videos with carefully designed illumination augmentations and rendered videos under extreme dynamic lighting, RelightVid achieves arbitrary video relighting with high temporal consistency without intrinsic decomposition while preserving the illumination priors of its image backbone.

📄 PDF Abstract BibTeX arXiv:2501.16330

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationImage Relightingmodel

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

RelightMaster: Precise Video Relighting with Multi-plane Light Images

2025-11-09 · Weikang Bian, Xiaoyu Shi, Zhaoyang Huang, Jianhong Bai 외 arxiv

Recent advances in diffusion models enable high-quality video generation and editing, but precise relighting with consistent video contents, which is critical for shaping scene atmosphere and viewer attention, remains un…

Video Generation

HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformers

2026-06-27 · Jing Yang, Mayoore Jaiswal, Zian Wang, Steven Zeng 외 arxiv

Diffusion-based video relighting enables controllable relighting from a single input video, but modern video diffusion backbones are trained on short clips and applied to long-horizon videos through chunked sliding-windo…

Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset

2025-03-18 · CVPR 2025 1 · Yiqun Mei, Mingming He, Li Ma, Julien Philip 외

Video portrait relighting remains challenging because the results need to be both photorealistic and temporally stable. This typically requires a strong model design that can capture complex facial reflections as well as…

Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap

2025-10-27 · Elisabeth Jüttner, Janelle Pfeifer, Leona Krath, Stefan Korfhage 외 arxiv

Volumetric video relighting is essential for bringing captured performances into virtual worlds, but current approaches struggle to deliver temporally stable, production-ready results. Diffusion-based intrinsic decomposi…

BodyReLux: Temporally Consistent Full-Body Video Relighting

2026-05-20 · Li Ma, Mingming He, Xueming Yu, David M. George 외 arxiv

Being able to relight human performance is a fundamental task for post production and content creation. We present BodyReLux, a subject-specific video diffusion-based framework for relighting full-body human performances…

Data Augmentation