paper-with-me

홈 › Papers

Toward Real-World Adoption of Portrait Relighting via Hybrid Domain Knowledge Fusion

2026-04-25 · Qian Huang, Mayoore Selvarasa Jaiswal, Zhen Zhong, Rochelle Pereira, Jianyuan Min arxiv

The real-world adoption of portrait relighting is hindered by dataset domain gaps, camera sensitivity, and computational costs. We address these challenges with Hybrid Domain Knowledge Fusion, a paradigm that fuses the specialized strengths of synthetic, One-Light-at-A-Time (OLAT), and real-world datasets into a compact model. Our approach features specialized prior models hardened by domain-aware adaptation, followed by augmented knowledge distillation into a lightweight student model with multi-domain expertise. Our method demonstrates a 6x to 240x inference speedup while maintaining state-of-the-art (SOTA) visual quality in the experiments. Additionally, we construct a massive, high-fidelity synthetic dataset with diverse ground-truth intrinsics to support our training pipeline.

📄 PDF Abstract BibTeX arXiv:2604.23094

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Distillation

Similar Papers 제목 키워드 기반

Neural Video Portrait Relighting in Real-time via Consistency Modeling

2021-04-01 · ICCV 2021 10 · Longwen Zhang, Qixuan Zhang, Minye Wu, Jingyi Yu 외

Video portraits relighting is critical in user-facing human photography, especially for immersive VR/AR experience. Recent advances still fail to recover consistent relit result under dynamic illuminations from monocular…

DecoderDisentanglementSingle-Image Portrait Relighting

Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset

2025-03-18 · CVPR 2025 1 · Yiqun Mei, Mingming He, Li Ma, Julien Philip 외

Video portrait relighting remains challenging because the results need to be both photorealistic and temporally stable. This typically requires a strong model design that can capture complex facial reflections as well as…

Pixel Cube: Diffusion-based Portrait Video Relighting Through Realistic Lighting Reproduction

2026-06-01 · Yufan Zhang, Yu Ji, Ayo Ajiboye, Rundi Wu 외 arxiv

We present a diffusion-based method for relighting dynamic portrait videos with photorealism and temporal consistency. Our method is fueled by a hybrid training dataset that consists of real-captured and rendered dynamic…

Lite2Relight: 3D-aware Single Image Portrait Relighting

2024-07-15 · Pramod Rao, Gereon Fox, Abhimitra Meka, Mallikarjun B R 외

Achieving photorealistic 3D view synthesis and relighting of human portraits is pivotal for advancing AR/VR applications. Existing methodologies in portrait relighting demonstrate substantial limitations in terms of gene…

Single-Image Portrait Relighting

LightPainter: Interactive Portrait Relighting with Freehand Scribble

2023-03-22 · CVPR 2023 1 · Yiqun Mei, He Zhang, Xuaner Zhang, Jianming Zhang 외

Recent portrait relighting methods have achieved realistic results of portrait lighting effects given a desired lighting representation such as an environment map. However, these methods are not intuitive for user intera…