paper-with-me

Papers

Controllable Light Diffusion for Portraits

2023-05-08 · CVPR 2023 1 · David Futschik, Kelvin Ritland, James Vecore, Sean Fanello, Sergio Orts-Escolano, Brian Curless, Daniel Sýkora, Rohit Pandey

We introduce light diffusion, a novel method to improve lighting in portraits, softening harsh shadows and specular highlights while preserving overall scene illumination. Inspired by professional photographers' diffusers and scrims, our method softens lighting given only a single portrait photo. Previous portrait relighting approaches focus on changing the entire lighting environment, removing shadows (ignoring strong specular highlights), or removing shading entirely. In contrast, we propose a learning based method that allows us to control the amount of light diffusion and apply it on in-the-wild portraits. Additionally, we design a method to synthetically generate plausible external shadows with sub-surface scattering effects while conforming to the shape of the subject's face. Finally, we show how our approach can increase the robustness of higher level vision applications, such as albedo estimation, geometry estimation and semantic segmentation.

📄 PDF Abstract BibTeX arXiv:2305.04745

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic Segmentation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

High-Fidelity Relightable Monocular Portrait Animation with Lighting-Controllable Video Diffusion Model

2025-02-27 · CVPR 2025 1 · Mingtao Guo, Guanyu Xing, Yanli Liu

Relightable portrait animation aims to animate a static reference portrait to match the head movements and expressions of a driving video while adapting to user-specified or reference lighting conditions. Existing portra…

Portrait Animation

3DFaceShop: Explicitly Controllable 3D-Aware Portrait Generation

2022-09-12 · Junshu Tang, Bo Zhang, Binxin Yang, Ting Zhang 외

In contrast to the traditional avatar creation pipeline which is a costly process, contemporary generative approaches directly learn the data distribution from photographs. While plenty of works extend unconditional gene…

3D Face AnimationDisentanglementFace GenerationFace Model+2

Controllable Dynamic Appearance for Neural 3D Portraits

2023-09-20 · ShahRukh Athar, Zhixin Shu, Zexiang Xu, Fujun Luan 외

Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such m…

POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling

2025-12-15 · Zhuo Chen, Chengqun Yang, Zhuo Su, Zheng Lv 외 arxiv

Face relighting aims to synthesize realistic portraits under novel illumination while preserving identity and geometry. However, progress remains constrained by the limited availability of large-scale, physically consist…

SkyReels-Audio: Omni Audio-Conditioned Talking Portraits in Video Diffusion Transformers

2025-06-01 · Zhengcong Fei, Hao Jiang, Di Qiu, Baoxuan Gu 외

The generation and editing of audio-conditioned talking portraits guided by multimodal inputs, including text, images, and videos, remains under explored. In this paper, we present SkyReels-Audio, a unified framework for…

Denoising