paper-with-me

홈 › Papers

Single Image Portrait Relighting

2019-05-02 · Tiancheng Sun, Jonathan T. Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, Ravi Ramamoorthi

Lighting plays a central role in conveying the essence and depth of the subject in a portrait photograph. Professional photographers will carefully control the lighting in their studio to manipulate the appearance of their subject, while consumer photographers are usually constrained to the illumination of their environment. Though prior works have explored techniques for relighting an image, their utility is usually limited due to requirements of specialized hardware, multiple images of the subject under controlled or known illuminations, or accurate models of geometry and reflectance. To this end, we present a system for portrait relighting: a neural network that takes as input a single RGB image of a portrait taken with a standard cellphone camera in an unconstrained environment, and from that image produces a relit image of that subject as though it were illuminated according to any provided environment map. Our method is trained on a small database of 18 individuals captured under different directional light sources in a controlled light stage setup consisting of a densely sampled sphere of lights. Our proposed technique produces quantitatively superior results on our dataset's validation set compared to prior works, and produces convincing qualitative relighting results on a dataset of hundreds of real-world cellphone portraits. Because our technique can produce a 640 $\times$ 640 image in only 160 milliseconds, it may enable interactive user-facing photographic applications in the future.

📄 PDF Abstract BibTeX arXiv:1905.00824

Code (0)

등록된 구현이 없습니다.

Tasks

Single-Image Portrait Relighting

Similar Papers 제목 키워드 기반

Deep Single-Image Portrait Relighting

2019-10-01 · ICCV 2019 10 · Hao Zhou, Sunil Hadap, Kalyan Sunkavalli, David W. Jacobs

Conventional physically-based methods for relighting portrait images need to solve an inverse rendering problem, estimating face geometry, reflectance and lighting. However, the inaccurate estimation of face components c…

Inverse RenderingSingle-Image Portrait Relighting

Text2Relight: Creative Portrait Relighting with Text Guidance

2024-12-18 · Junuk Cha, Mengwei Ren, Krishna Kumar Singh, He Zhang 외

We present a lighting-aware image editing pipeline that, given a portrait image and a text prompt, performs single image relighting. Our model modifies the lighting and color of both the foreground and background to alig…

Image GenerationImage RelightingLarge Language Model

Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image

2024-03-14 · CVPR 2024 1 · Yiqun Mei, Yu Zeng, He Zhang, Zhixin Shu 외

At the core of portrait photography is the search for ideal lighting and viewpoint. The process often requires advanced knowledge in photography and an elaborate studio setup. In this work, we propose Holo-Relighting, a …

Lite2Relight: 3D-aware Single Image Portrait Relighting

2024-07-15 · Pramod Rao, Gereon Fox, Abhimitra Meka, Mallikarjun B R 외

Achieving photorealistic 3D view synthesis and relighting of human portraits is pivotal for advancing AR/VR applications. Existing methodologies in portrait relighting demonstrate substantial limitations in terms of gene…

Single-Image Portrait Relighting

Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation

2022-09-21 · Yu-Ying Yeh, Koki Nagano, Sameh Khamis, Jan Kautz 외

Given a portrait image of a person and an environment map of the target lighting, portrait relighting aims to re-illuminate the person in the image as if the person appeared in an environment with the target lighting. To…