paper-with-me

홈 › Papers

A Visual Representation for Editing Face Images

2016-12-02 · Jiajun Lu, Kalyan Sunkavalli, Nathan Carr, Sunil Hadap, David Forsyth

We propose a new approach for editing face images, which enables numerous exciting applications including face relighting, makeup transfer and face detail editing. Our face edits are based on a visual representation, which includes geometry, face segmentation, albedo, illumination and detail map. To recover our visual representation, we start by estimating geometry using a morphable face model, then decompose the face image to recover the albedo, and then shade the geometry with the albedo and illumination. The residual between our shaded geometry and the input image produces our detail map, which carries high frequency information that is either insufficiently or incorrectly captured by our shading process. By manipulating the detail map, we can edit face images with reality and identity preserved. Our representation allows various applications. First, it allows a user to directly manipulate various illumination. Second, it allows non-parametric makeup transfer with input face's distinctive identity features preserved. Third, it allows non-parametric modifications to the face appearance by transferring details. For face relighting and detail editing, we evaluate via a user study and our method outperforms other methods. For makeup transfer, we evaluate via an online attractiveness evaluation system, and can reliably make people look younger and more attractive. We also show extensive qualitative comparisons to existing methods, and have significant improvements over previous techniques.

📄 PDF Abstract BibTeX arXiv:1612.00522

Code (0)

등록된 구현이 없습니다.

Tasks

Face Model

Similar Papers 제목 키워드 기반

RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spaces

2018-04-10 · Ryota Natsume, Tatsuya Yatagawa, Shigeo Morishima

In this paper, we present an integrated system for automatically generating and editing face images through face swapping, attribute-based editing, and random face parts synthesis. The proposed system is based on a deep …

AttributeFace SwappingGenerative Adversarial Network

Visual Instruction Inversion: Image Editing via Visual Prompting

2023-07-26 · Thao Nguyen, Yuheng Li, Utkarsh Ojha, Yong Jae Lee

Text-conditioned image editing has emerged as a powerful tool for editing images. However, in many situations, language can be ambiguous and ineffective in describing specific image edits. When faced with such challenges…

Visual Prompting

Visual Instruction Inversion: Image Editing via Image Prompting

2023-09-21 · NeurIPS 2023 11

Text-conditioned image editing has emerged as a powerful tool for editing images. However, in many situations, language can be ambiguous and ineffective in describing specific image edits. When faced with such challenges…

NeuSEditor: From Multi-View Images to Text-Guided Neural Surface Edits

2025-05-16 · Nail Ibrahimli, Julian F. P. Kooij, Liangliang Nan

Implicit surface representations are valued for their compactness and continuity, but they pose significant challenges for editing. Despite recent advancements, existing methods often fail to preserve identity and mainta…

Text-based Talking Video Editing with Cascaded Conditional Diffusion

2024-07-20 · Bo Han, Heqing Zou, Haoyang Li, Guangcong Wang 외

Text-based talking-head video editing aims to efficiently insert, delete, and substitute segments of talking videos through a user-friendly text editing approach. It is challenging because of \textbf{1)} generalizable ta…

Video Editing