paper-with-me

Papers

Generative Landmarks Guided Eyeglasses Removal 3D Face Reconstruction

2024-12-25 · Dapeng Zhao, Yue Qi

Single-view 3D face reconstruction is a fundamental Computer Vision problem of extraordinary difficulty. Current systems often assume the input is unobstructed faces which makes their method not suitable for in-the-wild conditions. We present a method for performing a 3D face that removes eyeglasses from a single image. Existing facial reconstruction methods fail to remove eyeglasses automatically for generating a photo-realistic 3D face "in-the-wild".The innovation of our method lies in a process for identifying the eyeglasses area robustly and remove it intelligently. In this work, we estimate the 2D face structure of the reasonable position of the eyeglasses area, which is used for the construction of 3D texture. An excellent anti-eyeglasses face reconstruction method should ensure the authenticity of the output, including the topological structure between the eyes, nose, and mouth. We achieve this via a deep learning architecture that performs direct regression of a 3DMM representation of the 3D facial geometry from a single 2D image. We also demonstrate how the related face parsing task can be incorporated into the proposed framework and help improve reconstruction quality. We conduct extensive experiments on existing 3D face reconstruction tasks as concrete examples to demonstrate the method's superior regulation ability over existing methods often break down.

📄 PDF Abstract BibTeX arXiv:2412.19848

Code (0)

등록된 구현이 없습니다.

Tasks

3D Face ReconstructionFace ParsingFace Reconstruction

Similar Papers 제목 키워드 기반

Unsupervised Eyeglasses Removal in the Wild

2019-09-16 · Bingwen Hu, Zhedong Zheng, Ping Liu, Wankou Yang 외

Eyeglasses removal is challenging in removing different kinds of eyeglasses, e.g., rimless glasses, full-rim glasses and sunglasses, and recovering appropriate eyes. Due to the large visual variants, the conventional met…

Face ReconstructionFace VerificationFacial Expression RecognitionFacial Expression Recognition (FER)+1

Portrait Eyeglasses and Shadow Removal by Leveraging 3D Synthetic Data

2022-03-20 · CVPR 2022 1 · Junfeng Lyu, Zhibo Wang, Feng Xu

In portraits, eyeglasses may occlude facial regions and generate cast shadows on faces, which degrades the performance of many techniques like face verification and expression recognition. Portrait eyeglasses removal is …

Face VerificationShadow Removal

GeneGAN: Learning Object Transfiguration and Attribute Subspace from Unpaired Data

2017-05-14 · Shuchang Zhou, Taihong Xiao, Yi Yang, Dieqiao Feng 외

Object Transfiguration replaces an object in an image with another object from a second image. For example it can perform tasks like "putting exactly those eyeglasses from image A on the nose of the person in image B". U…

AttributeConditional Image GenerationImage GenerationObject

Text-guided Eyeglasses Manipulation with Spatial Constraints

2023-04-25 · Jiacheng Wang, Ping Liu, Jingen Liu, Wei Xu

Virtual try-on of eyeglasses involves placing eyeglasses of different shapes and styles onto a face image without physically trying them on. While existing methods have shown impressive results, the variety of eyeglasses…

Virtual Try-on

Face De-occlusion using 3D Morphable Model and Generative Adversarial Network

2019-04-12 · ICCV 2019 10 · Xiaowei Yuan, In Kyu Park

In recent decades, 3D morphable model (3DMM) has been commonly used in image-based photorealistic 3D face reconstruction. However, face images are often corrupted by serious occlusion by non-face objects including eyegla…

3D Face ReconstructionFace ModelFace ReconstructionGenerative Adversarial Network