paper-with-me

Papers

FreeEnricher: Enriching Face Landmarks without Additional Cost

2022-12-19 · Yangyu Huang, Xi Chen, Jongyoo Kim, Hao Yang, Chong Li, Jiaolong Yang, Dong Chen

Recent years have witnessed significant growth of face alignment. Though dense facial landmark is highly demanded in various scenarios, e.g., cosmetic medicine and facial beautification, most works only consider sparse face alignment. To address this problem, we present a framework that can enrich landmark density by existing sparse landmark datasets, e.g., 300W with 68 points and WFLW with 98 points. Firstly, we observe that the local patches along each semantic contour are highly similar in appearance. Then, we propose a weakly-supervised idea of learning the refinement ability on original sparse landmarks and adapting this ability to enriched dense landmarks. Meanwhile, several operators are devised and organized together to implement the idea. Finally, the trained model is applied as a plug-and-play module to the existing face alignment networks. To evaluate our method, we manually label the dense landmarks on 300W testset. Our method yields state-of-the-art accuracy not only in newly-constructed dense 300W testset but also in the original sparse 300W and WFLW testsets without additional cost.

📄 PDF Abstract BibTeX arXiv:2212.09525

Code (0)

등록된 구현이 없습니다.

Tasks

Face Alignment

Similar Papers 제목 키워드 기반

Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation

2023-06-02 · Federico Nocentini, Claudio Ferrari, Stefano Berretti

This paper presents a novel approach for generating 3D talking heads from raw audio inputs. Our method grounds on the idea that speech related movements can be comprehensively and efficiently described by the motion of a…

3D Face AnimationTalking Head Generation

3D face reconstruction with dense landmarks

2022-04-06 · Erroll Wood, Tadas Baltrusaitis, Charlie Hewitt, Matthew Johnson 외

Landmarks often play a key role in face analysis, but many aspects of identity or expression cannot be represented by sparse landmarks alone. Thus, in order to reconstruct faces more accurately, landmarks are often combi…

3D Face ReconstructionCPUFace AlignmentFace Model+1

DiffTalker: Co-driven audio-image diffusion for talking faces via intermediate landmarks

2023-09-14 · Zipeng Qi, xulong Zhang, Ning Cheng, Jing Xiao 외

Generating realistic talking faces is a complex and widely discussed task with numerous applications. In this paper, we present DiffTalker, a novel model designed to generate lifelike talking faces through audio and land…

Face Generation

Infinite 3D Landmarks: Improving Continuous 2D Facial Landmark Detection

2024-05-30 · Prashanth Chandran, Gaspard Zoss, Paulo Gotardo, Derek Bradley

In this paper, we examine 3 important issues in the practical use of state-of-the-art facial landmark detectors and show how a combination of specific architectural modifications can directly improve their accuracy and t…

Facial Landmark Detection

Pix2face: Direct 3D Face Model Estimation

2017-08-29 · Daniel Crispell, Maxim Bazik

An efficient, fully automatic method for 3D face shape and pose estimation in unconstrained 2D imagery is presented. The proposed method jointly estimates a dense set of 3D landmarks and facial geometry using a single pa…

Face ModelmodelPose Estimation