paper-with-me

Papers

Angle Range and Identity Similarity Enhanced Gaze and Head Redirection based on Synthetic data

2023-09-11 · Jiawei Qin, Xueting Wang

In this paper, we propose a method for improving the angular accuracy and photo-reality of gaze and head redirection in full-face images. The problem with current models is that they cannot handle redirection at large angles, and this limitation mainly comes from the lack of training data. To resolve this problem, we create data augmentation by monocular 3D face reconstruction to extend the head pose and gaze range of the real data, which allows the model to handle a wider redirection range. In addition to the main focus on data augmentation, we also propose a framework with better image quality and identity preservation of unseen subjects even training with synthetic data. Experiments show that our method significantly improves redirection performance in terms of redirection angular accuracy while maintaining high image quality, especially when redirecting to large angles.

📄 PDF Abstract BibTeX arXiv:2309.05214

Code (0)

등록된 구현이 없습니다.

Tasks

3D Face ReconstructionData AugmentationFace Reconstruction

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

GazeCorrection:Self-Guided Eye Manipulation in the wild using Self-Supervised Generative Adversarial Networks

2019-06-03 · arXiv 2019 6 · Jichao Zhang, Meng Sun, Jingjing Chen, Hao Tang 외

Gaze correction aims to redirect the person's gaze into the camera by manipulating the eye region, and it can be considered as a specific image resynthesis problem. Gaze correction has a wide range of applications in rea…

Resynthesis

Dual In-painting Model for Unsupervised Gaze Correction and Animation in the Wild

2020-08-09 · Jichao Zhang, Jingjing Chen, Hao Tang, Wei Wang 외

In this paper we address the problem of unsupervised gaze correction in the wild, presenting a solution that works without the need for precise annotations of the gaze angle and the head pose. We have created a new datas…

GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields

2022-12-08 · CVPR 2023 1 · Alessandro Ruzzi, Xiangwei Shi, Xi Wang, Gengyan Li 외

We propose GazeNeRF, a 3D-aware method for the task of gaze redirection. Existing gaze redirection methods operate on 2D images and struggle to generate 3D consistent results. Instead, we build on the intuition that the …

gaze redirectionNeRF

Multi-Modal Gaze Following in Conversational Scenarios

2023-11-09 · Yuqi Hou, Zhongqun Zhang, Nora Horanyi, Jaewon Moon 외

Gaze following estimates gaze targets of in-scene person by understanding human behavior and scene information. Existing methods usually analyze scene images for gaze following. However, compared with visual images, audi…

Generalizing Gaze Estimation With Rotation Consistency

2022-01-01 · CVPR 2022 1 · Yiwei Bao, Yunfei Liu, Haofei Wang, Feng Lu

Recent advances of deep learning-based approaches have achieved remarkable performance on appearance-based gaze estimation. However, due to the shortage of target domain data and absence of target labels, generalizin…

Domain AdaptationGaze EstimationUnsupervised Domain Adaptation