High-Accuracy Facial Depth Models derived from 3D Synthetic Data

2020-03-26

In this paper, we explore how synthetically generated 3D face models can be used to construct a high accuracy ground truth for depth. This allows us to train the Convolutional Neural Networks (CNN) to solve facial depth estimation problems. These models provide sophisticated controls over image variations including pose, illumination, facial expressions and camera position. 2D training samples can be rendered from these models, typically in RGB format, together with depth information. Using synthetic facial animations, a dynamic facial expression or facial action data can be rendered for a sequence of image frames together with ground truth depth and additional metadata such as head pose, light direction, etc. The synthetic data is used to train a CNN based facial depth estimation system which is validated on both synthetic and real images. Potential fields of application include 3D reconstruction, driver monitoring systems, robotic vision systems, and advanced scene understanding.

📄 PDF Abstract BibTeX arXiv:2003.06211

Code (0)

등록된 구현이 없습니다.

Tasks

3D Reconstruction Depth Estimation Scene Understanding Vocal Bursts Intensity Prediction

Learning to Generate Facial Depth Maps

2018-05-30 · Stefano Pini, Filippo Grazioli, Guido Borghi, Roberto Vezzani 외

In this paper, an adversarial architecture for facial depth map estimation from monocular intensity images is presented. By following an image-to-image approach, we combine the advantages of supervised learning and adver…

Face Verification Generative Adversarial Network

ChildGAN: Large Scale Synthetic Child Facial Data Using Domain Adaptation in StyleGAN

2023-07-25 · Muhammad Ali Farooq, Wang Yao, Gabriel Costache, Peter Corcoran

In this research work, we proposed a novel ChildGAN, a pair of GAN networks for generating synthetic boys and girls facial data derived from StyleGAN2. ChildGAN is built by performing smooth domain transfer using transfe…

Domain Adaptation Transfer Learning

Real-Time 3D Head Pose and Facial Landmark Estimation From Depth Images Using Triangular Surface Patch Features

2015-06-01 · CVPR 2015 6 · Chavdar Papazov, Tim K. Marks, Michael Jones

We present a real-time system for 3D head pose estimation and facial landmark localization using a commodity depth sensor. We introduce a novel triangular surface patch (TSP) descriptor, which encodes the shape of the 3D…

Face Alignment Head Pose Estimation Pose Estimation

Synthetic Data Generation for Emotional Depth Faces: Optimizing Conditional DCGANs via Genetic Algorithms in the Latent Space and Stabilizing Training with Knowledge Distillation

2025-08-07 · Seyed Muhammad Hossein Mousavi, S. Younes Mirinezhad arxiv

Affective computing faces a major challenge: the lack of high-quality, diverse depth facial datasets for recognizing subtle emotional expressions. We propose a framework for synthetic depth face generation using an optim…

Synthetic Data Generation Knowledge Distillation

Micro-expression recognition based on depth map to point cloud

2024-06-12 · Ren Zhang, Jianqin Yin, Chao Qi, Zehao Wang 외

Micro-expressions are nonverbal facial expressions that reveal the covert emotions of individuals, making the micro-expression recognition task receive widespread attention. However, the micro-expression recognition task…

Micro Expression Recognition Micro-Expression Recognition