paper-with-me

Papers

Uncertainty-Aware Mesh Decoder for High Fidelity 3D Face Reconstruction

2020-06-01 · CVPR 2020 6 · Gun-Hee Lee, Seong-Whan Lee

3D Morphable Model (3DMM) is a statistical model of facial shape and texture using a set of linear basis functions. Most of the recent 3D face reconstruction methods aim to embed the 3D morphable basis functions into Deep Convolutional Neural Network (DCNN). However, balancing the requirements of strong regularization for global shape and weak regularization for high level details is still ill-posed. To address this problem, we properly control generality and specificity in terms of regularization by harnessing the power of uncertainty. Additionally, we focus on the concept of nonlinearity and find out that Graph Convolutional Neural Network (Graph CNN) and Generative Adversarial Network (GAN) are effective in reconstructing high quality 3D shapes and textures respectively. In this paper, we propose to employ (i) an uncertainty-aware encoder that presents face features as distributions and (ii) a fully nonlinear decoder model combining Graph CNN with GAN. We demonstrate how our method builds excellent high quality results and outperforms previous state-of-the-art methods on 3D face reconstruction tasks for both constrained and in-the-wild images.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Face ReconstructionDecoderFace ReconstructionGenerative Adversarial NetworkSpecificityVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

DeepHandMesh: A Weakly-supervised Deep Encoder-Decoder Framework for High-fidelity Hand Mesh Modeling

2020-08-19 · ECCV 2020 8 · Gyeongsik Moon, Takaaki Shiratori, Kyoung Mu Lee

Human hands play a central role in interacting with other people and objects. For realistic replication of such hand motions, high-fidelity hand meshes have to be reconstructed. In this study, we firstly propose DeepHand…

Decoder

Multifidelity data fusion in convolutional encoder/decoder networks

2022-05-10 · Lauren Partin, Gianluca Geraci, Ahmad Rushdi, Michael S. Eldred 외

We analyze the regression accuracy of convolutional neural networks assembled from encoders, decoders and skip connections and trained with multifidelity data. Besides requiring significantly less trainable parameters th…

Decoderregression

FACE: A Face-based Autoregressive Representation for High-Fidelity and Efficient Mesh Generation

2026-03-02 · Hanxiao Wang, Yuan-Chen Guo, Ying-Tian Liu, Zi-Xin Zou 외 arxiv

Autoregressive models for 3D mesh generation suffer from a fundamental limitation: they flatten meshes into long vertex-coordinate sequences. This results in prohibitive computational costs, hindering the efficient synth…

Few-Shot Physically-Aware Articulated Mesh Generation via Hierarchical Deformation

2023-08-21 · ICCV 2023 1 · Xueyi Liu, Bin Wang, He Wang, Li Yi

We study the problem of few-shot physically-aware articulated mesh generation. By observing an articulated object dataset containing only a few examples, we wish to learn a model that can generate diverse meshes with hig…

DiversityPhilosophy

Geometric Granularity Aware Pixel-To-Mesh

2021-01-01 · ICCV 2021 10 · Yue Shi, Bingbing Ni, Jinxian Liu, Dingyi Rong 외

Pixel-to-mesh has wide applications, especially in virtual or augmented reality, animation and game industry. However, existing mesh reconstruction models perform unsatisfactorily in local geometry details due to ign…