paper-with-me

홈 › Papers

Identity-Disentangled Neural Deformation Model for Dynamic Meshes

2021-09-30 · Binbin Xu, Lingni Ma, Yuting Ye, Tanner Schmidt, Christopher D. Twigg, Steven Lovegrove

Neural shape models can represent complex 3D shapes with a compact latent space. When applied to dynamically deforming shapes such as the human hands, however, they would need to preserve temporal coherence of the deformation as well as the intrinsic identity of the subject. These properties are difficult to regularize with manually designed loss functions. In this paper, we learn a neural deformation model that disentangles the identity-induced shape variations from pose-dependent deformations using implicit neural functions. We perform template-free unsupervised learning on 3D scans without explicit mesh correspondence or semantic correspondences of shapes across subjects. We can then apply the learned model to reconstruct partial dynamic 4D scans of novel subjects performing unseen actions. We propose two methods to integrate global pose alignment with our neural deformation model. Experiments demonstrate the efficacy of our method in the disentanglement of identities and pose. Our method also outperforms traditional skeleton-driven models in reconstructing surface details such as palm prints or tendons without limitations from a fixed template.

📄 PDF Abstract BibTeX arXiv:2109.15299

Code (0)

등록된 구현이 없습니다.

Tasks

Disentanglementmodel

Similar Papers 제목 키워드 기반

DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinates

2021-02-18 · CVPR 2021 1 · Minghua Liu, Minhyuk Sung, Radomir Mech, Hao Su

We propose DeepMetaHandles, a 3D conditional generative model based on mesh deformation. Given a collection of 3D meshes of a category and their deformation handles (control points), our method learns a set of meta-handl…

Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes

2022-06-10 · CVPR 2022 1 · Ka-Hei Hui, Ruihui Li, Jingyu Hu, Chi-Wing Fu

This paper introduces a novel framework called DTNet for 3D mesh reconstruction and generation via Disentangled Topology. Beyond previous works, we learn a topology-aware neural template specific to each input then defor…

Deep Spectral Meshes: Multi-Frequency Facial Mesh Processing with Graph Neural Networks

2024-02-15 · Robert Kosk, Richard Southern, Lihua You, Shaojun Bian 외

With the rising popularity of virtual worlds, the importance of data-driven parametric models of 3D meshes has grown rapidly. Numerous applications, such as computer vision, procedural generation, and mesh editing, vastl…

Representation Learning

Sparse to Dense Dynamic 3D Facial Expression Generation

2021-05-16 · CVPR 2022 1 · Naima Otberdout, Claudio Ferrari, Mohamed Daoudi, Stefano Berretti 외

In this paper, we propose a solution to the task of generating dynamic 3D facial expressions from a neutral 3D face and an expression label. This involves solving two sub-problems: (i)modeling the temporal dynamics of ex…

3D Face AnimationDecoderFace GenerationFacial expression generation

PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image

2025-08-13 · Geonhee Sim, Gyeongsik Moon arxiv

Two major approaches exist for creating animatable human avatars. The first, a 3D-based approach, optimizes a NeRF- or 3DGS-based avatar from videos of a single person, achieving personalization through a disentangled id…