paper-with-me

홈 › Papers

ASM: Adaptive Skinning Model for High-Quality 3D Face Modeling

2023-04-19 · ICCV 2023 1 · Kai Yang, Hong Shang, Tianyang Shi, Xinghan Chen, Jingkai Zhou, Zhongqian Sun, Wei Yang

The research fields of parametric face model and 3D face reconstruction have been extensively studied. However, a critical question remains unanswered: how to tailor the face model for specific reconstruction settings. We argue that reconstruction with multi-view uncalibrated images demands a new model with stronger capacity. Our study shifts attention from data-dependent 3D Morphable Models (3DMM) to an understudied human-designed skinning model. We propose Adaptive Skinning Model (ASM), which redefines the skinning model with more compact and fully tunable parameters. With extensive experiments, we demonstrate that ASM achieves significantly improved capacity than 3DMM, with the additional advantage of model size and easy implementation for new topology. We achieve state-of-the-art performance with ASM for multi-view reconstruction on the Florence MICC Coop benchmark. Our quantitative analysis demonstrates the importance of a high-capacity model for fully exploiting abundant information from multi-view input in reconstruction. Furthermore, our model with physical-semantic parameters can be directly utilized for real-world applications, such as in-game avatar creation. As a result, our work opens up new research direction for parametric face model and facilitates future research on multi-view reconstruction.

📄 PDF Abstract BibTeX arXiv:2304.09423

Code (0)

등록된 구현이 없습니다.

Tasks

3D Face ReconstructionFace AlignmentFace ModelFace ReconstructionVocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

Florence Florence is a computer vision foundation model aiming to learn universal visual-language representations that be adapted to various computer vision tasks, visual question…

Similar Papers 제목 키워드 기반

JNR: Joint-based Neural Rig Representation for Compact 3D Face Modeling

2020-07-14 · ECCV 2020 8 · Noranart Vesdapunt, Mitch Rundle, HsiangTao Wu, Baoyuan Wang

In this paper, we introduce a novel approach to learn a 3D face model using a joint-based face rig and a neural skinning network. Thanks to the joint-based representation, our model enjoys some significant advantages ove…

3D Face ModellingFace Model

Robust Biharmonic Skinning Using Geometric Fields

2024-06-01 · Ana Dodik, Vincent Sitzmann, Justin Solomon, Oded Stein

Skinning is a popular way to rig and deform characters for animation, to compute reduced-order simulations, and to define features for geometry processing. Methods built on skinning rely on weight functions that distribu…

DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representation

2024-10-09 · Zhiqi Li, Yiming Chen, Peidong Liu

Recent advancements in 2D/3D generative techniques have facilitated the generation of dynamic 3D objects from monocular videos. Previous methods mainly rely on the implicit neural radiance fields (NeRF) or explicit Gauss…

3D GenerationComputational EfficiencyImage to 3DNeRF

Neural Point-based Shape Modeling of Humans in Challenging Clothing

2022-09-14 · Qianli Ma, Jinlong Yang, Michael J. Black, Siyu Tang

Parametric 3D body models like SMPL only represent minimally-clothed people and are hard to extend to clothing because they have a fixed mesh topology and resolution. To address these limitations, recent work uses implic…

REACTO: Reconstructing Articulated Objects from a Single Video

2024-04-17 · CVPR 2024 1 · Chaoyue Song, Jiacheng Wei, Chuan-Sheng Foo, Guosheng Lin 외

In this paper, we address the challenge of reconstructing general articulated 3D objects from a single video. Existing works employing dynamic neural radiance fields have advanced the modeling of articulated objects like…