paper-with-me

Papers

COAP: Compositional Articulated Occupancy of People

2022-04-13 · CVPR 2022 1 · Marko Mihajlovic, Shunsuke Saito, Aayush Bansal, Michael Zollhoefer, Siyu Tang

We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the environment, which is essential for human motion reconstruction and synthesis in 3D scenes. However, existing neural implicit bodies suffer from either poor generalization on highly articulated poses or slow inference time. In this work, we observe that prior knowledge about the human body's shape and kinematic structure can be leveraged to improve generalization and efficiency. We decompose the full-body geometry into local body parts and employ a part-aware encoder-decoder architecture to learn neural articulated occupancy that models complex deformations locally. Our local shape encoder represents the body deformation of not only the corresponding body part but also the neighboring body parts. The decoder incorporates the geometric constraints of local body shape which significantly improves pose generalization. We demonstrate that our model is suitable for resolving self-intersections and collisions with 3D environments. Quantitative and qualitative experiments show that our method largely outperforms existing solutions in terms of both efficiency and accuracy. The code and models are available at https://neuralbodies.github.io/COAP/index.html

📄 PDF Abstract BibTeX arXiv:2204.06184

Code (1)

markomih/COAP 공식 구현 pytorch

Tasks

Decoder

Similar Papers 제목 키워드 기반

LEAP: Learning Articulated Occupancy of People

2021-04-14 · CVPR 2021 1 · Marko Mihajlovic, Yan Zhang, Michael J. Black, Siyu Tang

Substantial progress has been made on modeling rigid 3D objects using deep implicit representations. Yet, extending these methods to learn neural models of human shape is still in its infancy. Human bodies are complex an…

A Skeleton-Driven Neural Occupancy Representation for Articulated Hands

2021-09-23 · Korrawe Karunratanakul, Adrian Spurr, Zicong Fan, Otmar Hilliges 외

We present Hand ArticuLated Occupancy (HALO), a novel representation of articulated hands that bridges the advantages of 3D keypoints and neural implicit surfaces and can be used in end-to-end trainable architectures. Un…

NASA Neural Articulated Shape Approximation

2020-08-01 · ECCV 2020 8 · Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll 외

Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics. To efficiently simulate deformation, existing approaches represent 3D objects using polygonal …

NASA: Neural Articulated Shape Approximation

2019-12-06 · Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll 외

Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics. To efficiently simulate deformation, existing approaches represent 3D objects using polygonal …

Integrating Grammar and Segmentation for Human Pose Estimation

2013-06-01 · CVPR 2013 6 · Brandon Rothrock, Se-Young Park, Song-Chun Zhu

In this paper we present a compositional and-or graph grammar model for human pose estimation. Our model has three distinguishing features: (i) large appearance differences between people are handled compositionally by a…

Pose Estimation