paper-with-me

홈 › Papers

LEAP: Learning Articulated Occupancy of People

2021-04-14 · CVPR 2021 1 · Marko Mihajlovic, Yan Zhang, Michael J. Black, Siyu Tang

Substantial progress has been made on modeling rigid 3D objects using deep implicit representations. Yet, extending these methods to learn neural models of human shape is still in its infancy. Human bodies are complex and the key challenge is to learn a representation that generalizes such that it can express body shape deformations for unseen subjects in unseen, highly-articulated, poses. To address this challenge, we introduce LEAP (LEarning Articulated occupancy of People), a novel neural occupancy representation of the human body. Given a set of bone transformations (i.e. joint locations and rotations) and a query point in space, LEAP first maps the query point to a canonical space via learned linear blend skinning (LBS) functions and then efficiently queries the occupancy value via an occupancy network that models accurate identity- and pose-dependent deformations in the canonical space. Experiments show that our canonicalized occupancy estimation with the learned LBS functions greatly improves the generalization capability of the learned occupancy representation across various human shapes and poses, outperforming existing solutions in all settings.

📄 PDF Abstract BibTeX arXiv:2104.06849

Code (1)

neuralbodies/leap 공식 구현 pytorch

Similar Papers 제목 키워드 기반

COAP: Compositional Articulated Occupancy of People

2022-04-13 · CVPR 2022 1 · Marko Mihajlovic, Shunsuke Saito, Aayush Bansal, Michael Zollhoefer 외

We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the…

Decoder

LEAP: Enhancing Vision-Based Occupancy Networks with Lightweight Spatio-Temporal Correlation

2025-02-21 · Fengcheng Yu, Haoran Xu, Canming Xia, Guang Tan

Vision-based occupancy networks provide an end-to-end solution for reconstructing the surrounding environment using semantic occupied voxels derived from multi-view images. This technique relies on effectively learning t…

A Skeleton-Driven Neural Occupancy Representation for Articulated Hands

2021-09-23 · Korrawe Karunratanakul, Adrian Spurr, Zicong Fan, Otmar Hilliges 외

We present Hand ArticuLated Occupancy (HALO), a novel representation of articulated hands that bridges the advantages of 3D keypoints and neural implicit surfaces and can be used in end-to-end trainable architectures. Un…

NASA Neural Articulated Shape Approximation

2020-08-01 · ECCV 2020 8 · Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll 외

Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics. To efficiently simulate deformation, existing approaches represent 3D objects using polygonal …

NASA: Neural Articulated Shape Approximation

2019-12-06 · Boyang Deng, JP Lewis, Timothy Jeruzalski, Gerard Pons-Moll 외

Efficient representation of articulated objects such as human bodies is an important problem in computer vision and graphics. To efficiently simulate deformation, existing approaches represent 3D objects using polygonal …