paper-with-me

Papers

FIND: An Unsupervised Implicit 3D Model of Articulated Human Feet

2022-10-21 · Oliver Boyne, James Charles, Roberto Cipolla

In this paper we present a high fidelity and articulated 3D human foot model. The model is parameterised by a disentangled latent code in terms of shape, texture and articulated pose. While high fidelity models are typically created with strong supervision such as 3D keypoint correspondences or pre-registration, we focus on the difficult case of little to no annotation. To this end, we make the following contributions: (i) we develop a Foot Implicit Neural Deformation field model, named FIND, capable of tailoring explicit meshes at any resolution i.e. for low or high powered devices; (ii) an approach for training our model in various modes of weak supervision with progressively better disentanglement as more labels, such as pose categories, are provided; (iii) a novel unsupervised part-based loss for fitting our model to 2D images which is better than traditional photometric or silhouette losses; (iv) finally, we release a new dataset of high resolution 3D human foot scans, Foot3D. On this dataset, we show our model outperforms a strong PCA implementation trained on the same data in terms of shape quality and part correspondences, and that our novel unsupervised part-based loss improves inference on images.

📄 PDF Abstract BibTeX arXiv:2210.12241

Code (1)

OllieBoyne/FIND 공식 구현 pytorch

Tasks

Disentanglement

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Markerless Augmented Reality Registration for Surgical Guidance: A Multi-Anatomy Clinical Accuracy Study

2025-11-03 · Yue Yang, Fabian Necker, Christoph Leuze, Michelle Chen 외 arxiv

Purpose: In this paper, we develop and clinically evaluate a depth-only, markerless augmented reality (AR) registration pipeline on a head-mounted display, and assess accuracy across small or low-curvature anatomies in r…

Tracking Human Pose by Tracking Symmetric Parts

2013-06-01 · CVPR 2013 6 · Varun Ramakrishna, Takeo Kanade, Yaser Sheikh

The human body is structurally symmetric. Tracking by detection approaches for human pose suffer from double counting, where the same image evidence is used to explain two separate but symmetric parts, such as the left a…

Action RecognitionPose EstimationTemporal Action Localization

Unsupervised Pose-Aware Part Decomposition for 3D Articulated Objects

2021-10-08 · Yuki Kawana, Yusuke Mukuta, Tatsuya Harada

Articulated objects exist widely in the real world. However, previous 3D generative methods for unsupervised part decomposition are unsuitable for such objects, because they assume a spatially fixed part location, result…

Pose Estimation

Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video

2022-05-24 · CVPR 2022 1 · Erik Gärtner, Mykhaylo Andriluka, Hongyi Xu, Cristian Sminchisescu

We focus on the task of estimating a physically plausible articulated human motion from monocular video. Existing approaches that do not consider physics often produce temporally inconsistent output with motion artifacts…

3D Human Pose EstimationPose Estimation

imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose

2021-08-24 · ICCV 2021 10 · Thiemo Alldieck, Hongyi Xu, Cristian Sminchisescu

We present imGHUM, the first holistic generative model of 3D human shape and articulated pose, represented as a signed distance function. In contrast to prior work, we model the full human body implicitly as a function z…