paper-with-me

홈 › Papers

A2J: Anchor-to-Joint Regression Network for 3D Articulated Pose Estimation from a Single Depth Image

2019-08-27 · ICCV 2019 10 · Fu Xiong, Boshen Zhang, Yang Xiao, Zhiguo Cao, Taidong Yu, Joey Tianyi Zhou, Junsong Yuan

For 3D hand and body pose estimation task in depth image, a novel anchor-based approach termed Anchor-to-Joint regression network (A2J) with the end-to-end learning ability is proposed. Within A2J, anchor points able to capture global-local spatial context information are densely set on depth image as local regressors for the joints. They contribute to predict the positions of the joints in ensemble way to enhance generalization ability. The proposed 3D articulated pose estimation paradigm is different from the state-of-the-art encoder-decoder based FCN, 3D CNN and point-set based manners. To discover informative anchor points towards certain joint, anchor proposal procedure is also proposed for A2J. Meanwhile 2D CNN (i.e., ResNet-50) is used as backbone network to drive A2J, without using time-consuming 3D convolutional or deconvolutional layers. The experiments on 3 hand datasets and 2 body datasets verify A2J's superiority. Meanwhile, A2J is of high running speed around 100 FPS on single NVIDIA 1080Ti GPU.

📄 PDF Abstract BibTeX arXiv:1908.09999

Code (2)

zhangboshen/A2J 공식 구현 pytorch
bo-zhang-cs/CACNet-Pytorch pytorch

Tasks

3D Pose EstimationDecoderDepth EstimationGPUHand Pose EstimationPose Estimation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
FCN Fully Convolutional Networks, or FCNs, are an architecture used mainly for semantic segmentation. They employ solely locally connected layers, such as…

Similar Papers 제목 키워드 기반

A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB Image

2023-04-07 · CVPR 2023 1 · Changlong Jiang, Yang Xiao, Cunlin Wu, Mingyang Zhang 외

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint p…

3D Interacting Hand Pose EstimationHand Pose EstimationPose EstimationPose Prediction

OMAD: Object Model with Articulated Deformations for Pose Estimation and Retrieval

2021-12-14 · Han Xue, Liu Liu, Wenqiang Xu, Haoyuan Fu 외

Articulated objects are pervasive in daily life. However, due to the intrinsic high-DoF structure, the joint states of the articulated objects are hard to be estimated. To model articulated objects, two kinds of shape de…

ObjectPose EstimationRetrieval

CAPT: Category-level Articulation Estimation from a Single Point Cloud Using Transformer

2024-02-27 · Lian Fu, Ryoichi Ishikawa, Yoshihiro Sato, Takeshi Oishi

The ability to estimate joint parameters is essential for various applications in robotics and computer vision. In this paper, we propose CAPT: category-level articulation estimation from a point cloud using Transformer.…

parameter estimationState Estimation

ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views

2026-05-23 · Inseo Lee, Yoonji Kim, Eugene Sohn, Jiwoong Lee 외 arxiv

Articulated object reconstruction from sparse-view images is an ill-posed problem that requires simultaneous inference of geometry and underlying articulation structure. Existing methods for articulated object reconstruc…

CenterArt: Joint Shape Reconstruction and 6-DoF Grasp Estimation of Articulated Objects

2024-04-23 · Sassan Mokhtar, Eugenio Chisari, Nick Heppert, Abhinav Valada

Precisely grasping and reconstructing articulated objects is key to enabling general robotic manipulation. In this paper, we propose CenterArt, a novel approach for simultaneous 3D shape reconstruction and 6-DoF grasp es…

3D Shape ReconstructionDecoder