paper-with-me

홈 › Papers

Direct Dense Pose Estimation

2022-04-04 · Liqian Ma, Lingjie Liu, Christian Theobalt, Luc van Gool

Dense human pose estimation is the problem of learning dense correspondences between RGB images and the surfaces of human bodies, which finds various applications, such as human body reconstruction, human pose transfer, and human action recognition. Prior dense pose estimation methods are all based on Mask R-CNN framework and operate in a top-down manner of first attempting to identify a bounding box for each person and matching dense correspondences in each bounding box. Consequently, these methods lack robustness due to their critical dependence on the Mask R-CNN detection, and the runtime increases drastically as the number of persons in the image increases. We therefore propose a novel alternative method for solving the dense pose estimation problem, called Direct Dense Pose (DDP). DDP first predicts the instance mask and global IUV representation separately and then combines them together. We also propose a simple yet effective 2D temporal-smoothing scheme to alleviate the temporal jitters when dealing with video data. Experiments demonstrate that DDP overcomes the limitations of previous top-down baseline methods and achieves competitive accuracy. In addition, DDP is computationally more efficient than previous dense pose estimation methods, and it reduces jitters when applied to a video sequence, which is a problem plaguing the previous methods.

📄 PDF Abstract BibTeX arXiv:2204.01263

Code (0)

등록된 구현이 없습니다.

Tasks

Action RecognitionPose EstimationPose TransferTemporal Action Localization

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

RadarCam-Depth: Radar-Camera Fusion for Depth Estimation with Learned Metric Scale

2024-01-09 · Han Li, Yukai Ma, Yaqing Gu, Kewei Hu 외

We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings,…

Depth EstimationDepth Prediction

Dense 3D Regression for Hand Pose Estimation

2017-11-24 · CVPR 2018 6 · Chengde Wan, Thomas Probst, Luc van Gool, Angela Yao

We present a simple and effective method for 3D hand pose estimation from a single depth frame. As opposed to previous state-of-the-art methods based on holistic 3D regression, our method works on dense pixel-wise estima…

3D Hand Pose EstimationHand Pose EstimationPose Estimationregression

Improving 2D-3D Dense Correspondences with Diffusion Models for 6D Object Pose Estimation

2024-02-09 · Peter Hönig, Stefan Thalhammer, Markus Vincze

Estimating 2D-3D correspondences between RGB images and 3D space is a fundamental problem in 6D object pose estimation. Recent pose estimators use dense correspondence maps and Point-to-Point algorithms to estimate objec…

6D Pose Estimation using RGBBenchmarkingImage-to-Image TranslationObject+2

Neural Voting Field for Camera-Space 3D Hand Pose Estimation

2023-05-07 · CVPR 2023 1 · Lin Huang, Chung-Ching Lin, Kevin Lin, Lin Liang 외

We present a unified framework for camera-space 3D hand pose estimation from a single RGB image based on 3D implicit representation. As opposed to recent works, most of which first adopt holistic or pixel-level dense reg…

3D Hand Pose EstimationHand Pose EstimationPose Estimationregression

Learning Optical Flow from a Few Matches

2021-04-05 · CVPR 2021 1 · Shihao Jiang, Yao Lu, Hongdong Li, Richard Hartley

State-of-the-art neural network models for optical flow estimation require a dense correlation volume at high resolutions for representing per-pixel displacement. Although the dense correlation volume is informative for …

Optical Flow Estimation