3D Human Pose Estimation from Deep Multi-View 2D Pose
Human pose estimation - the process of recognizing a human's limb positions and orientations in a video - has many important applications including surveillance, diagnosis of movement disorders, and computer animation. While deep learning has lead to great advances in 2D and 3D pose estimation from single video sources, the problem of estimating 3D human pose from multiple video sensors with overlapping fields of view has received less attention. When the application allows use of multiple cameras, 3D human pose estimates may be greatly improved through fusion of multi-view pose estimates and observation of limbs that are fully or partially occluded in some views. Past approaches to multi-view 3D pose estimation have used probabilistic graphical models to reason over constraints, including per-image pose estimates, temporal smoothness, and limb length. In this paper, we present a pipeline for multi-view 3D pose estimation of multiple individuals which combines a state-of-art 2D pose detector with a factor graph of 3D limb constraints optimized with belief propagation. We evaluate our results on the TUM-Campus and Shelf datasets for multi-person 3D pose estimation and show that our system significantly out-performs the previous state-of-the-art with a simpler model of limb dependency.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose Estimation3D Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
Multi-Person 3D Pose Estimation from Multi-View Uncalibrated Depth Cameras
We tackle the task of multi-view, multi-person 3D human pose estimation from a limited number of uncalibrated depth cameras. Recently, many approaches have been proposed for 3D human pose estimation from multi-view RGB c…
3D Human Pose Estimation3D Pose Estimation3D ReconstructionCamera Pose Estimation+23D Pictorial Structures for Multiple Human Pose Estimation
In this work, we address the problem of 3D pose estimation of multiple humans from multiple views. This is a more challenging problem than single human 3D pose estimation due to the much larger state space, partial occlu…
3D Human Pose Estimation3D Multi-Person Pose Estimation3D Pose EstimationPose EstimationMulti-view Pose Fusion for Occlusion-Aware 3D Human Pose Estimation
Robust 3D human pose estimation is crucial to ensure safe and effective human-robot collaboration. Accurate human perception,however, is particularly challenging in these scenarios due to strong occlusions and limited ca…
3D Human Pose Estimation3D Pose EstimationPose EstimationPPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimation
Recently, the vision transformer and its variants have played an increasingly important role in both monocular and multi-view human pose estimation. Considering image patches as tokens, transformers can model the global …
2D Human Pose Estimation3D Human Pose EstimationPose EstimationA Multi-view RGB-D Approach for Human Pose Estimation in Operating Rooms
Many approaches have been proposed for human pose estimation in single and multi-view RGB images. However, some environments, such as the operating room, are still very challenging for state-of-the-art RGB methods. In th…
3D Human Pose EstimationMulti-view 3D Human Pose EstimationPose Estimation