TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecasting
Existing volumetric methods for predicting 3D human pose estimation are accurate, but computationally expensive and optimized for single time-step prediction. We present TEMPO, an efficient multi-view pose estimation model that learns a robust spatiotemporal representation, improving pose accuracy while also tracking and forecasting human pose. We significantly reduce computation compared to the state-of-the-art by recurrently computing per-person 2D pose features, fusing both spatial and temporal information into a single representation. In doing so, our model is able to use spatiotemporal context to predict more accurate human poses without sacrificing efficiency. We further use this representation to track human poses over time as well as predict future poses. Finally, we demonstrate that our model is able to generalize across datasets without scene-specific fine-tuning. TEMPO achieves 10$\%$ better MPJPE with a 33$\times$ improvement in FPS compared to TesseTrack on the challenging CMU Panoptic Studio dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking
This paper introduces an approach for multi-human 3D pose estimation and tracking based on calibrated multi-view. The main challenge lies in finding the cross-view and temporal correspondences correctly even when several…
3D Human Pose Estimation3D Human Pose Tracking3D Multi-Person Human Pose Estimation3D Pose Estimation+2MV-TAP: Tracking Any Point in Multi-View Videos
Multi-view camera systems enable rich observations of complex real-world scenes, and understanding dynamic objects in multi-view settings has become central to various applications. In this work, we present MV-TAP, a nov…
Point TrackingCOMETH: Convex Optimization for Multiview Estimation and Tracking of Humans
In the era of Industry 5.0, monitoring human activity is essential for ensuring both ergonomic safety and overall well-being. While multi-camera centralized setups improve pose estimation accuracy, they often suffer from…
Pose EstimationMultiple human pose estimation with temporally consistent 3d pictorial structures
Multiple human 3D pose estimation from multiple camera views is a challenging task in unconstrained environments. Each individual has to be matched across each view and then the body pose has to be estimated. Additionall…
3D Multi-Person Pose Estimation3D Pose EstimationPose EstimationTesseTrack: End-to-End Learnable Multi-Person Articulated 3D Pose Tracking
We consider the task of 3D pose estimation and tracking of multiple people seen in an arbitrary number of camera feeds. We propose TesseTrack, a novel top-down approach that simultaneously reasons about multiple individu…
2D Pose Estimation3D Human Pose Estimation3D Human Pose Tracking3D Multi-Object Tracking+5