Part-Aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking
This paper introduces an approach for multi-human 3D pose estimation and tracking based on calibrated multi-view. The main challenge lies in finding the cross-view and temporal correspondences correctly even when several human pose estimations are noisy. Compare to previous solutions that construct 3D poses from multiple views, our approach takes advantage of temporal consistency to match the 2D poses estimated with previously constructed 3D skeletons in every view. Therefore cross-view and temporal associations are accomplished simultaneously. Since the performance suffers from mistaken association and noisy predictions, we design two strategies for aiming better correspondences and 3D reconstruction. Specifically, we propose a part-aware measurement for 2D-3D association and a filter that can cope with 2D outliers during reconstruction. Our approach is efficient and effective comparing to state-of-the-art methods; it achieves competitive results on two benchmarks: 96.8% on Campus and 97.4% on Shelf. Moreover, we extends the length of Campus evaluation frames to be more challenging and our proposal also reach well-performed result.
Code (1)
Tasks
3D Human Pose Estimation3D Human Pose Tracking3D Multi-Person Human Pose Estimation3D Pose Estimation3D ReconstructionPose EstimationSimilar Papers 제목 키워드 기반
EchoVLM: Measurement-Grounded Multimodal Learning for Echocardiography
Echocardiography is the most widely used imaging modality in cardiology, yet its interpretation remains labor-intensive and inherently multimodal, requiring view recognition, quantitative measurements, qualitative assess…
Text RetrievalKnowledge-Informed Kernel State Reconstruction from Heterogeneous Partial Observations
Real-world scientific systems are rarely observed through complete, regularly sampled state trajectories. Instead, measurements are often partial, noisy, and heterogeneous, providing fragmented views of latent dynamical …
Motion-Uncertainty-Aware Next-Best-View Planning for Moving Object Reconstruction
Active 3D reconstruction of moving objects requires selecting informative viewpoints while accounting for object motion uncertainty during the decision-to-execution delay. Existing methods address only parts of this prob…
3D ReconstructionHuman-Aware Sensor Network Ontology: Semantic Support for Empirical Data Collection
Significant efforts have been made to understand and document knowledge related to scientific measurements. Many of those efforts resulted in one or more high-quality ontologies that describe some aspects of scientific m…
ManagementTreeDGS: Aerial Gaussian Splatting for Distant DBH Measurement
Aerial remote sensing efficiently surveys large areas, but accurate direct object-level measurement remains difficult in complex natural scenes. Advancements in 3D computer vision, particularly radiance field representat…
Image Reconstruction