Towards Alleviating the Modeling Ambiguity of Unsupervised Monocular 3D Human Pose Estimation
In this work, we study the ambiguity problem in the task of unsupervised 3D human pose estimation from 2D counterpart. On one hand, without explicit annotation, the scale of 3D pose is difficult to be accurately captured (scale ambiguity). On the other hand, one 2D pose might correspond to multiple 3D gestures, where the lifting procedure is inherently ambiguous (pose ambiguity). Previous methods generally use temporal constraints (e.g., constant bone length and motion smoothness) to alleviate the above issues. However, these methods commonly enforce the outputs to fulfill multiple training objectives simultaneously, which often lead to sub-optimal results. In contrast to the majority of previous works, we propose to split the whole problem into two sub-tasks, i.e., optimizing 2D input poses via a scale estimation module and then mapping optimized 2D pose to 3D counterpart via a pose lifting module. Furthermore, two temporal constraints are proposed to alleviate the scale and pose ambiguity respectively. These two modules are optimized via a iterative training scheme with corresponding temporal constraints, which effectively reduce the learning difficulty and lead to better performance. Results on the Human3.6M dataset demonstrate that our approach improves upon the prior art by 23.1% and also outperforms several weakly supervised approaches that rely on 3D annotations. Our project is available at https://sites.google.com/view/ambiguity-aware-hpe.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose EstimationMonocular 3D Human Pose EstimationPose EstimationUnsupervised 3D Human Pose EstimationSimilar Papers 제목 키워드 기반
X as Supervision: Contending with Depth Ambiguity in Unsupervised Monocular 3D Pose Estimation
Recent unsupervised methods for monocular 3D pose estimation have endeavored to reduce dependence on limited annotated 3D data, but most are solely formulated in 2D space, overlooking the inherent depth ambiguity issue. …
3D Pose EstimationPose EstimationHyperDiff: Hypergraph Guided Diffusion Model for 3D Human Pose Estimation
Monocular 3D human pose estimation (HPE) often encounters challenges such as depth ambiguity and occlusion during the 2D-to-3D lifting process. Additionally, traditional methods may overlook multi-scale skeleton features…
Monocular 3D Human Pose Estimation3D Pose EstimationUnsupervised Multi-Person 3D Human Pose Estimation From 2D Poses Alone
Current unsupervised 2D-3D human pose estimation (HPE) methods do not work in multi-person scenarios due to perspective ambiguity in monocular images. Therefore, we present one of the first studies investigating the feas…
3D Human Pose Estimation3D Pose Estimation3D ReconstructionPose EstimationMulti-Object Discovery by Low-Dimensional Object Motion
Recent work in unsupervised multi-object segmentation shows impressive results by predicting motion from a single image despite the inherent ambiguity in predicting motion without the next image. On the other hand, the s…
Depth EstimationMonocular Depth EstimationMulti-object discoveryObject+3Dynamo-Depth: Fixing Unsupervised Depth Estimation for Dynamical Scenes
Unsupervised monocular depth estimation techniques have demonstrated encouraging results but typically assume that the scene is static. These techniques suffer when trained on dynamical scenes, where apparent object moti…
Depth EstimationMonocular Depth EstimationMotion SegmentationSegmentation+1