HPERL: 3D Human Pose Estimation from RGB and LiDAR
In-the-wild human pose estimation has a huge potential for various fields, ranging from animation and action recognition to intention recognition and prediction for autonomous driving. The current state-of-the-art is focused only on RGB and RGB-D approaches for predicting the 3D human pose. However, not using precise LiDAR depth information limits the performance and leads to very inaccurate absolute pose estimation. With LiDAR sensors becoming more affordable and common on robots and autonomous vehicle setups, we propose an end-to-end architecture using RGB and LiDAR to predict the absolute 3D human pose with unprecedented precision. Additionally, we introduce a weakly-supervised approach to generate 3D predictions using 2D pose annotations from PedX [1]. This allows for many new opportunities in the field of 3D human pose estimation.
Code (1)
Tasks
3D Human Pose EstimationAction RecognitionAutonomous DrivingIntent DetectionPose EstimationSimilar Papers 제목 키워드 기반
Factorized Spatio-Temporal Convolutions for Human Pose Estimation from Planar Lidar
Localizing nearby humans and estimating their facing direction are key capabilities for safe navigation and socially aware human-robot interaction. Many pose-estimation pipelines target cameras and 3D LiDAR or assume GPU…
2D Pose Estimation3D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review
In this paper, we present a comprehensive review of 3D human pose estimation and human mesh recovery from in-the-wild LiDAR point clouds. We compare existing approaches across several key dimensions, and propose a struct…
3D human pose and shape estimation3D Human Pose EstimationHuman Mesh RecoveryPoint CloudsExpanding mmWave Datasets for Human Pose Estimation with Unlabeled Data and LiDAR Datasets
Current millimeter-wave (mmWave) datasets for human pose estimation (HPE) are scarce and lack diversity in both point cloud (PC) attributes and human poses, hindering the generalization ability of their trained models. O…
Pose EstimationPre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimation
With the rapid development of autonomous driving, LiDAR-based 3D Human Pose Estimation (3D HPE) is becoming a research focus. However, due to the noise and sparsity of LiDAR-captured point clouds, robust human pose estim…
3D Human Pose EstimationAutonomous DrivingPose EstimationLPFormer: LiDAR Pose Estimation Transformer with Multi-Task Network
Due to the difficulty of acquiring large-scale 3D human keypoint annotation, previous methods for 3D human pose estimation (HPE) have often relied on 2D image features and sequential 2D annotations. Furthermore, the trai…
3D Human Pose EstimationPose Estimation