paper-with-me

홈 › Papers

JRDB-Pose3D: A Multi-person 3D Human Pose and Shape Estimation Dataset for Robotics

2026-02-03 · Sandika Biswas, Kian Izadpanah, Hamid Rezatofighi arxiv

Real-world scenes are inherently crowded. Hence, estimating 3D poses of all nearby humans, tracking their movements over time, and understanding their activities within social and environmental contexts are essential for many applications, such as autonomous driving, robot perception, robot navigation, and human-robot interaction. However, most existing 3D human pose estimation datasets primarily focus on single-person scenes or are collected in controlled laboratory environments, which restricts their relevance to real-world applications. To bridge this gap, we introduce JRDB-Pose3D, which captures multi-human indoor and outdoor environments from a mobile robotic platform. JRDB-Pose3D provides rich 3D human pose annotations for such complex and dynamic scenes, including SMPL-based pose annotations with consistent body-shape parameters and track IDs for each individual over time. JRDB-Pose3D contains, on average, 5-10 human poses per frame, with some scenes featuring up to 35 individuals simultaneously. The proposed dataset presents unique challenges, including frequent occlusions, truncated bodies, and out-of-frame body parts, which closely reflect real-world environments. Moreover, JRDB-Pose3D inherits all available annotations from the JRDB dataset, such as 2D pose, information about social grouping, activities, and interactions, full-scene semantic masks with consistent human- and object-level tracking, and detailed annotations for each individual, such as age, gender, and race, making it a holistic dataset for a wide range of downstream perception and human-centric understanding tasks.

📄 PDF Abstract BibTeX arXiv:2602.03064

Code (0)

등록된 구현이 없습니다.

Tasks

3D human pose and shape estimation3D Human Pose EstimationAutonomous DrivingRobot Navigation

Similar Papers 제목 키워드 기반

JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Tracking

2022-10-20 · CVPR 2023 1 · Edward Vendrow, Duy Tho Le, Jianfei Cai, Hamid Rezatofighi

Autonomous robotic systems operating in human environments must understand their surroundings to make accurate and safe decisions. In crowded human scenes with close-up human-robot interaction and robot navigation, a dee…

DiversityMulti-Person Pose EstimationMulti-Person Pose Estimation and TrackingPose Estimation+2

JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups

2024-04-06 · CVPR 2024 1 · Simindokht Jahangard, Zhixi Cai, Shiki Wen, Hamid Rezatofighi

Understanding human social behaviour is crucial in computer vision and robotics. Micro-level observations like individual actions fall short, necessitating a comprehensive approach that considers individual behaviour, in…

JRDB-Act: A Large-scale Dataset for Spatio-temporal Action, Social Group and Activity Detection

2021-06-16 · CVPR 2022 1 · Mahsa Ehsanpour, Fatemeh Saleh, Silvio Savarese, Ian Reid 외

The availability of large-scale video action understanding datasets has facilitated advances in the interpretation of visual scenes containing people. However, learning to recognise human actions and their social interac…

Action DetectionAction UnderstandingActivity Detection

Person-MinkUNet: 3D Person Detection with LiDAR Point Cloud

2021-07-03 · Dan Jia, Bastian Leibe

In this preliminary work we attempt to apply submanifold sparse convolution to the task of 3D person detection. In particular, we present Person-MinkUNet, a single-stage 3D person detection network based on Minkowski Eng…

Human Detection

JRDB-PanoTrack: An Open-world Panoptic Segmentation and Tracking Robotic Dataset in Crowded Human Environments

2024-04-02 · CVPR 2024 1 · Duy-Tho Le, Chenhui Gou, Stavya Datta, Hengcan Shi 외

Autonomous robot systems have attracted increasing research attention in recent years, where environment understanding is a crucial step for robot navigation, human-robot interaction, and decision. Real-world robot syste…

Decision MakingPanoptic SegmentationRobot Navigation