DynOPETs: A Versatile Benchmark for Dynamic Object Pose Estimation and Tracking in Moving Camera Scenarios
In the realm of object pose estimation, scenarios involving both dynamic objects and moving cameras are prevalent. However, the scarcity of corresponding real-world datasets significantly hinders the development and evaluation of robust pose estimation models. This is largely attributed to the inherent challenges in accurately annotating object poses in dynamic scenes captured by moving cameras. To bridge this gap, this paper presents a novel dataset DynOPETs and a dedicated data acquisition and annotation pipeline tailored for object pose estimation and tracking in such unconstrained environments. Our efficient annotation method innovatively integrates pose estimation and pose tracking techniques to generate pseudo-labels, which are subsequently refined through pose graph optimization. The resulting dataset offers accurate pose annotations for dynamic objects observed from moving cameras. To validate the effectiveness and value of our dataset, we perform comprehensive evaluations using 18 state-of-the-art methods, demonstrating its potential to accelerate research in this challenging domain. The dataset will be made publicly available to facilitate further exploration and advancement in the field.
Code (1)
Tasks
3D Object DetectionObjectobject-detectionObject TrackingPose EstimationPose TrackingSimilar Papers 제목 키워드 기반
Versatile Offline Imitation from Observations and Examples via Regularized State-Occupancy Matching
We propose State Matching Offline DIstribution Correction Estimation (SMODICE), a novel and versatile regression-based offline imitation learning (IL) algorithm derived via state-occupancy matching. We show that the SMOD…
Imitation LearningReinforcement Learning (RL)OCTScenes: A Versatile Real-World Dataset of Tabletop Scenes for Object-Centric Learning
Humans possess the cognitive ability to comprehend scenes in a compositional manner. To empower AI systems with similar capabilities, object-centric learning aims to acquire representations of individual objects from vis…
ObjectRepresentation LearningVersaGauss: A Versatile Framework for Generating Multiphase Dynamics with 3D Gaussians
Recent progress has been made in 3D Gaussian representation for reconstruction, generation, and physical simulation. However, current approaches mainly concentrate on physics-based dynamic generation of solid objects and…
VALO: A Versatile Anytime Framework for LiDAR-based Object Detection Deep Neural Networks
This work addresses the challenge of adapting dynamic deadline requirements for LiDAR object detection deep neural networks (DNNs). The computing latency of object detection is critically important to ensure safe and eff…
Objectobject-detectionObject DetectionSimpleDet: A Simple and Versatile Distributed Framework for Object Detection and Instance Recognition
A Simple and Versatile Framework for Object Detection and Instance Recognition
Autonomous DrivingMedical Image AnalysisObjectobject-detection+1