Bridging the Reality Gap for Pose Estimation Networks using Sensor-Based Domain Randomization
Since the introduction of modern deep learning methods for object pose estimation, test accuracy and efficiency has increased significantly. For training, however, large amounts of annotated training data are required for good performance. While the use of synthetic training data prevents the need for manual annotation, there is currently a large performance gap between methods trained on real and synthetic data. This paper introduces a new method, which bridges this gap. Most methods trained on synthetic data use 2D images, as domain randomization in 2D is more developed. To obtain precise poses, many of these methods perform a final refinement using 3D data. Our method integrates the 3D data into the network to increase the accuracy of the pose estimation. To allow for domain randomization in 3D, a sensor-based data augmentation has been developed. Additionally, we introduce the SparseEdge feature, which uses a wider search space during point cloud propagation to avoid relying on specific features without increasing run-time. Experiments on three large pose estimation benchmarks show that the presented method outperforms previous methods trained on synthetic data and achieves comparable results to existing methods trained on real data.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationPose EstimationSimilar Papers 제목 키워드 기반
VLPose: Bridging the Domain Gap in Pose Estimation with Language-Vision Tuning
Thanks to advances in deep learning techniques, Human Pose Estimation (HPE) has achieved significant progress in natural scenarios. However, these models perform poorly in artificial scenarios such as painting and sculpt…
Pose EstimationSynthetic Data Generation for Bridging Sim2Real Gap in a Production Environment
Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an impo…
6D Pose Estimation using RGBObjectobject-detectionObject Detection+3S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Reality
Due to the lack of enough real multi-agent data and time-consuming of labeling, existing multi-agent cooperative perception algorithms usually select the simulated sensor data for training and validating. However, the pe…
3D Object Detectionobject-detectionObject DetectionTransfer LearningINDOOR-LiDAR: Bridging Simulation and Reality for Robot-Centric 360 degree Indoor LiDAR Perception -- A Robot-Centric Hybrid Dataset
We present INDOOR-LIDAR, a comprehensive hybrid dataset of indoor 3D LiDAR point clouds designed to advance research in robot perception. Existing indoor LiDAR datasets often suffer from limited scale, inconsistent annot…
Scene Understanding3D Object DetectionDomain AdaptationPoint CloudsRobust Deep-Learning-Based Road-Prediction for Augmented Reality Navigation Systems
This paper proposes an approach that predicts the road course from camera sensors leveraging deep learning techniques. Road pixels are identified by training a multi-scale convolutional neural network on a large number o…