paper-with-me

Papers

Bridging the Reality Gap for Pose Estimation Networks using Sensor-Based Domain Randomization

2020-11-17 · Frederik Hagelskjaer, Anders Glent Buch

Since the introduction of modern deep learning methods for object pose estimation, test accuracy and efficiency has increased significantly. For training, however, large amounts of annotated training data are required for good performance. While the use of synthetic training data prevents the need for manual annotation, there is currently a large performance gap between methods trained on real and synthetic data. This paper introduces a new method, which bridges this gap. Most methods trained on synthetic data use 2D images, as domain randomization in 2D is more developed. To obtain precise poses, many of these methods perform a final refinement using 3D data. Our method integrates the 3D data into the network to increase the accuracy of the pose estimation. To allow for domain randomization in 3D, a sensor-based data augmentation has been developed. Additionally, we introduce the SparseEdge feature, which uses a wider search space during point cloud propagation to avoid relying on specific features without increasing run-time. Experiments on three large pose estimation benchmarks show that the presented method outperforms previous methods trained on synthetic data and achieves comparable results to existing methods trained on real data.

📄 PDF Abstract BibTeX arXiv:2011.08517

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationPose Estimation

Similar Papers 제목 키워드 기반

VLPose: Bridging the Domain Gap in Pose Estimation with Language-Vision Tuning

2024-02-22 · Jingyao Li, Pengguang Chen, Xuan Ju, Hong Xu 외

Thanks to advances in deep learning techniques, Human Pose Estimation (HPE) has achieved significant progress in natural scenarios. However, these models perform poorly in artificial scenarios such as painting and sculpt…

Pose Estimation

Synthetic Data Generation for Bridging Sim2Real Gap in a Production Environment

2023-11-18 · Parth Rawal, Mrunal Sompura, Wolfgang Hintze

Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an impo…

6D Pose Estimation using RGBObjectobject-detectionObject Detection+3

S2R-ViT for Multi-Agent Cooperative Perception: Bridging the Gap from Simulation to Reality

2023-07-16 · Jinlong Li, Runsheng Xu, Xinyu Liu, Baolu Li 외

Due to the lack of enough real multi-agent data and time-consuming of labeling, existing multi-agent cooperative perception algorithms usually select the simulated sensor data for training and validating. However, the pe…

3D Object Detectionobject-detectionObject DetectionTransfer Learning

INDOOR-LiDAR: Bridging Simulation and Reality for Robot-Centric 360 degree Indoor LiDAR Perception -- A Robot-Centric Hybrid Dataset

2025-12-13 · Haichuan Li, Changda Tian, Panos Trahanias, Tomi Westerlund arxiv

We present INDOOR-LIDAR, a comprehensive hybrid dataset of indoor 3D LiDAR point clouds designed to advance research in robot perception. Existing indoor LiDAR datasets often suffer from limited scale, inconsistent annot…

Scene Understanding3D Object DetectionDomain AdaptationPoint Clouds

Robust Deep-Learning-Based Road-Prediction for Augmented Reality Navigation Systems

2016-05-31 · Matthias Limmer, Julian Forster, Dennis Baudach, Florian Schüle 외

This paper proposes an approach that predicts the road course from camera sensors leveraging deep learning techniques. Road pixels are identified by training a multi-scale convolutional neural network on a large number o…