Implicit 3D Orientation Learning for 6D Object Detection from RGB Images
We propose a real-time RGB-based pipeline for object detection and 6D pose estimation. Our novel 3D orientation estimation is based on a variant of the Denoising Autoencoder that is trained on simulated views of a 3D model using Domain Randomization. This so-called Augmented Autoencoder has several advantages over existing methods: It does not require real, pose-annotated training data, generalizes to various test sensors and inherently handles object and view symmetries. Instead of learning an explicit mapping from input images to object poses, it provides an implicit representation of object orientations defined by samples in a latent space. Our pipeline achieves state-of-the-art performance on the T-LESS dataset both in the RGB and RGB-D domain. We also evaluate on the LineMOD dataset where we can compete with other synthetically trained approaches. We further increase performance by correcting 3D orientation estimates to account for perspective errors when the object deviates from the image center and show extended results.
Code (1)
Tasks
6D Pose Estimation6D Pose Estimation using RGBDenoisingObjectobject-detectionObject DetectionPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Joint stereo 3D object detection and implicit surface reconstruction
We present a new learning-based framework S-3D-RCNN that can recover accurate object orientation in SO(3) and simultaneously predict implicit rigid shapes from stereo RGB images. For orientation estimation, in contrast t…
3D Object DetectionHallucinationObjectobject-detection+3Learning Implicit Probability Distribution Functions for Symmetric Orientation Estimation from RGB Images Without Pose Labels
Object pose estimation is a necessary prerequisite for autonomous robotic manipulation, but the presence of symmetry increases the complexity of the pose estimation task. Existing methods for object pose estimation outpu…
ObjectPoint Cloud RegistrationPose EstimationA 2-Stage Model for Vehicle Class and Orientation Detection with Photo-Realistic Image Generation
We aim to detect the class and orientation of a vehicle by training a model with synthetic data. However, the distribution of the classes in the training data is imbalanced, and the model trained on the synthetic image i…
Image GenerationVistaRef: Boosting Visual Spatial Orientation Awareness for Pointing-to-Object Detection
Grounding deictic gestures in natural images is fundamental to AR and human-robot collaboration, providing a basis for seamless spatial interaction. While Transformer-based visual models have achieved significant progres…
Object DetectionImpDet: Exploring Implicit Fields for 3D Object Detection
Conventional 3D object detection approaches concentrate on bounding boxes representation learning with several parameters, i.e., localization, dimension, and orientation. Despite its popularity and universality, such a s…
3D Object DetectionObjectobject-detectionObject Detection+1