GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence
We present GigaPose, a fast, robust, and accurate method for CAD-based novel object pose estimation in RGB images. GigaPose first leverages discriminative "templates", rendered images of the CAD models, to recover the out-of-plane rotation and then uses patch correspondences to estimate the four remaining parameters. Our approach samples templates in only a two-degrees-of-freedom space instead of the usual three and matches the input image to the templates using fast nearest-neighbor search in feature space, results in a speedup factor of 35x compared to the state of the art. Moreover, GigaPose is significantly more robust to segmentation errors. Our extensive evaluation on the seven core datasets of the BOP challenge demonstrates that it achieves state-of-the-art accuracy and can be seamlessly integrated with existing refinement methods. Additionally, we show the potential of GigaPose with 3D models predicted by recent work on 3D reconstruction from a single image, relaxing the need for CAD models and making 6D pose object estimation much more convenient. Our source code and trained models are publicly available at https://github.com/nv-nguyen/gigaPose
Code (1)
Tasks
3D Reconstruction6D Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation
Estimating the 6D pose of an object from a single RGB image is a critical task that becomes additionally challenging when dealing with symmetric objects. Recent approaches typically establish one-to-one correspondences b…
ObjectPose EstimationDPODv2: Dense Correspondence-Based 6 DoF Pose Estimation
We propose a three-stage 6 DoF object detection method called DPODv2 (Dense Pose Object Detector) that relies on dense correspondences. We combine a 2D object detector with a dense correspondence estimation network and a…
Objectobject-detectionObject DetectionPose EstimationCOPE: End-to-end trainable Constant Runtime Object Pose Estimation
State-of-the-art object pose estimation handles multiple instances in a test image by using multi-model formulations: detection as a first stage and then separately trained networks per object for 2D-3D geometric corresp…
6D Pose Estimation using RGBObjectPose EstimationObject Detection in Video with Spatial-temporal Context Aggregation
Recent cutting-edge feature aggregation paradigms for video object detection rely on inferring feature correspondence. The feature correspondence estimation problem is fundamentally difficult due to poor image quality, m…
Objectobject-detectionObject DetectionVideo Object DetectionOptFlow: Fast Optimization-based Scene Flow Estimation without Supervision
Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based sc…
Autonomous DrivingPoint Cloud RegistrationScene Flow EstimationSelf-supervised Scene Flow Estimation+1