ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation
Establishing correspondences from image to 3D has been a key task of 6DoF object pose estimation for a long time. To predict pose more accurately, deeply learned dense maps replaced sparse templates. Dense methods also improved pose estimation in the presence of occlusion. More recently researchers have shown improvements by learning object fragments as segmentation. In this work, we present a discrete descriptor, which can represent the object surface densely. By incorporating a hierarchical binary grouping, we can encode the object surface very efficiently. Moreover, we propose a coarse to fine training strategy, which enables fine-grained correspondence prediction. Finally, by matching predicted codes with object surface and using a PnP solver, we estimate the 6DoF pose. Results on the public LM-O and YCB-V datasets show major improvement over the state of the art w.r.t. ADD(-S) metric, even surpassing RGB-D based methods in some cases.
Code (1)
Tasks
Image to 3DObjectPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
3D-C2FT: Coarse-to-fine Transformer for Multi-view 3D Reconstruction
Recently, the transformer model has been successfully employed for the multi-view 3D reconstruction problem. However, challenges remain on designing an attention mechanism to explore the multiview features and exploit th…
3D ReconstructionMulti-View 3D ReconstructionHR-NeuS: Recovering High-Frequency Surface Geometry via Neural Implicit Surfaces
Recent advances in neural implicit surfaces for multi-view 3D reconstruction primarily focus on improving large-scale surface reconstruction accuracy, but often produce over-smoothed geometries that lack fine surface det…
3D ReconstructionMulti-View 3D ReconstructionSurface ReconstructionVocal Bursts Intensity PredictionHiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation
In this work, we present a novel dense-correspondence method for 6DoF object pose estimation from a single RGB-D image. While many existing data-driven methods achieve impressive performance, they tend to be time-consumi…
Pose Estimation1st Place Solution for ICCV 2023 OmniObject3D Challenge: Sparse-View Reconstruction
In this report, we present the 1st place solution for ICCV 2023 OmniObject3D Challenge: Sparse-View Reconstruction. The challenge aims to evaluate approaches for novel view synthesis and surface reconstruction using only…
NeRFNovel View SynthesisSurface ReconstructionSpatially-Adaptive Hash Encodings For Neural Surface Reconstruction
Positional encodings are a common component of neural scene reconstruction methods, and provide a way to bias the learning of neural fields towards coarser or finer representations. Current neural surface reconstruction …
Surface Reconstruction