paper-with-me

Papers

ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation

2022-03-17 · CVPR 2022 1 · Yongzhi Su, Mahdi Saleh, Torben Fetzer, Jason Rambach, Nassir Navab, Benjamin Busam, Didier Stricker, Federico Tombari

Establishing correspondences from image to 3D has been a key task of 6DoF object pose estimation for a long time. To predict pose more accurately, deeply learned dense maps replaced sparse templates. Dense methods also improved pose estimation in the presence of occlusion. More recently researchers have shown improvements by learning object fragments as segmentation. In this work, we present a discrete descriptor, which can represent the object surface densely. By incorporating a hierarchical binary grouping, we can encode the object surface very efficiently. Moreover, we propose a coarse to fine training strategy, which enables fine-grained correspondence prediction. Finally, by matching predicted codes with object surface and using a PnP solver, we estimate the 6DoF pose. Results on the public LM-O and YCB-V datasets show major improvement over the state of the art w.r.t. ADD(-S) metric, even surpassing RGB-D based methods in some cases.

📄 PDF Abstract BibTeX arXiv:2203.09418

Code (1)

suyz526/zebrapose 공식 구현 pytorch

Tasks

Image to 3DObjectPose Estimation

Methods 이 논문이 사용한 방법론

PnP PnP, or Poll and Pool, is sampling module extension for DETR-type architectures that adaptively allocates its computation…

Similar Papers 제목 키워드 기반

3D-C2FT: Coarse-to-fine Transformer for Multi-view 3D Reconstruction

2022-05-29 · Leslie Ching Ow Tiong, Dick Sigmund, Andrew Beng Jin Teoh

Recently, the transformer model has been successfully employed for the multi-view 3D reconstruction problem. However, challenges remain on designing an attention mechanism to explore the multiview features and exploit th…

3D ReconstructionMulti-View 3D Reconstruction

HR-NeuS: Recovering High-Frequency Surface Geometry via Neural Implicit Surfaces

2023-02-14 · Erich Liang, Kenan Deng, Xi Zhang, Chun-Kai Wang

Recent advances in neural implicit surfaces for multi-view 3D reconstruction primarily focus on improving large-scale surface reconstruction accuracy, but often produce over-smoothed geometries that lack fine surface det…

3D ReconstructionMulti-View 3D ReconstructionSurface ReconstructionVocal Bursts Intensity Prediction

HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation

2023-11-21 · CVPR 2024 1 · Yongliang Lin, Yongzhi Su, Praveen Nathan, Sandeep Inuganti 외

In this work, we present a novel dense-correspondence method for 6DoF object pose estimation from a single RGB-D image. While many existing data-driven methods achieve impressive performance, they tend to be time-consumi…

Pose Estimation

1st Place Solution for ICCV 2023 OmniObject3D Challenge: Sparse-View Reconstruction

2024-04-16 · Hang Du, Yaping Xue, Weidong Dai, Xuejun Yan 외

In this report, we present the 1st place solution for ICCV 2023 OmniObject3D Challenge: Sparse-View Reconstruction. The challenge aims to evaluate approaches for novel view synthesis and surface reconstruction using only…

NeRFNovel View SynthesisSurface Reconstruction

Spatially-Adaptive Hash Encodings For Neural Surface Reconstruction

2024-12-06 · Thomas Walker, Octave Mariotti, Amir Vaxman, Hakan Bilen

Positional encodings are a common component of neural scene reconstruction methods, and provide a way to bias the learning of neural fields towards coarser or finer representations. Current neural surface reconstruction …

Surface Reconstruction