paper-with-me

홈 › Papers

UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image

2024-11-25 · CVPR 2025 1 · Xingyu Liu, Gu Wang, Ruida Zhang, Chenyangguang Zhang, Federico Tombari, Xiangyang Ji

Unseen object pose estimation methods often rely on CAD models or multiple reference views, making the onboarding stage costly. To simplify reference acquisition, we aim to estimate the unseen object's pose through a single unposed RGB-D reference image. While previous works leverage reference images as pose anchors to limit the range of relative pose, our scenario presents significant challenges since the relative transformation could vary across the entire SE(3) space. Moreover, factors like occlusion, sensor noise, and extreme geometry could result in low viewpoint overlap. To address these challenges, we present a novel approach and benchmark, termed UNOPose, for unseen one-reference-based object pose estimation. Building upon a coarse-to-fine paradigm, UNOPose constructs an SE(3)-invariant reference frame to standardize object representation despite pose and size variations. To alleviate small overlap across viewpoints, we recalibrate the weight of each correspondence based on its predicted likelihood of being within the overlapping region. Evaluated on our proposed benchmark based on the BOP Challenge, UNOPose demonstrates superior performance, significantly outperforming traditional and learning-based methods in the one-reference setting and remaining competitive with CAD-model-based methods. The code and dataset will be available.

📄 PDF Abstract BibTeX arXiv:2411.16106

Code (0)

등록된 구현이 없습니다.

Tasks

ObjectPose Estimation

Similar Papers 제목 키워드 기반

MELON: NeRF with Unposed Images in SO(3)

2023-03-14 · Axel Levy, Mark Matthews, Matan Sela, Gordon Wetzstein 외

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smoo…

Inverse RenderingNeRFNovel View SynthesisPose Estimation

Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Views

2024-12-11 · Songchun Zhang, Chunhui Zhao

Inferring 3D structures from sparse, unposed observations is challenging due to its unconstrained nature. Recent methods propose to predict implicit representations directly from unposed inputs in a data-driven manner, a…

3D ReconstructionNovel View Synthesis

CodeNeRF: Disentangled Neural Radiance Fields for Object Categories

2021-09-03 · ICCV 2021 10 · Wonbong Jang, Lourdes Agapito

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unli…

NeRFObject

TUN3D: Towards Real-World Scene Understanding from Unposed Images

2025-09-23 · Anton Konushin, Nikita Drozdov, Bulat Gabdullin, Alexey Zakharov 외 arxiv

Layout estimation and 3D object detection are two fundamental tasks in indoor scene understanding. When combined, they enable the creation of a compact yet semantically rich spatial representation of a scene. Existing ap…

3D Object DetectionScene UnderstandingPoint Clouds

Learning Robust Multi-Scale Representation for Neural Radiance Fields from Unposed Images

2023-11-08 · Nishant Jain, Suryansh Kumar, Luc van Gool

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic …

Camera Pose EstimationDepth EstimationDepth PredictionGraph Neural Network+2