paper-with-me

홈 › Papers

Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames

2025-03-05 · Jun Yang, Wenjie Xue, Sahar Ghavidel, Steven L. Waslander

Estimating the 6D pose of textureless objects from RBG images is an important problem in robotics. Due to appearance ambiguities, rotational symmetries, and severe occlusions, single-view based 6D pose estimators are still unable to handle a wide range of objects, motivating research towards multi-view pose estimation and next-best-view prediction that addresses these limitations. In this work, we propose a comprehensive active perception framework for estimating the 6D poses of textureless objects using only RGB images. Our approach is built upon a key idea: decoupling the 6D pose estimation into a sequential two-step process can greatly improve both accuracy and efficiency. First, we estimate the 3D translation of each object, resolving scale and depth ambiguities inherent to RGB images. These estimates are then used to simplify the subsequent task of determining the 3D orientation, which we achieve through canonical scale template matching. Building on this formulation, we then introduce an active perception strategy that predicts the next best camera viewpoint to capture an RGB image, effectively reducing object pose uncertainty and enhancing pose accuracy. We evaluate our method on the public ROBI dataset as well as on a transparent object dataset that we created. When evaluated using the same camera viewpoints, our multi-view pose estimation significantly outperforms state-of-the-art approaches. Furthermore, by leveraging our next-best-view strategy, our method achieves high object pose accuracy with substantially fewer viewpoints than heuristic-based policies.

📄 PDF Abstract BibTeX arXiv:2503.03726

Code (0)

등록된 구현이 없습니다.

Tasks

6D Pose EstimationObjectPose EstimationTemplate Matching

Similar Papers 제목 키워드 기반

Multi-View Neural Surface Reconstruction with Structured Light

2022-11-22 · Chunyu Li, Taisuke Hashimoto, Eiichi Matsumoto, Hiroharu Kato

Three-dimensional (3D) object reconstruction based on differentiable rendering (DR) is an active research topic in computer vision. DR-based methods minimize the difference between the rendered and target images by optim…

3D Object ReconstructionObject ReconstructionSurface Reconstruction

DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects

2025-10-13 · Jiahong Chen, Jinghao Wang, Zi Wang, Ziwen Wang 외 arxiv

6D pose estimation of textureless objects is valuable for industrial robotic applications, yet remains challenging due to the frequent loss of depth information. Current multi-view methods either rely on depth data or in…

6D Pose Estimation

Shape-biased Texture Agnostic Representations for Improved Textureless and Metallic Object Detection and 6D Pose Estimation

2024-02-07 · Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel, Matthias Hirschmanner 외

Recent advances in machine learning have greatly benefited object detection and 6D pose estimation. However, textureless and metallic objects still pose a significant challenge due to few visual cues and the texture bias…

6D Pose EstimationObjectobject-detectionObject Detection+3

Coherence As Texture - Passive Textureless 3D Reconstruction by Self-interference

2024-01-01 · CVPR 2024 1 · Wei-Yu Chen, Aswin C. Sankaranarayanan, Anat Levin, Matthew O'Toole

Passive depth estimation based on stereo or defocus relies on the presence of the texture on an object to resolve its depth. Hence recovering the depth of a textureless object-- for example a large white wall--is not…

3D ReconstructionDepth Estimation

Neural Active Structure-from-Motion in Dark and Textureless Environment

2024-10-20 · Kazuto Ichimaru, Diego Thomas, Takafumi Iwaguchi, Hiroshi Kawasaki

Active 3D measurement, especially structured light (SL) has been widely used in various fields for its robustness against textureless or equivalent surfaces by low light illumination. In addition, reconstruction of large…

Pose Estimation