paper-with-me

Papers

Object Pose Estimation Using Implicit Representation For Transparent Objects

2024-10-17 · Varun Burde, Artem Moroz, Vit Zeman, Pavel Burget

Object pose estimation is a prominent task in computer vision. The object pose gives the orientation and translation of the object in real-world space, which allows various applications such as manipulation, augmented reality, etc. Various objects exhibit different properties with light, such as reflections, absorption, etc. This makes it challenging to understand the object's structure in RGB and depth channels. Recent research has been moving toward learning-based methods, which provide a more flexible and generalizable approach to object pose estimation utilizing deep learning. One such approach is the render-and-compare method, which renders the object from multiple views and compares it against the given 2D image, which often requires an object representation in the form of a CAD model. We reason that the synthetic texture of the CAD model may not be ideal for rendering and comparing operations. We showed that if the object is represented as an implicit (neural) representation in the form of Neural Radiance Field (NeRF), it exhibits a more realistic rendering of the actual scene and retains the crucial spatial features, which makes the comparison more versatile. We evaluated our NeRF implementation of the render-and-compare method on transparent datasets and found that it surpassed the current state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:2410.13465

Code (0)

등록된 구현이 없습니다.

Tasks

NeRFObjectPose EstimationTransparent objects

Similar Papers 제목 키워드 기반

RGB-D Local Implicit Function for Depth Completion of Transparent Objects

2021-04-01 · CVPR 2021 1 · Luyang Zhu, Arsalan Mousavian, Yu Xiang, Hammad Mazhar 외

Majority of the perception methods in robotics require depth information provided by RGB-D cameras. However, standard 3D sensors fail to capture depth of transparent objects due to refraction and absorption of light. In …

Depth CompletionDepth EstimationTransparent objects

Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask

2025-08-04 · Yaofeng Cheng, Xinkai Gao, Sen Zhang, Chao Zeng 외 arxiv

Due to the optical properties, transparent objects often lead depth cameras to generate incomplete or invalid depth data, which in turn reduces the accuracy and reliability of robotic grasping. Existing approaches typica…

Monocular Depth EstimationDepth CompletionRobotic Grasping

Depth Restoration of Hand-Held Transparent Objects for Human-to-Robot Handover

2024-08-27 · Ran Yu, Haixin Yu, Shoujie Li, Huang Yan 외

Transparent objects are common in daily life, while their optical properties pose challenges for RGB-D cameras to capture accurate depth information. This issue is further amplified when these objects are hand-held, as h…

Depth EstimationTransparent objects

StereoPose: Category-Level 6D Transparent Object Pose Estimation from Stereo Images via Back-View NOCS

2022-11-03 · Kai Chen, Stephen James, Congying Sui, Yun-hui Liu 외

Most existing methods for category-level pose estimation rely on object point clouds. However, when considering transparent objects, depth cameras are usually not able to capture meaningful data, resulting in point cloud…

ObjectPose EstimationTransparent objects

ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning

2024-12-30 · Hrishikesh Gupta, Stefan Thalhammer, Jean-Baptiste Weibel, Alexander Haberl 외

Transparent objects are ubiquitous in daily life, making their perception and robotics manipulation important. However, they present a major challenge due to their distinct refractive and reflective properties when it co…

6D Pose EstimationImage MattingPose EstimationRepresentation Learning+1