Object Pose Estimation Using Implicit Representation For Transparent Objects
Object pose estimation is a prominent task in computer vision. The object pose gives the orientation and translation of the object in real-world space, which allows various applications such as manipulation, augmented reality, etc. Various objects exhibit different properties with light, such as reflections, absorption, etc. This makes it challenging to understand the object's structure in RGB and depth channels. Recent research has been moving toward learning-based methods, which provide a more flexible and generalizable approach to object pose estimation utilizing deep learning. One such approach is the render-and-compare method, which renders the object from multiple views and compares it against the given 2D image, which often requires an object representation in the form of a CAD model. We reason that the synthetic texture of the CAD model may not be ideal for rendering and comparing operations. We showed that if the object is represented as an implicit (neural) representation in the form of Neural Radiance Field (NeRF), it exhibits a more realistic rendering of the actual scene and retains the crucial spatial features, which makes the comparison more versatile. We evaluated our NeRF implementation of the render-and-compare method on transparent datasets and found that it surpassed the current state-of-the-art results.
Code (0)
등록된 구현이 없습니다.
Tasks
NeRFObjectPose EstimationTransparent objectsSimilar Papers 제목 키워드 기반
RGB-D Local Implicit Function for Depth Completion of Transparent Objects
Majority of the perception methods in robotics require depth information provided by RGB-D cameras. However, standard 3D sensors fail to capture depth of transparent objects due to refraction and absorption of light. In …
Depth CompletionDepth EstimationTransparent objectsRethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask
Due to the optical properties, transparent objects often lead depth cameras to generate incomplete or invalid depth data, which in turn reduces the accuracy and reliability of robotic grasping. Existing approaches typica…
Monocular Depth EstimationDepth CompletionRobotic GraspingDepth Restoration of Hand-Held Transparent Objects for Human-to-Robot Handover
Transparent objects are common in daily life, while their optical properties pose challenges for RGB-D cameras to capture accurate depth information. This issue is further amplified when these objects are hand-held, as h…
Depth EstimationTransparent objectsStereoPose: Category-Level 6D Transparent Object Pose Estimation from Stereo Images via Back-View NOCS
Most existing methods for category-level pose estimation rely on object point clouds. However, when considering transparent objects, depth cameras are usually not able to capture meaningful data, resulting in point cloud…
ObjectPose EstimationTransparent objectsReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning
Transparent objects are ubiquitous in daily life, making their perception and robotics manipulation important. However, they present a major challenge due to their distinct refractive and reflective properties when it co…
6D Pose EstimationImage MattingPose EstimationRepresentation Learning+1