Self-Supervised Learning for Transparent Object Depth Completion Using Depth from Non-Transparent Objects
The perception of transparent objects is one of the well-known challenges in computer vision. Conventional depth sensors have difficulty in sensing the depth of transparent objects due to refraction and reflection of light. Previous research has typically train a neural network to complete the depth acquired by the sensor, and this method can quickly and accurately acquire accurate depth maps of transparent objects. However, previous training relies on a large amount of annotation data for supervision, and the labeling of depth maps is costly. To tackle this challenge, we propose a new self-supervised method for training depth completion networks. Our method simulates the depth deficits of transparent objects within non-transparent regions and utilizes the original depth map as ground truth for supervision. Experiments demonstrate that our method achieves performance comparable to supervised approach, and pre-training with our method can improve the model performance when the training samples are small.
Code (0)
등록된 구현이 없습니다.
Tasks
Self-Supervised LearningDepth CompletionSimilar Papers 제목 키워드 기반
SelfDeco: Self-Supervised Monocular Depth Completion in Challenging Indoor Environments
We present a novel algorithm for self-supervised monocular depth completion. Our approach is based on training a neural network that requires only sparse depth measurements and corresponding monocular video sequences wit…
Depth CompletionTransparent Object Depth Completion
The perception of transparent objects for grasp and manipulation remains a major challenge, because existing robotic grasp methods which heavily rely on depth maps are not suitable for transparent objects due to their un…
Depth CompletionDepth EstimationObjectTransparent objectsRGB-D Local Implicit Function for Depth Completion of Transparent Objects
Majority of the perception methods in robotics require depth information provided by RGB-D cameras. However, standard 3D sensors fail to capture depth of transparent objects due to refraction and absorption of light. In …
Depth CompletionDepth EstimationTransparent objectsTDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Network
The sensing and manipulation of transparent objects present a critical challenge in industrial and laboratory robotics. Conventional sensors face challenges in obtaining the full depth of transparent objects due to the r…
Depth CompletionTransparent objectsSeeing Glass: Joint Point Cloud and Depth Completion for Transparent Objects
The basis of many object manipulation algorithms is RGB-D input. Yet, commodity RGB-D sensors can only provide distorted depth maps for a wide range of transparent objects due light refraction and absorption. To tackle t…
Depth CompletionTransparent objects