paper-with-me

홈 › Papers

TDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Network

2024-12-19 · Xianghui Fan, Chao Ye, Anping Deng, Xiaotian Wu, Mengyang Pan, Hang Yang

The sensing and manipulation of transparent objects present a critical challenge in industrial and laboratory robotics. Conventional sensors face challenges in obtaining the full depth of transparent objects due to the refraction and reflection of light on their surfaces and their lack of visible texture. Previous research has attempted to obtain complete depth maps of transparent objects from RGB and damaged depth maps (collected by depth sensor) using deep learning models. However, existing methods fail to fully utilize the original depth map, resulting in limited accuracy for deep completion. To solve this problem, we propose TDCNet, a novel dual-branch CNN-Transformer parallel network for transparent object depth completion. The proposed framework consists of two different branches: one extracts features from partial depth maps, while the other processes RGB-D images. Experimental results demonstrate that our model achieves state-of-the-art performance across multiple public datasets. Our code and the pre-trained model are publicly available at https://github.com/XianghuiFan/TDCNet.

📄 PDF Abstract BibTeX arXiv:2412.14961

Code (1)

xianghuifan/tdcnet 공식 구현 pytorch

Tasks

Depth CompletionTransparent objects

Similar Papers 제목 키워드 기반

HDCNet: A Hybrid Depth Completion Network for Grasping Transparent and Reflective Objects

2025-11-10 · Guanghu Xie, Mingxu Li, Songwei Wu, Yang Liu 외 arxiv

Depth perception of transparent and reflective objects has long been a critical challenge in robotic manipulation.Conventional depth sensors often fail to provide reliable measurements on such surfaces, limiting the perf…

Depth CompletionRobotic Grasping

Transparent Object Depth Completion

2024-05-24 · Yifan Zhou, Wanli Peng, Zhongyu Yang, He Liu 외

The perception of transparent objects for grasp and manipulation remains a major challenge, because existing robotic grasp methods which heavily rely on depth maps are not suitable for transparent objects due to their un…

Depth CompletionDepth EstimationObjectTransparent objects

HTMNet: A Hybrid Network with Transformer-Mamba Bottleneck Multimodal Fusion for Transparent and Reflective Objects Depth Completion

2025-05-27 · Guanghu Xie, Yonglong Zhang, Zhiduo Jiang, Yang Liu 외

Transparent and reflective objects pose significant challenges for depth sensors, resulting in incomplete depth information that adversely affects downstream robotic perception and manipulation tasks. To address this iss…

DecoderDepth CompletionMambaState Space Models

Self-Supervised Learning for Transparent Object Depth Completion Using Depth from Non-Transparent Objects

2025-12-04 · Xianghui Fan, Zhaoyu Chen, Mengyang Pan, Anping Deng 외 arxiv

The perception of transparent objects is one of the well-known challenges in computer vision. Conventional depth sensors have difficulty in sensing the depth of transparent objects due to refraction and reflection of lig…

Self-Supervised LearningDepth Completion

Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objects

2021-09-30 · Haoping Xu, Yi Ru Wang, Sagi Eppel, Alàn Aspuru-Guzik 외

The basis of many object manipulation algorithms is RGB-D input. Yet, commodity RGB-D sensors can only provide distorted depth maps for a wide range of transparent objects due light refraction and absorption. To tackle t…

Depth CompletionTransparent objects