paper-with-me

홈 › Papers

TransNet: Category-Level Transparent Object Pose Estimation

2022-08-22 · Huijie Zhang, Anthony Opipari, Xiaotong Chen, Jiyue Zhu, Zeren Yu, Odest Chadwicke Jenkins

Transparent objects present multiple distinct challenges to visual perception systems. First, their lack of distinguishing visual features makes transparent objects harder to detect and localize than opaque objects. Even humans find certain transparent surfaces with little specular reflection or refraction, e.g. glass doors, difficult to perceive. A second challenge is that common depth sensors typically used for opaque object perception cannot obtain accurate depth measurements on transparent objects due to their unique reflective properties. Stemming from these challenges, we observe that transparent object instances within the same category (e.g. cups) look more similar to each other than to ordinary opaque objects of that same category. Given this observation, the present paper sets out to explore the possibility of category-level transparent object pose estimation rather than instance-level pose estimation. We propose TransNet, a two-stage pipeline that learns to estimate category-level transparent object pose using localized depth completion and surface normal estimation. TransNet is evaluated in terms of pose estimation accuracy on a recent, large-scale transparent object dataset and compared to a state-of-the-art category-level pose estimation approach. Results from this comparison demonstrate that TransNet achieves improved pose estimation accuracy on transparent objects and key findings from the included ablation studies suggest future directions for performance improvements.

📄 PDF Abstract BibTeX arXiv:2208.10002

Code (0)

등록된 구현이 없습니다.

Tasks

Depth CompletionObjectPose EstimationSurface Normal EstimationTransparent objects

Similar Papers 제목 키워드 기반

TransNet: Transparent Object Manipulation Through Category-Level Pose Estimation

2023-07-23 · Huijie Zhang, Anthony Opipari, Xiaotong Chen, Jiyue Zhu 외

Transparent objects present multiple distinct challenges to visual perception systems. First, their lack of distinguishing visual features makes transparent objects harder to detect and localize than opaque objects. Even…

Depth CompletionObjectPose EstimationSurface Normal Estimation+1

StereoPose: Category-Level 6D Transparent Object Pose Estimation from Stereo Images via Back-View NOCS

2022-11-03 · Kai Chen, Stephen James, Congying Sui, Yun-hui Liu 외

Most existing methods for category-level pose estimation rely on object point clouds. However, when considering transparent objects, depth cameras are usually not able to capture meaningful data, resulting in point cloud…

ObjectPose EstimationTransparent objects

TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Network

2021-08-09 · Zhengyi Liu, YuAn Wang, Zhengzheng Tu, Yun Xiao 외

Salient object detection is the pixel-level dense prediction task which can highlight the prominent object in the scene. Recently U-Net framework is widely used, and continuous convolution and pooling operations generate…

DecoderObjectobject-detectionObject Detection+3

PhoCaL: A Multi-Modal Dataset for Category-Level Object Pose Estimation with Photometrically Challenging Objects

2022-05-18 · CVPR 2022 1 · Pengyuan Wang, HyunJun Jung, Yitong Li, Siyuan Shen 외

Object pose estimation is crucial for robotic applications and augmented reality. Beyond instance level 6D object pose estimation methods, estimating category-level pose and shape has become a promising trend. As such, a…

6D Pose Estimation using RGBObjectPose EstimationTransparent objects

GroupTransNet: Group Transformer Network for RGB-D Salient Object Detection

2022-03-21 · Xian Fang, Jinshao Zhu, Xiuli Shao, Hongpeng Wang

Salient object detection on RGB-D images is an active topic in computer vision. Although the existing methods have achieved appreciable performance, there are still some challenges. The locality of convolutional neural n…

object-detectionObject DetectionRGB-D Salient Object DetectionSalient Object Detection