paper-with-me

홈 › Papers

TransPose: A Transformer-based 6D Object Pose Estimation Network with Depth Refinement

2023-07-09 · Mahmoud Abdulsalam, Nabil Aouf

As demand for robotics manipulation application increases, accurate vision-based 6D pose estimation becomes essential for autonomous operations. Convolutional Neural Networks (CNNs) based approaches for pose estimation have been previously introduced. However, the quest for better performance still persists especially for accurate robotics manipulation. This quest extends to the Agri-robotics domain. In this paper, we propose TransPose, an improved Transformer-based 6D pose estimation with a depth refinement module. The architecture takes in only an RGB image as input with no additional supplementing modalities such as depth or thermal images. The architecture encompasses an innovative lighter depth estimation network that estimates depth from an RGB image using feature pyramid with an up-sampling method. A transformer-based detection network with additional prediction heads is proposed to directly regress the object's centre and predict the 6D pose of the target. A novel depth refinement module is then used alongside the predicted centers, 6D poses and depth patches to refine the accuracy of the estimated 6D pose. We extensively compared our results with other state-of-the-art methods and analysed our results for fruit-picking applications. The results we achieved show that our proposed technique outperforms the other methods available in the literature.

📄 PDF Abstract BibTeX arXiv:2307.05561

Code (0)

등록된 구현이 없습니다.

Tasks

6D Pose Estimation6D Pose Estimation using RGBDepth EstimationPose Estimation

Similar Papers 제목 키워드 기반

TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer

2023-10-25 · Xiao Lin, Deming Wang, Guangliang Zhou, Chengju Liu 외

Estimating the 6D object pose is an essential task in many applications. Due to the lack of depth information, existing RGB-based methods are sensitive to occlusion and illumination changes. How to extract and utilize th…

6D Pose Estimation using RGBObjectPose Estimation

TransPoser: Transformer as an Optimizer for Joint Object Shape and Pose Estimation

2023-03-23 · Yuta Yoshitake, Mai Nishimura, Shohei Nobuhara, Ko Nishino

We propose a novel method for joint estimation of shape and pose of rigid objects from their sequentially observed RGB-D images. In sharp contrast to past approaches that rely on complex non-linear optimization, we propo…

Pose Estimation

TransPose: Keypoint Localization via Transformer

2020-12-28 · ICCV 2021 10 · Sen yang, Zhibin Quan, Mu Nie, Wankou Yang

While CNN-based models have made remarkable progress on human pose estimation, what spatial dependencies they capture to localize keypoints remains unclear. In this work, we propose a model called \textbf{TransPose}, whi…

Keypoint DetectionMulti-Person Pose EstimationPose Estimation

OCTraN: 3D Occupancy Convolutional Transformer Network in Unstructured Traffic Scenarios

2023-07-20 · Aditya Nalgunda Ganesh, Dhruval Pobbathi Badrinath, Harshith Mohan Kumar, Priya SS 외

Modern approaches for vision-centric environment perception for autonomous navigation make extensive use of self-supervised monocular depth estimation algorithms that output disparity maps. However, when this disparity m…

Autonomous NavigationDepth EstimationMonocular Depth Estimation

TRansPose: Large-Scale Multispectral Dataset for Transparent Object

2023-07-11 · Jeongyun Kim, Myung-Hwan Jeon, Sangwoo Jung, Wooseong Yang 외

Transparent objects are encountered frequently in our daily lives, yet recognizing them poses challenges for conventional vision sensors due to their unique material properties, not being well perceived from RGB or depth…

ObjectTransparent objects