Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking
3D object pose estimation for robotic grasping and manipulation is a crucial task in the manufacturing industry. In cluttered and occluded scenes, the 6D pose estimation of the low-textured or textureless industrial object is a challenging problem due to the lack of color information. Thus, point cloud that is hardly affected by the lighting conditions is gaining popularity as an alternative solution for pose estimation. This article proposes a deep learning-based pose estimation using point cloud as input, which consists of instance segmentation and instance point cloud pose estimation. The instance segmentation divides the scene point cloud into multiple instance point clouds, and each instance point cloud pose is accurately predicted by fusing the depth and normal feature maps. In order to reduce the time consumption of the dataset acquisition and annotation, a physically-simulated engine is constructed to generate the synthetic dataset. Finally, several experiments are conducted on the public, synthetic and real datasets to verify the effectiveness of the pose estimation network. The experimental results show that the point cloud based pose estimation network can effectively and robustly predict the poses of objects in cluttered and occluded scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose EstimationInstance SegmentationPose EstimationRobotic GraspingSemantic SegmentationSimilar Papers 제목 키워드 기반
Towards Robust Part-aware Instance Segmentation for Industrial Bin Picking
Industrial bin picking is a challenging task that requires accurate and robust segmentation of individual object instances. Particularly, industrial objects can have irregular shapes, that is, thin and concave, whereas i…
Instance SegmentationSegmentationSemantic SegmentationIMD: A 6-DoF Pose Estimation Benchmark for Industrial Metallic Objects
Object 6DoF (6D) pose estimation is essential for robotic perception, especially in industrial settings. It enables robots to interact with the environment and manipulate objects. However, existing benchmarks on object 6…
Video Object Segmentation6D Pose EstimationPose TrackingIndustryShapes: An RGB-D Benchmark dataset for 6D object pose estimation of industrial assembly components and tools
We introduce IndustryShapes, a new RGB-D benchmark dataset of industrial tools and components, designed for both instance-level and novel object 6D pose estimation approaches. The dataset provides a realistic and applica…
6D Pose EstimationObject DetectioniShape: A First Step Towards Irregular Shape Instance Segmentation
In this paper, we introduce a brand new dataset to promote the study of instance segmentation for objects with irregular shapes. Our key observation is that though irregularly shaped objects widely exist in daily life an…
Instance SegmentationSegmentationSemantic SegmentationInstance Segmentation of Industrial Point Cloud Data
The challenge that this paper addresses is how to efficiently minimize the cost and manual labour for automatically generating object oriented geometric Digital Twins (gDTs) of industrial facilities, so that the benefits…
Instance SegmentationSegmentationSemantic Segmentation