Robust 6D Object Pose Estimation in Cluttered Scenes using Semantic Segmentation and Pose Regression Networks
Object pose estimation is a crucial prerequisite for robots to perform autonomous manipulation in clutter. Real-world bin-picking settings such as warehouses present additional challenges, e.g., new objects are added constantly. Most of the existing object pose estimation methods assume that 3D models of the objects is available beforehand. We present a pipeline that requires minimal human intervention and circumvents the reliance on the availability of 3D models by a fast data acquisition method and a synthetic data generation procedure. This work builds on previous work on semantic segmentation of cluttered bin-picking scenes to isolate individual objects in clutter. An additional network is trained on synthetic scenes to estimate object poses from a cropped object-centered encoding extracted from the segmentation results. The proposed method is evaluated on a synthetic validation dataset and cluttered real-world scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
6D Pose Estimation using RGBObjectPose EstimationregressionSegmentationSemantic SegmentationSynthetic Data GenerationSimilar Papers 제목 키워드 기반
Counting the uncountable: deep semantic density estimation from Space
We propose a new method to count objects of specific categories that are significantly smaller than the ground sampling distance of a satellite image. This task is hard due to the cluttered nature of scenes where differe…
Density EstimationObjectObject Countingobject-detection+2Object detection and Autoencoder-based 6D pose estimation for highly cluttered Bin Picking
Bin picking is a core problem in industrial environments and robotics, with its main module as 6D pose estimation. However, industrial depth sensors have a lack of accuracy when it comes to small objects. Therefore, we p…
6D Pose Estimationobject-detectionObject DetectionPose Estimation+1Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation
Grasping in cluttered scenes has always been a great challenge for robots, due to the requirement of the ability to well understand the scene and object information. Previous works usually assume that the geometry inform…
Multi-Task LearningPose EstimationSemantic SegmentationSimulation-Ready Cluttered Scene Estimation via Physics-aware Joint Shape and Pose Optimization
Estimating simulation-ready scenes from real-world observations is crucial for downstream planning and policy learning tasks. Regretfully, existing methods struggle in cluttered environments, often exhibiting prohibitive…
SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimation
Zero-shot 6D object pose estimation involves the detection of novel objects with their 6D poses in cluttered scenes, presenting significant challenges for model generalizability. Fortunately, the recent Segment Anything …
6D Pose Estimation using RGBInstance SegmentationObjectPose Estimation+3