Reinforcement Learning for Picking Cluttered General Objects with Dense Object Descriptors
Picking cluttered general objects is a challenging task due to the complex geometries and various stacking configurations. Many prior works utilize pose estimation for picking, but pose estimation is difficult on cluttered objects. In this paper, we propose Cluttered Objects Descriptors (CODs), a dense cluttered objects descriptor that can represent rich object structures, and use the pre-trained CODs network along with its intermediate outputs to train a picking policy. Additionally, we train the policy with reinforcement learning, which enable the policy to learn picking without supervision. We conduct experiments to demonstrate that our CODs is able to consistently represent seen and unseen cluttered objects, which allowed for the picking policy to robustly pick cluttered general objects. The resulting policy can pick 96.69% of unseen objects in our experimental environment which is twice as cluttered as the training scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Pose Estimationreinforcement-learningSimilar Papers 제목 키워드 기반
Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learning
Skilled robotic manipulation benefits from complex synergies between non-prehensile (e.g. pushing) and prehensile (e.g. grasping) actions: pushing can help rearrange cluttered objects to make space for arms and fingers; …
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning+1Object detection and Autoencoder-based 6D pose estimation for highly cluttered Bin Picking
Bin picking is a core problem in industrial environments and robotics, with its main module as 6D pose estimation. However, industrial depth sensors have a lack of accuracy when it comes to small objects. Therefore, we p…
6D Pose Estimationobject-detectionObject DetectionPose Estimation+1A Hybrid Approach for Learning to Shift and Grasp with Elaborate Motion Primitives
Many possible fields of application of robots in real world settings hinge on the ability of robots to grasp objects. As a result, robot grasping has been an active field of research for many years. With our publication …
Data AugmentationRobust 6D Object Pose Estimation in Cluttered Scenes using Semantic Segmentation and Pose Regression Networks
Object pose estimation is a crucial prerequisite for robots to perform autonomous manipulation in clutter. Real-world bin-picking settings such as warehouses present additional challenges, e.g., new objects are added con…
6D Pose Estimation using RGBObjectPose Estimationregression+3Towards Reliable Sequential Object Picking in Clutter: The Runner-up Solution to RGMC 2025
As a long-standing challenge in robotic manipulation, stable and efficient grasping in cluttered environments is of great importance in industrial settings. While recent studies have achieved relatively high success rate…
Object RecognitionRobotic Grasping