paper-with-me

홈 › Papers

Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation

2021-08-05 · Yiming Li, Tao Kong, Ruihang Chu, Yifeng Li, Peng Wang, Lei LI

Grasping in cluttered scenes has always been a great challenge for robots, due to the requirement of the ability to well understand the scene and object information. Previous works usually assume that the geometry information of the objects is available, or utilize a step-wise, multi-stage strategy to predict the feasible 6-DoF grasp poses. In this work, we propose to formalize the 6-DoF grasp pose estimation as a simultaneous multi-task learning problem. In a unified framework, we jointly predict the feasible 6-DoF grasp poses, instance semantic segmentation, and collision information. The whole framework is jointly optimized and end-to-end differentiable. Our model is evaluated on large-scale benchmarks as well as the real robot system. On the public dataset, our method outperforms prior state-of-the-art methods by a large margin (+4.08 AP). We also demonstrate the implementation of our model on a real robotic platform and show that the robot can accurately grasp target objects in cluttered scenarios with a high success rate. Project link: https://openbyterobotics.github.io/sscl

📄 PDF Abstract BibTeX arXiv:2108.02425

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task LearningPose EstimationSemantic Segmentation

Similar Papers 제목 키워드 기반

A Vision-Based Collision Sensing Method for Stable Circular Object Grasping with A Soft Gripper System

2025-08-07 · Boyang Zhang, Jiahui Zuo, Zeyu Duan, Fumin Zhang arxiv

External collisions to robot actuators typically pose risks to grasping circular objects. This work presents a vision-based sensing module capable of detecting collisions to maintain stable grasping with a soft gripper s…

Real-time Simultaneous Multi-Object 3D Shape Reconstruction, 6DoF Pose Estimation and Dense Grasp Prediction

2023-05-16 · Shubham Agrawal, Nikhil Chavan-Dafle, Isaac Kasahara, Selim Engin 외

Robotic manipulation systems operating in complex environments rely on perception systems that provide information about the geometry (pose and 3D shape) of the objects in the scene along with other semantic information …

3D Shape ReconstructionObjectPose Estimation

ZeroGrasp: Zero-Shot Shape Reconstruction Enabled Robotic Grasping

2025-04-15 · CVPR 2025 1 · Shun Iwase, Zubair Irshad, Katherine Liu, Vitor Guizilini 외

Robotic grasping is a cornerstone capability of embodied systems. Many methods directly output grasps from partial information without modeling the geometry of the scene, leading to suboptimal motion and even collisions.…

3D ReconstructionPose PredictionRobotic Graspingvalid

Collision-Aware Target-Driven Object Grasping in Constrained Environments

2021-04-01 · Xibai Lou, Yang Yang, Changhyun Choi

Grasping a novel target object in constrained environments (e.g., walls, bins, and shelves) requires intensive reasoning about grasp pose reachability to avoid collisions with the surrounding structures. Typical 6-DoF ro…

ObjectRobotic Grasping

Multi-fingered Robotic Hand Grasping in Cluttered Environments through Hand-object Contact Semantic Mapping

2024-04-12 · Lei Zhang, Kaixin Bai, Guowen Huang, Zhenshan Bing 외

The deep learning models has significantly advanced dexterous manipulation techniques for multi-fingered hand grasping. However, the contact information-guided grasping in cluttered environments remains largely underexpl…

Dataset GenerationDiversityGrasp Generation