paper-with-me

Papers

Beyond Visual Grasping: Benchmarking Complex Grasping from Detection to Execution

2026-07-15 · Hanyi Zhang, Khang Nguyen, Charith Munasinghe, Basu Hela, Tianyu Li, Zihong Luo, Hoan Nguyen, Hans Wernher van de Venn, Yalin Zheng, Ravi Prakash, Tung D. Ta, Anh Nguyen, Baoru Huang arxiv

Robust robotic grasping remains a fundamental challenge for complex real-world applications. Recent advances in large-scale models demonstrate promising capabilities for reasoning in robotic tasks. However, existing benchmarks for grasping primarily focus on isolated, visual-based grasp pose detection, failing to capture the complexity of grasping tasks that require multi-step reasoning and semantic understanding during execution. To address this gap, we propose GCA-Bench, a benchmark featuring challenging \textit{grasping with complex action} scenarios that involve both scene-level reasoning and semantic constraints. GCA-Bench enables the evaluation of recent large foundation models under the same settings. To demonstrate the effectiveness of our new benchmark, we implement a diverse set of baselines, ranging from traditional grasp detection pipelines to end-to-end learning methods. Empirical studies achieve success rates below 70\% on complex grasping scenarios, underscoring critical limitations. In addition, we propose new evaluation metrics, analyze critical failure models, and provide insights to guide the development of more robust and generalizable grasping strategies.

📄 PDF Abstract BibTeX arXiv:2607.14341

Code (0)

등록된 구현이 없습니다.

Tasks

Robotic Grasping

Similar Papers 제목 키워드 기반

DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenes

2024-10-30 · Jialiang Zhang, Haoran Liu, Danshi Li, Xinqiang Yu 외

Grasping in cluttered scenes remains highly challenging for dexterous hands due to the scarcity of data. To address this problem, we present a large-scale synthetic benchmark, encompassing 1319 objects, 8270 scenes, and …

Benchmarking

Visual-tactile Fusion for Transparent Object Grasping in Complex Backgrounds

2022-11-30 · Shoujie Li, Haixin Yu, Wenbo Ding, Houde Liu 외

The accurate detection and grasping of transparent objects are challenging but of significance to robots. Here, a visual-tactile fusion framework for transparent object grasping under complex backgrounds and variant ligh…

ClassificationDataset GenerationPositionTransparent objects

Multi-Keypoint Affordance Representation for Functional Dexterous Grasping

2025-02-27 · Fan Yang, Dongsheng Luo, Wenrui Chen, Jiacheng Lin 외

Functional dexterous grasping requires precise hand-object interaction, going beyond simple gripping. Existing affordance-based methods primarily predict coarse interaction regions and cannot directly constrain the grasp…

TARGO: Benchmarking Target-driven Object Grasping under Occlusions

2024-07-08 · Yan Xia, Ran Ding, Ziyuan Qin, Guanqi Zhan 외

Recent advances in predicting 6D grasp poses from a single depth image have led to promising performance in robotic grasping. However, previous grasping models face challenges in cluttered environments where nearby objec…

BenchmarkingObjectRobotic Grasping

Acceleration of Actor-Critic Deep Reinforcement Learning for Visual Grasping in Clutter by State Representation Learning Based on Disentanglement of a Raw Input Image

2020-02-27 · Taewon Kim, Yeseong Park, Youngbin Park, Il Hong Suh

For a robotic grasping task in which diverse unseen target objects exist in a cluttered environment, some deep learning-based methods have achieved state-of-the-art results using visual input directly. In contrast, actor…

Deep Reinforcement LearningDisentanglementReinforcement LearningReinforcement Learning (RL)+2