A Benchmarking Study of Vision-based Robotic Grasping Algorithms
We present a benchmarking study of vision-based robotic grasping algorithms with distinct approaches, and provide a comparative analysis. In particular, we compare two machine-learning-based and two analytical algorithms using an existing benchmarking protocol from the literature and determine the algorithm's strengths and weaknesses under different experimental conditions. These conditions include variations in lighting, background textures, cameras with different noise levels, and grippers. We also run analogous experiments in simulations and with real robots and present the discrepancies. Some experiments are also run in two different laboratories using same protocols to further analyze the repeatability of our results. We believe that this study, comprising 5040 experiments, provides important insights into the role and challenges of systematic experimentation in robotic manipulation, and guides the development of new algorithms by considering the factors that could impact the performance. The experiment recordings and our benchmarking software are publicly available.
Code (1)
Tasks
BenchmarkingRobotic GraspingSimilar Papers 제목 키워드 기반
BRAVE-6D: Benchmark for Robotic Active Vision in 6DOF Pose Estimation
Detecting and grasping small objects remains a significant challenge in robotics. Active vision, where the robot moves closer to the object, is an intuitive solution, yet comparing approaches on common ground is difficul…
Pose EstimationDeep Reinforcement Learning for Vision-Based Robotic Grasping: A Simulated Comparative Evaluation of Off-Policy Methods
In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but th…
Deep Reinforcement LearningDiversityQ-Learningreinforcement-learning+3REPLAB: A Reproducible Low-Cost Arm Benchmark Platform for Robotic Learning
Standardized evaluation measures have aided in the progress of machine learning approaches in disciplines such as computer vision and machine translation. In this paper, we make the case that robotic learning would also …
BenchmarkingDeep Reinforcement LearningMachine TranslationReinforcement Learning+1SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenes
We present a new reproducible benchmark for evaluating robot manipulation in the real world, specifically focusing on pick-and-place. Our benchmark uses the YCB objects, a commonly used dataset in the robotics community,…
BenchmarkingMotion PlanningRobotic GraspingRobot ManipulationJENGA: Object selection and pose estimation for robotic grasping from a stack
Vision-based robotic object grasping is typically investigated in the context of isolated objects or unstructured object sets in bin picking scenarios. However, there are several settings, such as construction or warehou…
BenchmarkingObjectPose EstimationRobotic Grasping