A Single Multi-Task Deep Neural Network with Post-Processing for Object Detection with Reasoning and Robotic Grasp Detection

2019-09-16 · Dongwon Park, Yonghyeok Seo, Dongju Shin, Jaesik Choi, Se Young Chun

Recently, robotic grasp detection (GD) and object detection (OD) with reasoning have been investigated using deep neural networks (DNNs). There have been works to combine these multi-tasks using separate networks so that robots can deal with situations of grasping specific target objects in the cluttered, stacked, complex piles of novel objects from a single RGB-D camera. We propose a single multi-task DNN that yields the information on GD, OD and relationship reasoning among objects with a simple post-processing. Our proposed methods yielded state-of-the-art performance with the accuracy of 98.6% and 74.2% and the computation speed of 33 and 62 frame per second on VMRD and Cornell datasets, respectively. Our methods also yielded 95.3% grasp success rate for single novel object grasping with a 4-axis robot arm and 86.7% grasp success rate in cluttered novel objects with a Baxter robot.

📄 PDF Abstract BibTeX arXiv:1909.07050

Code (0)

등록된 구현이 없습니다.

Tasks

object-detection Object Detection

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Real-Time Seamless Single Shot 6D Object Pose Prediction

2017-11-24 · CVPR 2018 6 · Bugra Tekin, Sudipta N. Sinha, Pascal Fua

We propose a single-shot approach for simultaneously detecting an object in an RGB image and predicting its 6D pose without requiring multiple stages or having to examine multiple hypotheses. Unlike a recently proposed s…

6D Pose Estimation using RGB Drone Pose Estimation GPU Object+3

Seq-NMS for Video Object Detection

2016-02-26 · Wei Han, Pooya Khorrami, Tom Le Paine, Prajit Ramachandran 외

Video object detection is challenging because objects that are easily detected in one frame may be difficult to detect in another frame within the same clip. Recently, there have been major advances for doing object dete…

General Classification Object object-detection Object Detection+3

Reinforced Coloring for End-to-End Instance Segmentation

2020-05-14 · Tuan Tran Anh, Khoa Nguyen-Tuan, Tran Minh Quan, Won-Ki Jeong

Instance segmentation is one of the actively studied research topics in computer vision in which many objects of interest should be separated individually. While many feed-forward networks produce high-quality segmentati…

Deep Reinforcement Learning Instance Segmentation Object Segmentation+1

Temporal compressive edge imaging enabled by a lensless diffuser camera

2023-09-13 · Ze Zheng, Baolei Liu, Jiaqi Song, Lei Ding 외

Lensless imagers based on diffusers or encoding masks enable high-dimensional imaging from a single shot measurement and have been applied in various applications. However, to further extract image information such as ed…

Edge Detection

ColorRL: Reinforced Coloring for End-to-End Instance Segmentation

2021-06-19 · CVPR 2021 1 · Tran Anh Tuan, Nguyen Tuan Khoa, Tran Minh Quan, Won-Ki Jeong

Instance segmentation, the task of identifying and separating each individual object of interest in the image, is one of the actively studied research topics in computer vision. Although many feed-forward networks pr…

Deep Reinforcement Learning Instance Segmentation Segmentation Semantic Segmentation