Learning to Catch Piglets in Flight
Catching objects in-flight is an outstanding challenge in robotics. In this paper, we present a closed-loop control system fusing data from two sensor modalities: an RGB-D camera and a radar. To develop and test our method, we start with an easy to identify object: a stuffed Piglet. We implement and compare two approaches to detect and track the object, and to predict the interception point. A baseline model uses colour filtering for locating the thrown object in the environment, while the interception point is predicted using a least squares regression over the physical ballistic trajectory equations. A deep learning based method uses artificial neural networks for both object detection and interception point prediction. We show that we are able to successfully catch Piglet in 80% of the cases with our deep learning approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningObjectobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Modular Neural Network Policies for Learning In-Flight Object Catching with a Robot Hand-Arm System
We present a modular framework designed to enable a robot hand-arm system to learn how to catch flying objects, a task that requires fast, reactive, and accurately-timed robot motions. Our framework consists of five core…
Deep Reinforcement LearningObjectTrajectory PredictionOIPP: Object-Adaptive Impact Point Predictor for Catching Diverse In-Flight Objects
In this study, we address the problem of in-flight object catching using a quadruped robot with a basket. Our objective is to accurately predict the impact point, defined as the object's landing position. This task poses…
The neonatal sepsis is diminished by cervical vagus nerve stimulation and tracked non-invasively by ECG: a preliminary report in the piglet model
An electrocardiogram (ECG)-derived heart rate variability (HRV) index reliably tracks the inflammatory response induced by low-dose lipopolysaccharide (LPS) in near-term sheep fetuses. We evaluated the effect of vagus ne…
Heart Rate VariabilityAgile Interception of a Flying Target using Competitive Reinforcement Learning
This article presents a solution to intercept an agile drone by another agile drone carrying a catching net. We formulate the interception as a Competitive Reinforcement Learning problem, where the interceptor and the ta…
Reinforcement LearningDelivery strategies to improve piglets exposure to oral antibiotics
The widespread practice of delivering antibiotics through drinking water to livestock leads to considerable variability in exposure levels among animals, raising concerns regarding disease outbreaks and the emergence of …