Learning to Learn in Simulation
Deep learning often requires the manual collection and annotation of a training set. On robotic platforms, can we partially automate this task by training the robot to be curious, i.e., to seek out beneficial training information in the environment? In this work, we address the problem of curiosity as it relates to online, real-time, human-in-the-loop training of an object detection algorithm onboard a drone, where motion is constrained to two dimensions. We use a 3D simulation environment and deep reinforcement learning to train a curiosity agent to, in turn, train the object detection model. This agent could have one of two conflicting objectives: train as quickly as possible, or train with minimal human input. We outline a reward function that allows the curiosity agent to learn either of these objectives, while taking into account some of the physical characteristics of the drone platform on which it is meant to run. In addition, We show that we can weigh the importance of achieving these objectives by adjusting a parameter in the reward function.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement Learningobject-detectionObject DetectionReinforcement LearningSimilar Papers 제목 키워드 기반
Model Bridging: Connection between Simulation Model and Neural Network
The interpretability of machine learning, particularly for deep neural networks, is crucial for decision making in real-world applications. One approach is replacing the un-interpretable machine learning model with a sur…
BIG-bench Machine LearningDecision MakingInterpretable Machine LearningmodelInSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations
We propose InSituNet, a deep learning based surrogate model to support parameter space exploration for ensemble simulations that are visualized in situ. In situ visualization, generating visualizations at simulation time…
Image GenerationAn empirical learning-based validation procedure for simulation workflow
Simulation workflow is a top-level model for the design and control of simulation process. It connects multiple simulation components with time and interaction restrictions to form a complete simulation system. Before th…
Transfer learning for multifidelity simulation-based inference in cosmology
Simulation-based inference (SBI) enables cosmological parameter estimation when closed-form likelihoods or models are unavailable. However, SBI relies on machine learning for neural compression and density estimation. Th…
Density Estimationparameter estimationTransfer LearningField-level weak lensing cosmology with $<100$ simulations using multifidelity simulation-based inference
We perform a realistic KiDS-Legacy mock analysis with field-level neural compression and simulation-based inference using fewer than 100 $N$-body simulations. The weak lensing shear field encodes substantially more cosmo…