paper-with-me

홈 › Papers

Amortized Safe Active Learning for Real-Time Data Acquisition: Pretrained Neural Policies from Simulated Nonparametric Functions

2025-01-26 · Cen-You Li, Marc Toussaint, Barbara Rakitsch, Christoph Zimmer

Safe active learning (AL) is a sequential scheme for learning unknown systems while respecting safety constraints during data acquisition. Existing methods often rely on Gaussian processes (GPs) to model the task and safety constraints, requiring repeated GP updates and constrained acquisition optimization-incurring in significant computations which are challenging for real-time decision-making. We propose an amortized safe AL framework that replaces expensive online computations with a pretrained neural policy. Inspired by recent advances in amortized Bayesian experimental design, we turn GPs into a pretraining simulator. We train our policy prior to the AL deployment on simulated nonparametric functions, using Fourier feature-based GP sampling and a differentiable, safety-aware acquisition objective. At deployment, our policy selects safe and informative queries via a single forward pass, eliminating the need for GP inference or constrained optimization. This leads to substantial speed improvements while preserving safety and learning quality. Our framework is modular and can be adapted to unconstrained, time-sensitive AL tasks by omitting the safety requirement.

📄 PDF Abstract BibTeX arXiv:2501.15458

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningDecision MakingExperimental DesignGaussian Processes

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Amortized Active Causal Induction with Deep Reinforcement Learning

2024-05-26 · Yashas Annadani, Panagiotis Tigas, Stefan Bauer, Adam Foster

We present Causal Amortized Active Structure Learning (CAASL), an active intervention design policy that can select interventions that are adaptive, real-time and that does not require access to the likelihood. This poli…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningZero-shot Generalization

Amortized Active Learning for Nonparametric Functions

2024-07-25 · Cen-You Li, Marc Toussaint, Barbara Rakitsch, Christoph Zimmer

Active learning (AL) is a sequential learning scheme aiming to select the most informative data. AL reduces data consumption and avoids the cost of labeling large amounts of data. However, AL trains the model and solves …

Active Learning

Iterative Amortized Hierarchical VAE

2026-01-22 · Simon W. Penninga, Ruud J. G. van Sloun arxiv

In this paper we propose the Iterative Amortized Hierarchical Variational Autoencoder (IA-HVAE), which expands on amortized inference with a hybrid scheme containing an initial amortized guess and iterative refinement wi…

ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition

2025-06-08 · Daolang Huang, Xinyi Wen, Ayush Bharti, Samuel Kaski 외

Many critical applications, from autonomous scientific discovery to personalized medicine, demand systems that can both strategically acquire the most informative data and instantaneously perform inference based upon it.…

Active LearningBayesian InferenceExperimental Designscientific discovery

Robust Amortized Bayesian Inference with Self-Consistency Losses on Unlabeled Data

2025-01-23 · Aayush Mishra, Daniel Habermann, Marvin Schmitt, Stefan T. Radev 외

Amortized Bayesian inference (ABI) with neural networks can solve probabilistic inverse problems orders of magnitude faster than classical methods. However, ABI is not yet sufficiently robust for widespread and safe appl…

Bayesian Inference