Efficient Adaptive Data Acquisition via Pretrained Belief Representations
Learning effective policies for adaptive data acquisition remains challenging: posterior-based methods rely on surrogate models and posterior approximations that can be misspecified or biased, while direct policy-learning methods map from historical observations and fail to exploit available model representations, making learning harder. We introduce policy learning with belief representations (POLAR), based on the insight that optimal data acquisition depends on the observation history only through a sufficient belief state. Specifically, POLAR decouples representation learning from policy learning by leveraging pretrained predictive foundation models as belief-state encoders, training a policy head on top of their representations. This yields a simple, unified amortised policy learning framework for Bayesian experimental design, Bayesian optimisation, and active learning, differing only in the task-specific utility used to train the policy. Empirically, we find that POLAR outperforms state-of-the-art amortised methods across diverse tasks while requiring far fewer training samples, demonstrating a significant step in the scalability and efficiency of amortised data acquisition.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningActive LearningSimilar Papers 제목 키워드 기반
LMEnt: A Suite for Analyzing Knowledge in Language Models from Pretraining Data to Representations
Language models (LMs) increasingly drive real-world applications that require world knowledge. However, the internal processes through which models turn data into representations of knowledge and beliefs about the world,…
Pretrained Model Representations as Acquisition Signals for Active Learning of MLIPs
Training machine learning interatomic potentials (MLIPs) for reactive chemistry is often bottlenecked by the high cost of quantum chemical labels and the scarcity of transition state configurations in candidate pools. Ac…
Active LearningFine Tuning Method by using Knowledge Acquisition from Deep Belief Network
We developed an adaptive structure learning method of Restricted Boltzmann Machine (RBM) which can generate/annihilate neurons by self-organizing learning method according to input patterns. Moreover, the adaptive Deep B…
ClassificationGeneral ClassificationSelf-selection of Information and Belief Update: An Experiment on COVID-19 Vaccine Information Acquisition
Rational information acquisition theory predicts that people select the more informative information. Thus, people's beliefs will be more persuaded by the information they select. We test the prediction in a critical rea…
Knowledge acquisition for dialogue agents using reinforcement learning on graph representations
We develop an artificial agent motivated to augment its knowledge base beyond its initial training. The agent actively participates in dialogues with other agents, strategically acquiring new information. The agent model…