paper-with-me

홈 › Papers

Curiosity is Knowledge: Self-Consistent Learning and No-Regret Optimization with Active Inference

2026-02-05 · Yingke Li, Anjali Parashar, Enlu Zhou, Chuchu Fan arxiv

Active inference (AIF) unifies exploration and exploitation by minimizing the Expected Free Energy (EFE), balancing epistemic value (information gain) and pragmatic value (task performance) through a curiosity coefficient. Yet it has been unclear when this balance yields both coherent learning and efficient decision-making: insufficient curiosity can drive myopic exploitation and prevent uncertainty resolution, while excessive curiosity can induce unnecessary exploration and regret. We establish the first theoretical guarantee for EFE-minimizing agents, showing that a single requirement--sufficient curiosity--simultaneously ensures self-consistent learning (Bayesian posterior consistency) and no-regret optimization (bounded cumulative regret). Our analysis characterizes how this mechanism depends on initial uncertainty, identifiability, and objective alignment, thereby connecting AIF to classical Bayesian experimental design and Bayesian optimization within one theoretical framework. We further translate these theories into practical design guidelines for tuning the epistemic-pragmatic trade-off in hybrid learning-optimization problems, validated through real-world experiments.

📄 PDF Abstract BibTeX arXiv:2602.06029

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Pragmatic Curiosity: A Unified Framework for Hybrid Learning and Optimization via Active Inference

2026-02-05 · Yingke Li, Anjali Parashar, Enlu Zhou, Chuchu Fan arxiv

Many engineering and scientific workflows rely on expensive black-box evaluations, requiring sequential decisions that must both improve task performance and reduce uncertainty. Bayesian optimization (BO) and Bayesian ex…

Semantic Curiosity for Active Visual Learning

2020-06-16 · ECCV 2020 8 · Devendra Singh Chaplot, Helen Jiang, Saurabh Gupta, Abhinav Gupta

In this paper, we study the task of embodied interactive learning for object detection. Given a set of environments (and some labeling budget), our goal is to learn an object detector by having an agent select what data …

Objectobject-detectionObject Detection

The growth and form of knowledge networks by kinesthetic curiosity

2020-06-04 · Dale Zhou, David M. Lydon-Staley, Perry Zurn, Danielle S. Bassett

Throughout life, we might seek a calling, companions, skills, entertainment, truth, self-knowledge, beauty, and edification. The practice of curiosity can be viewed as an extended and open-ended search for valuable infor…

FormModel-based Reinforcement LearningPhilosophy

Hierarchical Optimistic Region Selection driven by Curiosity

2012-12-01 · NeurIPS 2012 12 · Odalric-Ambrym Maillard

This paper aims to take a step forwards making the term ``intrinsic motivation'' from reinforcement learning theoretically well founded, focusing on curiosity-driven learning. To that end, we consider the setting where, …

Active LearningMulti-Armed BanditsReinforcement Learning

From Psychological Curiosity to Artificial Curiosity: Curiosity-Driven Learning in Artificial Intelligence Tasks

2022-01-20 · Chenyu Sun, Hangwei Qian, Chunyan Miao

Psychological curiosity plays a significant role in human intelligence to enhance learning through exploration and information acquisition. In the Artificial Intelligence (AI) community, artificial curiosity provides a n…