paper-with-me

Papers

Demonstrating the Continual Learning Capabilities and Practical Application of Discrete-Time Active Inference

2024-09-30 · Rithvik Prakki

Active inference is a mathematical framework for understanding how agents (biological or artificial) interact with their environments, enabling continual adaptation and decision-making. It combines Bayesian inference and free energy minimization to model perception, action, and learning in uncertain and dynamic contexts. Unlike reinforcement learning, active inference integrates exploration and exploitation seamlessly by minimizing expected free energy. In this paper, we present a continual learning framework for agents operating in discrete time environments, using active inference as the foundation. We derive the mathematical formulations of variational and expected free energy and apply them to the design of a self-learning research agent. This agent updates its beliefs and adapts its actions based on new data without manual intervention. Through experiments in changing environments, we demonstrate the agent's ability to relearn and refine its models efficiently, making it suitable for complex domains like finance and healthcare. The paper concludes by discussing how the proposed framework generalizes to other systems, positioning active inference as a flexible approach for adaptive AI.

📄 PDF Abstract BibTeX arXiv:2410.00240

Code (1)

RPD123-byte/Demonstrating-the-Continual-Learning-Capabilities-and-Practical-Application-of-Discrete-Time-Active 공식 구현

Tasks

Bayesian InferenceContinual LearningDecision MakingSelf-Learning

Methods 이 논문이 사용한 방법론

Self-Learning 설명 없음

Similar Papers 제목 키워드 기반

Learn it or Leave it: Module Composition and Pruning for Continual Learning

2024-06-26 · Mingyang Wang, Heike Adel, Lukas Lange, Jannik Strötgen 외

In real-world environments, continual learning is essential for machine learning models, as they need to acquire new knowledge incrementally without forgetting what they have already learned. While pretrained language mo…

Continual LearningTransfer Learning

Memory-Free Continual Learning with Null Space Adaptation for Zero-Shot Vision-Language Models

2025-10-24 · Yujin Jo, Taesup Kim arxiv

Pre-trained vision-language models (VLMs), such as CLIP, have demonstrated remarkable zero-shot generalization, enabling deployment in a wide range of real-world tasks without additional task-specific training. However, …

Zero-shot GeneralizationContinual Learning

Continual Learning on the Edge with TensorFlow Lite

2021-05-05 · Giorgos Demosthenous, Vassilis Vassiliades

Deploying sophisticated deep learning models on embedded devices with the purpose of solving real-world problems is a struggle using today's technology. Privacy and data limitations, network connection issues, and the ne…

Continual LearningTransfer Learning

Empirical Analysis of the AdaBoost's Error Bound

2023-02-02 · Arman Bolatov, Kaisar Dauletbek

Understanding the accuracy limits of machine learning algorithms is essential for data scientists to properly measure performance so they can continually improve their models' predictive capabilities. This study empirica…

Branch-Tuning: Balancing Stability and Plasticity for Continual Self-Supervised Learning

2024-03-27 · Wenzhuo LIU, Fei Zhu, Cheng-Lin Liu

Self-supervised learning (SSL) has emerged as an effective paradigm for deriving general representations from vast amounts of unlabeled data. However, as real-world applications continually integrate new content, the hig…

Continual LearningContinual Self-Supervised LearningSelf-Supervised Learning