paper-with-me

홈 › Papers

Adaptive Active Inference Agents for Heterogeneous and Lifelong Federated Learning

2024-10-09 · Anastasiya Danilenka, Alireza Furutanpey, Victor Casamayor Pujol, Boris Sedlak, Anna Lackinger, Maria Ganzha, Marcin Paprzycki, Schahram Dustdar

Handling heterogeneity and unpredictability are two core problems in pervasive computing. The challenge is to seamlessly integrate devices with varying computational resources in a dynamic environment to form a cohesive system that can fulfill the needs of all participants. Existing work on adaptive systems typically focuses on optimizing individual variables or low-level Service Level Objectives (SLOs), such as constraining the usage of specific resources. While low-level control mechanisms permit fine-grained control over a system, they introduce considerable complexity, particularly in dynamic environments. To this end, we propose drawing from Active Inference (AIF), a neuroscientific framework for designing adaptive agents. Specifically, we introduce a conceptual agent for heterogeneous pervasive systems that permits setting global systems constraints as high-level SLOs. Instead of manually setting low-level SLOs, the system finds an equilibrium that can adapt to environmental changes. We demonstrate the viability of our AIF agents with an extensive experiment design, using heterogeneous and lifelong federated learning as an application scenario. We conduct our experiments on a physical testbed of devices with different resource types and vendor specifications. The results provide convincing evidence that an AIF agent can adapt a system to environmental changes. In particular, the AIF agent can balance competing SLOs in resource heterogeneous environments to ensure up to 98% fulfillment rate.

📄 PDF Abstract BibTeX arXiv:2410.09099

Code (1)

adanilenka/adaptive_aif_agents_for_fl 공식 구현 pytorch

Tasks

Federated Learning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners

2025-05-17 · Junhao Zheng, Xidi Cai, Qiuke Li, Duzhen Zhang 외

Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to accumulate or transfer knowledge over time…

Language ModelingLanguage ModellingLarge Language ModelLifelong learning

Learning While Acting: A Skill-Enhanced Test-Time Co-Evolution Framework for Online Lifelong Learning Agents

2026-06-03 · Bo Mao, Jie Zhou, Yutao Yang, Xin Li 외 arxiv

Lifelong learning is essential for Large Language Model (LLM) agents operating in dynamic, interactive environments. However, existing lifelong learning agents for long-horizon tasks typically depend on discrete skill or…

Reinforcement Learning

Towards Proactive Personalization through Profile Customization for Individual Users in Dialogues

2025-12-17 · Xiaotian Zhang, Yuan Wang, Ruizhe Chen, Zeya Wang 외 arxiv

The deployment of Large Language Models (LLMs) in interactive systems necessitates a deep alignment with the nuanced and dynamic preferences of individual users. Current alignment techniques predominantly address univers…

Fast Lifelong Adaptive Inverse Reinforcement Learning from Demonstrations

2022-09-24 · Letian Chen, Sravan Jayanthi, Rohan Paleja, Daniel Martin 외

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. However, current LfD frameworks are not capable of…

Continuous Controlreinforcement-learningReinforcement LearningReinforcement Learning (RL)

CHIRPs: Change-Induced Regret Proxy metrics for Lifelong Reinforcement Learning

2024-09-05 · John Birkbeck, Adam Sobey, Federico Cerutti, Katherine Heseltine Hurley Flynn 외

Reinforcement learning (RL) agents are costly to train and fragile to environmental changes. They often perform poorly when there are many changing tasks, prohibiting their widespread deployment in the real world. Many L…

Lifelong learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)