paper-with-me

홈 › Papers

A Partially Observable Deep Multi-Agent Active Inference Framework for Resource Allocation in 6G and Beyond Wireless Communications Networks

2023-08-22 · Fuhui Zhou, Rui Ding, Qihui Wu, Derrick Wing Kwan Ng, Kai-Kit Wong, Naofal Al-Dhahir

Resource allocation is of crucial importance in wireless communications. However, it is extremely challenging to design efficient resource allocation schemes for future wireless communication networks since the formulated resource allocation problems are generally non-convex and consist of various coupled variables. Moreover, the dynamic changes of practical wireless communication environment and user service requirements thirst for efficient real-time resource allocation. To tackle these issues, a novel partially observable deep multi-agent active inference (PODMAI) framework is proposed for realizing intelligent resource allocation. A belief based learning method is exploited for updating the policy by minimizing the variational free energy. A decentralized training with a decentralized execution multi-agent strategy is designed to overcome the limitations of the partially observable state information. Exploited the proposed framework, an intelligent spectrum allocation and trajectory optimization scheme is developed for a spectrum sharing unmanned aerial vehicle (UAV) network with dynamic transmission rate requirements as an example. Simulation results demonstrate that our proposed framework can significantly improve the sum transmission rate of the secondary network compared to various benchmark schemes. Moreover, the convergence speed of the proposed PODMAI is significantly improved compared with the conventional reinforcement learning framework. Overall, our proposed framework can enrich the intelligent resource allocation frameworks and pave the way for realizing real-time resource allocation.

📄 PDF Abstract BibTeX arXiv:2308.11402

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Learning Others' Intentional Models in Multi-Agent Settings Using Interactive POMDPs

2018-12-01 · NeurIPS 2018 12 · Yanlin Han, Piotr Gmytrasiewicz

Interactive partially observable Markov decision processes (I-POMDPs) provide a principled framework for planning and acting in a partially observable, stochastic and multi-agent environment. It extends POMDPs to multi-a…

Bayesian Inference

A Message Passing Realization of Expected Free Energy Minimization

2025-08-04 · Wouter W. L. Nuijten, Mykola Lukashchuk, Thijs van de Laar, Bert de Vries arxiv

We present a message passing approach to Expected Free Energy (EFE) minimization on factor graphs, based on the theory introduced in arXiv:2504.14898. By reformulating EFE minimization as Variational Free Energy minimiza…

Free Energy Projective Simulation (FEPS): Active inference with interpretability

2024-11-22 · Joséphine Pazem, Marius Krumm, Alexander Q. Vining, Lukas J. Fiderer 외

In the last decade, the free energy principle (FEP) and active inference (AIF) have achieved many successes connecting conceptual models of learning and cognition to mathematical models of perception and action. This eff…

Reinforcement Learning (RL)State Estimation

Online Active Perception for Partially Observable Markov Decision Processes with Limited Budget

2019-10-04 · Mahsa Ghasemi, Ufuk Topcu

Active perception strategies enable an agent to selectively gather information in a way to improve its performance. In applications in which the agent does not have prior knowledge about the available information sources…

Scene Informer: Anchor-based Occlusion Inference and Trajectory Prediction in Partially Observable Environments

2023-09-25 · Bernard Lange, Jiachen Li, Mykel J. Kochenderfer

Navigating complex and dynamic environments requires autonomous vehicles (AVs) to reason about both visible and occluded regions. This involves predicting the future motion of observed agents, inferring occluded ones, an…

Autonomous VehiclesPredictionTrajectory Prediction