paper-with-me

홈 › Papers

Multi-Armed Bandit Learning for Content Provisioning in Network of UAVs

2023-12-18 · Amit Kumar Bhuyan, Hrishikesh Dutta, Subir Biswas

This paper proposes an unmanned aerial vehicle (UAV) aided content management system in communication-challenged disaster scenarios. Without cellular infrastructure in such scenarios, community of stranded users can be provided access to situation-critical contents using a hybrid network of static and traveling UAVs. A set of relatively static anchor UAVs can download content from central servers and provide content access to its local users. A set of ferrying UAVs with wider mobility can provision content to users by shuffling them across different anchor UAVs while visiting different communities of users. The objective is to design a content dissemination system that on-the-fly learns content caching policies for maximizing content availability to the stranded users. This paper proposes a decentralized Top-k Multi-Armed Bandit Learning model for UAV-caching decision-making that takes geo-temporal differences in content popularity and heterogeneity in content demands into consideration. The proposed paradigm is able to combine the expected reward maximization attribute and a proposed multi-dimensional reward structure of Top-k Multi-Armed Bandit, for caching decision at the UAVs. This study is done for different user-specified tolerable access delay, heterogeneous popularity distributions, and inter-community geographical characteristics. Functional verification and performance evaluation of the proposed caching framework is done for a wide range of network size, UAV distribution, and content popularity.

📄 PDF Abstract BibTeX arXiv:2312.14967

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeDecision Making

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Top-k Multi-Armed Bandit Learning for Content Dissemination in Swarms of Micro-UAVs

2024-04-16 · Amit Kumar Bhuyan, Hrishikesh Dutta, Subir Biswas

This paper presents a Micro-Unmanned Aerial Vehicle (UAV)-enhanced content management system for disaster scenarios where communication infrastructure is generally compromised. Utilizing a hybrid network of stationary an…

Towards Federated Multi-Armed Bandit Learning for Content Dissemination using Swarm of UAVs

2025-01-15 · Amit Kumar Bhuyan, Hrishikesh Dutta, Subir Biswas

This paper introduces an Unmanned Aerial Vehicle - enabled content management architecture that is suitable for critical content access in communities of users that are communication-isolated during diverse types of disa…

Context-Aware Bandits

2015-10-12 · Shuai Li, Purushottam Kar

We propose an efficient Context-Aware clustering of Bandits (CAB) algorithm, which can capture collaborative effects. CAB can be easily deployed in a real-world recommendation system, where multi-armed bandits have been …

ClusteringMulti-Armed Bandits

Mortal Multi-Armed Bandits

2008-12-01 · NeurIPS 2008 12 · Deepayan Chakrabarti, Ravi Kumar, Filip Radlinski, Eli Upfal

We formulate and study a new variant of the $k$-armed bandit problem, motivated by e-commerce applications. In our model, arms have (stochastic) lifetime after which they expire. In this setting an algorithm needs to con…

Multi-Armed Bandits

Local Clustering in Contextual Multi-Armed Bandits

2021-02-26 · Yikun Ban, Jingrui He

We study identifying user clusters in contextual multi-armed bandits (MAB). Contextual MAB is an effective tool for many real applications, such as content recommendation and online advertisement. In practice, user depen…

ClusteringMulti-Armed Bandits