paper-with-me

홈 › Papers

Learning to maximize global influence from local observations

2021-09-24 · Gábor Lugosi, Gergely Neu, Julia Olkhovskaya

We study a family online influence maximization problems where in a sequence of rounds $t=1,\ldots,T$, a decision maker selects one from a large number of agents with the goal of maximizing influence. Upon choosing an agent, the decision maker shares a piece of information with the agent, which information then spreads in an unobserved network over which the agents communicate. The goal of the decision maker is to select the sequence of agents in a way that the total number of influenced nodes in the network. In this work, we consider a scenario where the networks are generated independently for each $t$ according to some fixed but unknown distribution, so that the set of influenced nodes corresponds to the connected component of the random graph containing the vertex corresponding to the selected agent. Furthermore, we assume that the decision maker only has access to limited feedback: instead of making the unrealistic assumption that the entire network is observable, we suppose that the available feedback is generated based on a small neighborhood of the selected vertex. Our results show that such partial local observations can be sufficient for maximizing global influence. We model the underlying random graph as a sparse inhomogeneous Erd\H{o}s--R\'enyi graph, and study three specific families of random graph models in detail: stochastic block models, Chung--Lu models and Kronecker random graphs. We show that in these cases one may learn to maximize influence by merely observing the degree of the selected vertex in the generated random graph. We propose sequential learning algorithms that aim at maximizing influence, and provide their theoretical analysis in both the subcritical and supercritical regimes of all considered models.

📄 PDF Abstract BibTeX arXiv:2109.11909

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Online Influence Maximization with Local Observations

2018-05-28 · Julia Olkhovskaya, Gergely Neu, Gábor Lugosi

We consider an online influence maximization problem in which a decision maker selects a node among a large number of possibilities and places a piece of information at the node. The node transmits the information to som…

Adversarial Linear-Quadratic Mean-Field Games over Multigraphs

2021-09-29 · Muhammad Aneeq uz Zaman, Sujay Bhatt, Tamer Başar

In this paper, we propose a game between an exogenous adversary and a network of agents connected via a multigraph. The multigraph is composed of (1) a global graph structure, capturing the virtual interactions among the…

Settling Decentralized Multi-Agent Coordinated Exploration by Novelty Sharing

2024-02-03 · Haobin Jiang, Ziluo Ding, Zongqing Lu

Exploration in decentralized cooperative multi-agent reinforcement learning faces two challenges. One is that the novelty of global states is unavailable, while the novelty of local observations is biased. The other is h…

Multi-agent Reinforcement Learning

Hierarchical Consensus-Based Multi-Agent Reinforcement Learning for Multi-Robot Cooperation Tasks

2024-07-11 · Pu Feng, Junkang Liang, Size Wang, Xin Yu 외

In multi-agent reinforcement learning (MARL), the Centralized Training with Decentralized Execution (CTDE) framework is pivotal but struggles due to a gap: global state guidance in training versus reliance on local obser…

Contrastive LearningMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning

On Power Allocation for Distributed Detection with Correlated Observations and Linear Fusion

2017-10-26

We consider a binary hypothesis testing problem in an inhomogeneous wireless sensor network, where a fusion center (FC) makes a global decision on the underlying hypothesis. We assume sensors observations are correlated …