paper-with-me

홈 › Papers

Q-Learning-Driven Adaptive Rewiring for Cooperative Control in Heterogeneous Networks

2025-09-01 · Yi-Ning Weng, Hsuan-Wei Lee arxiv

Cooperation emergence in multi-agent systems represents a fundamental statistical physics problem where microscopic learning rules drive macroscopic collective behavior transitions. We propose a Q-learning-based variant of adaptive rewiring that builds on mechanisms studied in the literature. This method combines temporal difference learning with network restructuring so that agents can optimize strategies and social connections based on interaction histories. Through neighbor-specific Q-learning, agents develop sophisticated partnership management strategies that enable cooperator cluster formation, creating spatial separation between cooperative and defective regions. Using power-law networks that reflect real-world heterogeneous connectivity patterns, we evaluate emergent behaviors under varying rewiring constraint levels, revealing distinct cooperation patterns across parameter space rather than sharp thermodynamic transitions. Our systematic analysis identifies three behavioral regimes: a permissive regime (low constraints) enabling rapid cooperative cluster formation, an intermediate regime with sensitive dependence on dilemma strength, and a patient regime (high constraints) where strategic accumulation gradually optimizes network structure. Simulation results show that while moderate constraints create transition-like zones that suppress cooperation, fully adaptive rewiring enhances cooperation levels through systematic exploration of favorable network configurations. Quantitative analysis reveals that increased rewiring frequency drives large-scale cluster formation with power-law size distributions. Our results establish a new paradigm for understanding intelligence-driven cooperation pattern formation in complex adaptive systems, revealing how machine learning serves as an alternative driving force for spontaneous organization in multi-agent networks.

📄 PDF Abstract BibTeX arXiv:2509.01057

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Integrated cooperative localization of heterogeneous measurement swarm: A unified data-driven method

2026-03-05 · Kunrui Ze, Wei Wang, Guibin Sun, Jiaqi Yan 외 arxiv

The cooperative localization (CL) problem in heterogeneous robotic systems with different measurement capabilities is investigated in this work. In practice, heterogeneous sensors lead to directed and sparse measurement …

A Cooperative Compliance Control Framework for Socially Optimal Mixed Traffic Routing

2025-03-28 · Anni Li, Ting Bai, Yingqing Chen, Christos G. Cassandras 외

In mixed traffic environments, where Connected and Autonomed Vehicles (CAVs) coexist with potentially non-cooperative Human-Driven Vehicles (HDVs), the self-centered behavior of human drivers may compromise the efficienc…

Data-Driven Cooperative Adaptive Cruise Control for Unknown Nonlinear Vehicle Platoons

2023-07-21 · Jianglin Lan

This paper studies cooperative adaptive cruise control (CACC) for vehicle platoons with consideration of the unknown nonlinear vehicle dynamics that are normally ignored in the literature. A unified data-driven CACC desi…

Adaptive Control for Unknown Heterogeneous Vehicles Synchronization with Unstructured Uncertainty

2020-02-12

The cooperative control applied to vehicles allows the optimization of traffic on the roads. There are many aspects to consider in the case of the operation of autonomous vehicles on highways since there are different ex…

Autonomous Vehicles

HCOMC: A Hierarchical Cooperative On-Ramp Merging Control Framework in Mixed Traffic Environment on Two-Lane Highways

2025-07-15 · Tianyi Wang, Yangyang Wang, Jie Pan, Junfeng Jiao 외 arxiv

Highway on-ramp merging areas are common bottlenecks to traffic congestion and accidents. Currently, a cooperative control strategy based on connected and automated vehicles (CAVs) is a fundamental solution to this probl…