paper-with-me

홈 › Papers

To Analyze and Regulate Human-in-the-loop Learning for Congestion Games

2025-01-06 · Hongbo Li, Lingjie Duan

In congestion games, selfish users behave myopically to crowd to the shortest paths, and the social planner designs mechanisms to regulate such selfish routing through information or payment incentives. However, such mechanism design requires the knowledge of time-varying traffic conditions and it is the users themselves to learn and report past road experiences to the social planner (e.g., Waze or Google Maps). When congestion games meet mobile crowdsourcing, it is critical to incentivize selfish users to explore non-shortest paths in the best exploitation-exploration trade-off. First, we consider a simple but fundamental parallel routing network with one deterministic path and multiple stochastic paths for users with an average arrival probability $\lambda$. We prove that the current myopic routing policy (widely used in Waze and Google Maps) misses both exploration (when strong hazard belief) and exploitation (when weak hazard belief) as compared to the social optimum. Due to the myopic policy's under-exploration, we prove that the caused price of anarchy (PoA) is larger than \(\frac{1}{1-\rho^{\frac{1}{\lambda}}}\), which can be arbitrarily large as discount factor \(\rho\rightarrow1\). To mitigate such huge efficiency loss, we propose a novel selective information disclosure (SID) mechanism: we only reveal the latest traffic information to users when they intend to over-explore stochastic paths upon arrival, while hiding such information when they want to under-explore. We prove that our mechanism successfully reduces PoA to be less than~\(2\). Besides the parallel routing network, we further extend our mechanism and PoA results to any linear path graphs with multiple intermediate nodes.

📄 PDF Abstract BibTeX arXiv:2501.03055

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning in Congestion Games with Bandit Feedback

2022-06-04 · Qiwen Cui, Zhihan Xiong, Maryam Fazel, Simon S. Du

In this paper, we investigate Nash-regret minimization in congestion games, a class of games with benign theoretical structure and broad real-world applications. We first propose a centralized algorithm based on the opti…

How Bad is Selfish Driving? Bounding the Inefficiency of Equilibria in Urban Driving Games

2022-10-24 · Alessandro Zanardi, Pier Giuseppe Sessa, Nando Käslin, Saverio Bolognani 외

We consider the interaction among agents engaging in a driving task and we model it as general-sum game. This class of games exhibits a plurality of different equilibria posing the issue of equilibrium selection. While s…

Multi-agent Reinforcement Learning

Human-in-the-loop Learning for Dynamic Congestion Games

2024-04-24 · Hongbo Li, Lingjie Duan

Today mobile users learn and share their traffic observations via crowdsourcing platforms (e.g., Waze). Yet such platforms simply cater to selfish users' myopic interests to recommend the shortest path, and do not encour…

Multiplicative Weights Update with Constant Step-Size in Congestion Games: Convergence, Limit Cycles and Chaos

2017-12-01 · NeurIPS 2017 12 · Gerasimos Palaiopanos, Ioannis Panageas, Georgios Piliouras

The Multiplicative Weights Update (MWU) method is a ubiquitous meta-algorithm that works as follows: A distribution is maintained on a certain set, and at each step the probability assigned to action $\gamma$ is multipli…

Towards Co-operative Congestion Mitigation

2023-02-17 · Aamir Hasan, Neeloy Chakraborty, Cathy Wu, Katherine Driggs-Campbell

The effects of traffic congestion are widespread and are an impedance to everyday life. Piecewise constant driving policies have shown promise in helping mitigate traffic congestion in simulation environments. However, n…