paper-with-me

Papers

Naive Algorithmic Collusion: When Do Bandit Learners Cooperate and When Do They Compete?

2024-11-25 · Connor Douglas, Foster Provost, Arun Sundararajan

Algorithmic agents are used in a variety of competitive decision settings, notably in making pricing decisions in contexts that range from online retail to residential home rentals. Business managers, algorithm designers, legal scholars, and regulators alike are all starting to consider the ramifications of "algorithmic collusion." We study the emergent behavior of multi-armed bandit machine learning algorithms used in situations where agents are competing, but they have no information about the strategic interaction they are engaged in. Using a general-form repeated Prisoner's Dilemma game, agents engage in online learning with no prior model of game structure and no knowledge of competitors' states or actions (e.g., no observation of competing prices). We show that these context-free bandits, with no knowledge of opponents' choices or outcomes, still will consistently learn collusive behavior - what we call "naive collusion." We primarily study this system through an analytical model and examine perturbations to the model through simulations. Our findings have several notable implications for regulators. First, calls to limit algorithms from conditioning on competitors' prices are insufficient to prevent algorithmic collusion. This is a direct result of collusion arising even in the naive setting. Second, symmetry in algorithms can increase collusion potential. This highlights a new, simple mechanism for "hub-and-spoke" algorithmic collusion. A central distributor need not imbue its algorithm with supra-competitive tendencies for apparent collusion to arise; it can simply arise by using certain (common) machine learning algorithms. Finally, we highlight that collusive outcomes depend starkly on the specific algorithm being used, and we highlight market and algorithmic conditions under which it will be unknown a priori whether collusion occurs.

📄 PDF Abstract BibTeX arXiv:2411.16574

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

No Algorithmic Collusion in Two-Player Blindfolded Game with Thompson Sampling

2024-05-23 · Ningyuan Chen, Xuefeng Gao, Yi Xiong

When two players are engaged in a repeated game with unknown payoff matrices, they may be completely unaware of the existence of each other and use multi-armed bandit algorithms to choose the actions, which is referred t…

Thompson Sampling

Algorithmic Collusion in Auctions: Evidence from Controlled Laboratory Experiments

2023-06-15 · Pranjal Rawat

Algorithms are increasingly being used to automate participation in online markets. Banchio and Skrzypacz (2022) demonstrate how exploration under identical valuation in first-price auctions may lead to spontaneous coupl…

Q-Learning

Algorithmic Collusion in Cournot Duopoly Market: Evidence from Experimental Economics

2018-02-21 · Nan Zhou, Li Zhang, Shijian Li, Zhijian Wang

Algorithmic collusion is an emerging concept in current artificial intelligence age. Whether algorithmic collusion is a creditable threat remains as an argument. In this paper, we propose an algorithm which can extort it…

Learning to Charge More: A Theoretical Study of Collusion by Q-Learning Agents

2025-05-28 · Cristian Chica, Yinglong Guo, Gilad Lerman

There is growing experimental evidence that $Q$-learning agents may learn to charge supracompetitive prices. We provide the first theoretical explanation for this behavior in infinite repeated games. Firms update their p…

Q-Learning

Breaking Algorithmic Collusion in Human-AI Ecosystems

2025-11-26 · Natalie Collina, Eshwar Ram Arunachaleswaran, Meena Jagadeesan arxiv

AI agents are increasingly deployed in ecosystems where they repeatedly interact not only with each other but also with humans. In this work, we study these human-AI ecosystems from a theoretical perspective, focusing on…