Understanding algorithmic collusion with experience replay
In an infinitely repeated pricing game, pricing algorithms based on artificial intelligence (Q-learning) may consistently learn to charge supra-competitive prices even without communication. Although concerns on algorithmic collusion have arisen, little is known on underlying factors. In this work, we experimentally analyze the dynamics of algorithms with three variants of experience replay. Algorithmic collusion still has roots in human preferences. Randomizing experience yields prices close to the static Bertrand equilibrium and higher prices are easily restored by favoring the latest experience. Moreover, relative performance concerns also stabilize the collusion. Finally, we investigate the scenarios with heterogeneous agents and test robustness on various factors.
Code (1)
Tasks
Q-LearningSimilar Papers 제목 키워드 기반
Collusive Outcomes Without Collusion
We develop a model of algorithmic pricing that shuts down every channel for explicit or implicit collusion while still generating collusive outcomes. We analyze the dynamics of a duopoly market where both firms use prici…
Algorithmic Collusion in Cournot Duopoly Market: Evidence from Experimental Economics
Algorithmic collusion is an emerging concept in current artificial intelligence age. Whether algorithmic collusion is a creditable threat remains as an argument. In this paper, we propose an algorithm which can extort it…
Naive Algorithmic Collusion: When Do Bandit Learners Cooperate and When Do They Compete?
Algorithmic agents are used in a variety of competitive decision settings, notably in making pricing decisions in contexts that range from online retail to residential home rentals. Business managers, algorithm designers…
Artificial Intelligence and Algorithmic Price Collusion in Two-sided Markets
Algorithmic price collusion facilitated by artificial intelligence (AI) algorithms raises significant concerns. We examine how AI agents using Q-learning engage in tacit collusion in two-sided markets. Our experiments re…
Q-LearningThe New Age of Collusion? An Empirical Study into Airbnb's Pricing Dynamics and Market Behavior
This study investigates the implications of algorithmic pricing in digital marketplaces, focusing on Airbnb's pricing dynamics. With the advent of Airbnb's new pricing tool, this research explores how digital tools influ…