Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack Overflow
Large language models like ChatGPT efficiently provide users with information about various topics, presenting a potential substitute for searching the web and asking people for help online. But since users interact privately with the model, these models may drastically reduce the amount of publicly available human-generated data and knowledge resources. This substitution can present a significant problem in securing training data for future models. In this work, we investigate how the release of ChatGPT changed human-generated open data on the web by analyzing the activity on Stack Overflow, the leading online Q\&A platform for computer programming. We find that relative to its Russian and Chinese counterparts, where access to ChatGPT is limited, and to similar forums for mathematics, where ChatGPT is less capable, activity on Stack Overflow significantly decreased. A difference-in-differences model estimates a 16\% decrease in weekly posts on Stack Overflow. This effect increases in magnitude over time, and is larger for posts related to the most widely used programming languages. Posts made after ChatGPT get similar voting scores than before, suggesting that ChatGPT is not merely displacing duplicate or low-quality content. These results suggest that more users are adopting large language models to answer questions and they are better substitutes for Stack Overflow for languages for which they have more training data. Using models like ChatGPT may be more efficient for solving certain programming problems, but its widespread adoption and the resulting shift away from public exchange on the web will limit the open data people and models can learn from in the future.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Valuing Diffuse Global Public Goods from Satellite Constellations: Evidence from GPS and Airline Delays
This paper studies the welfare impact of discrete improvements to global public goods in the context of the Global Positioning System (GPS). Specifically, I find that by disabling Selective Availability in May, 2000, and…
Estimating Digital Product Trade through Corporate Revenue Data
Despite global efforts to harmonize international trade statistics, our understanding of digital trade and its implications remains limited. Here, we introduce a method to estimate bilateral exports and imports for dozen…
Public policy for management of forest pests within an ownership mosaic
Urban forests provide ecosystem services that are public goods with local (shade) to global (carbon sequestration) benefits and occur on both public and private lands. Thus, incentives for private tree owners to invest i…
ManagementPromoting Cooperation in the Public Goods Game using Artificial Intelligent Agents
The tragedy of the commons illustrates a fundamental social dilemma where individual rational actions lead to collectively undesired outcomes, threatening the sustainability of shared resources. Strategies to escape this…
Social Catalysts, Not Moral Agents: The Illusion of Alignment in LLM Societies
The rapid evolution of Large Language Models (LLMs) has led to the emergence of Multi-Agent Systems where collective cooperation is often threatened by the "Tragedy of the Commons." This study investigates the effectiven…