Legacy Procurement Practices Shape How U.S. Cities Govern AI: Understanding Government Employees' Practices, Challenges, and Needs
Most AI tools adopted by governments are not developed internally, but instead are acquired from third-party vendors in a process called public procurement. In this paper, we conduct the first empirical study of how United States cities' procurement practices shape critical decisions surrounding public sector AI. We conduct semi-structured interviews with 19 city employees who oversee AI procurement across 7 U.S. cities. We found that cities' legacy procurement practices, which are shaped by decades-old laws and norms, establish infrastructure that determines which AI is purchased, and which actors hold decision-making power over procured AI. We characterize the emerging actions cities have taken to adapt their purchasing practices to address algorithmic harms. From employees' reflections on real-world AI procurements, we identify three key challenges that motivate but are not fully addressed by existing AI procurement reform initiatives. Based on these findings, we discuss implications and opportunities for the FAccT community to support cities in foreseeing and preventing AI harms throughout the public procurement processes.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingSimilar Papers 제목 키워드 기반
A machine learning model to identify corruption in México's public procurement contracts
The costs and impacts of government corruption range from impairing a country's economic growth to affecting its citizens' well-being and safety. Public contracting between government dependencies and private sector inst…
Decision MakingChallenges and Best Practices in Corporate AI Governance:Lessons from the Biopharmaceutical Industry
While the use of artificial intelligence (AI) systems promises to bring significant economic and social benefits, it is also coupled with ethical, legal, and technical challenges. Business leaders thus face the question …
EthicsManagementAn AI-Driven Data Mesh Architecture Enhancing Decision-Making in Infrastructure Construction and Public Procurement
Infrastructure construction, often dubbed an "industry of industries," is closely linked with government spending and public procurement, offering significant opportunities for improved efficiency and productivity throug…
Decision MakingImproving Transparency in IDIQ Contracts: A Comparison of Common Procurement Issues Affecting Economies Across the Atlantic and Suggested Solutions
Expansions in the size and scope of public procurement across the Atlantic have increased calls for accountability of democratic governments. Indefinite Delivery, Indefinite Quantity contracts by their very nature are le…
Managing Procurement Auction Failure: Bid Requirements or Reserve Prices
This paper examines bid requirements, where the government may cancel a procurement contract unless two or more bids are received. Using a first-price auction model with endogenous entry, we compare the bid requirement a…