paper-with-me

Papers

Runaway Feedback Loops in Predictive Policing

2017-06-29 · Danielle Ensign, Sorelle A. Friedler, Scott Neville, Carlos Scheidegger, Suresh Venkatasubramanian

Predictive policing systems are increasingly used to determine how to allocate police across a city in order to best prevent crime. Discovered crime data (e.g., arrest counts) are used to help update the model, and the process is repeated. Such systems have been empirically shown to be susceptible to runaway feedback loops, where police are repeatedly sent back to the same neighborhoods regardless of the true crime rate. In response, we develop a mathematical model of predictive policing that proves why this feedback loop occurs, show empirically that this model exhibits such problems, and demonstrate how to change the inputs to a predictive policing system (in a black-box manner) so the runaway feedback loop does not occur, allowing the true crime rate to be learned. Our results are quantitative: we can establish a link (in our model) between the degree to which runaway feedback causes problems and the disparity in crime rates between areas. Moreover, we can also demonstrate the way in which \emph{reported} incidents of crime (those reported by residents) and \emph{discovered} incidents of crime (i.e. those directly observed by police officers dispatched as a result of the predictive policing algorithm) interact: in brief, while reported incidents can attenuate the degree of runaway feedback, they cannot entirely remove it without the interventions we suggest.

📄 PDF Abstract BibTeX arXiv:1706.09847

Code (1)

algofairness/runaway-feedback-loops-src 공식 구현

Similar Papers 제목 키워드 기반

A Comparative Simulation Study of the Fairness and Accuracy of Predictive Policing Systems in Baltimore City

2026-01-30 · Samin Semsar, Kiran Laxmikant Prabhu, Gabriella Waters, James Foulds arxiv

There are ongoing discussions about predictive policing systems, such as those deployed in Los Angeles, California and Baltimore, Maryland, being unfair, for example, by exhibiting racial bias. Studies found that unfairn…

The effect of differential victim crime reporting on predictive policing systems

2021-01-30 · Nil-Jana Akpinar, Maria De-Arteaga, Alexandra Chouldechova

Police departments around the world have been experimenting with forms of place-based data-driven proactive policing for over two decades. Modern incarnations of such systems are commonly known as hot spot predictive pol…

Fairness

A Classification of Feedback Loops and Their Relation to Biases in Automated Decision-Making Systems

2023-05-10 · Nicolò Pagan, Joachim Baumann, Ezzat Elokda, Giulia De Pasquale 외

Prediction-based decision-making systems are becoming increasingly prevalent in various domains. Previous studies have demonstrated that such systems are vulnerable to runaway feedback loops, e.g., when police are repeat…

Decision MakingFairnessRecommendation SystemsRelation

FASE : A Fairness-Aware Spatiotemporal Event Graph Framework for Predictive Policing

2026-04-19 · Pronob Kumar Barman, Pronoy Kumar Barman, Plaban Kumar Barman, Rohan Mandar Salvi arxiv

Predictive policing systems that allocate patrol resources based solely on predicted crime risk can unintentionally amplify racial disparities through feedback driven data bias. We present FASE, a Fairness Aware Spatiote…

Graph Neural Network

The Stability of Online Algorithms in Performative Prediction

2026-02-27 · Gabriele Farina, Juan Carlos Perdomo arxiv

The use of algorithmic predictions in decision-making leads to a feedback loop where the models we deploy actively influence the data distributions we see, and later use to retrain on. This dynamic was formalized by Perd…