paper-with-me

홈 › Papers

Interventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment

2017-12-21 · Chelsea Barabas, Karthik Dinakar, Joichi Ito, Madars Virza, Jonathan Zittrain

Actuarial risk assessments might be unduly perceived as a neutral way to counteract implicit bias and increase the fairness of decisions made at almost every juncture of the criminal justice system, from pretrial release to sentencing, parole and probation. In recent times these assessments have come under increased scrutiny, as critics claim that the statistical techniques underlying them might reproduce existing patterns of discrimination and historical biases that are reflected in the data. Much of this debate is centered around competing notions of fairness and predictive accuracy, resting on the contested use of variables that act as "proxies" for characteristics legally protected against discrimination, such as race and gender. We argue that a core ethical debate surrounding the use of regression in risk assessments is not simply one of bias or accuracy. Rather, it's one of purpose. If machine learning is operationalized merely in the service of predicting individual future crime, then it becomes difficult to break cycles of criminalization that are driven by the iatrogenic effects of the criminal justice system itself. We posit that machine learning should not be used for prediction, but rather to surface covariates that are fed into a causal model for understanding the social, structural and psychological drivers of crime. We propose an alternative application of machine learning and causal inference away from predicting risk scores to risk mitigation.

📄 PDF Abstract BibTeX arXiv:1712.08238

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningCausal InferenceFairness

Similar Papers 제목 키워드 기반

How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?

2022-10-27 · Hritik Bansal, Da Yin, Masoud Monajatipoor, Kai-Wei Chang

Text-to-image generative models have achieved unprecedented success in generating high-quality images based on natural language descriptions. However, it is shown that these models tend to favor specific social groups wh…

Cultural Vocal Bursts Intensity PredictionDiversityImage GenerationText to Image Generation+1

Reasons, Values, Stakeholders: A Philosophical Framework for Explainable Artificial Intelligence

2021-03-01 · Atoosa Kasirzadeh

The societal and ethical implications of the use of opaque artificial intelligence systems for consequential decisions, such as welfare allocation and criminal justice, have generated a lively debate among multiple stake…

Explainable artificial intelligence

Shifting the Human-AI Relationship: Toward a Dynamic Relational Learning-Partner Model

2024-10-07 · Julia Mossbridge

As artificial intelligence (AI) continues to evolve, the current paradigm of treating AI as a passive tool no longer suffices. As a human-AI team, we together advocate for a shift toward viewing AI as a learning partner,…

Relational Reasoning

Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions?

2021-06-02 · Findings (ACL) 2021 8 · Jieyu Zhao, Daniel Khashabi, Tushar Khot, Ashish Sabharwal 외

Is it possible to use natural language to intervene in a model's behavior and alter its prediction in a desired way? We investigate the effectiveness of natural language interventions for reading-comprehension systems, s…

EthicsFew-Shot LearningQuestion AnsweringReading Comprehension

Unequal Uncertainty: Rethinking Algorithmic Interventions for Mitigating Discrimination from AI

2025-08-11 · Holli Sargeant, Mackenzie Jorgensen, Arina Shah, Sam Goring 외 arxiv

Uncertainty in artificial intelligence (AI) predictions raises pressing legal and ethical questions for AI-assisted decision-making. This article examines two uncertainty-based algorithmic interventions that act as guard…