Algorithms for Fairness in Sequential Decision Making
It has recently been shown that if feedback effects of decisions are ignored, then imposing fairness constraints such as demographic parity or equality of opportunity can actually exacerbate unfairness. We propose to address this challenge by modeling feedback effects as Markov decision processes (MDPs). First, we propose analogs of fairness properties for the MDP setting. Second, we propose algorithms for learning fair decision-making policies for MDPs. Finally, we demonstrate the need to account for dynamical effects using simulations on a loan applicant MDP.
Code (1)
Tasks
Decision MakingFairnessReinforcement LearningSequential Decision MakingSimilar Papers 제목 키워드 기반
Fairness in Learning-Based Sequential Decision Algorithms: A Survey
Algorithmic fairness in decision-making has been studied extensively in static settings where one-shot decisions are made on tasks such as classification. However, in practice most decision-making processes are of a sequ…
Decision MakingFairnessSequential Decision MakingSurveyRemembering to Be Fair: Non-Markovian Fairness in Sequential Decision Making
Fair decision making has largely been studied with respect to a single decision. Here we investigate the notion of fairness in the context of sequential decision making where multiple stakeholders can be affected by the …
Decision MakingFairnessSequential Decision MakingReinforcement Learning with Stepwise Fairness Constraints
AI methods are used in societally important settings, ranging from credit to employment to housing, and it is crucial to provide fairness in regard to algorithmic decision making. Moreover, many settings are dynamic, wit…
Decision MakingFairnessreinforcement-learningReinforcement Learning+1Fairness and Sequential Decision Making: Limits, Lessons, and Opportunities
As automated decision making and decision assistance systems become common in everyday life, research on the prevention or mitigation of potential harms that arise from decisions made by these systems has proliferated. H…
Decision MakingFairnessSequential Decision MakingAdapting Static Fairness to Sequential Decision-Making: Bias Mitigation Strategies towards Equal Long-term Benefit Rate
Decisions made by machine learning models can have lasting impacts, making long-term fairness a critical consideration. It has been observed that ignoring the long-term effect and directly applying fairness criterion in …
Decision MakingFairnessSequential Decision Making