Explaining by Imitating: Understanding Decisions by Interpretable Policy Learning
Understanding human behavior from observed data is critical for transparency and accountability in decision-making. Consider real-world settings such as healthcare, in which modeling a decision-maker's policy is challenging -- with no access to underlying states, no knowledge of environment dynamics, and no allowance for live experimentation. We desire learning a data-driven representation of decision-making behavior that (1) inheres transparency by design, (2) accommodates partial observability, and (3) operates completely offline. To satisfy these key criteria, we propose a novel model-based Bayesian method for interpretable policy learning ("Interpole") that jointly estimates an agent's (possibly biased) belief-update process together with their (possibly suboptimal) belief-action mapping. Through experiments on both simulated and real-world data for the problem of Alzheimer's disease diagnosis, we illustrate the potential of our approach as an investigative device for auditing, quantifying, and understanding human decision-making behavior.
Code (1)
Tasks
Decision MakingSimilar Papers 제목 키워드 기반
Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead
Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creati…
BIG-bench Machine LearningDecision MakingInterpretable Machine LearningImage-guided topic modeling for interpretable privacy classification
Predicting and explaining the private information contained in an image in human-understandable terms is a complex and contextual task. This task is challenging even for large language models. To facilitate the understan…
ClassificationLanguage ModelingLanguage ModellingAdvantage Actor-Critic with Reasoner: Explaining the Agent's Behavior from an Exploratory Perspective
Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-w…
Decision MakingReinforcement Learning (RL)Fidelity-Induced Interpretable Policy Extraction for Reinforcement Learning
Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making problems. However, existing DRL agents make decisions in an opaque fashion, hindering the user from establishing trust and s…
Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+3Evolutionary Selective Imitation: Interpretable Agents by Imitation Learning Without a Demonstrator
We propose a new method for training an agent via an evolutionary strategy (ES), in which we iteratively improve a set of samples to imitate: Starting with a random set, in every iteration we replace a subset of the samp…
Imitation LearningOpenAI GymPolicy Gradient Methods