Reward Learning with Trees: Methods and Evaluation
Recent efforts to learn reward functions from human feedback have tended to use deep neural networks, whose lack of transparency hampers our ability to explain agent behaviour or verify alignment. We explore the merits of learning intrinsically interpretable tree models instead. We develop a recently proposed method for learning reward trees from preference labels, and show it to be broadly competitive with neural networks on challenging high-dimensional tasks, with good robustness to limited or corrupted data. Having found that reward tree learning can be done effectively in complex settings, we then consider why it should be used, demonstrating that the interpretable reward structure gives significant scope for traceability, verification and explanation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CATPO: Critique-Augmented Tree Policy Optimization
Reinforcement learning with verifiable rewards (RLVR) has become a dominant paradigm for improving the reasoning capabilities of large language models (LLMs). Recent tree-based methods such as TreeRPO extend flat traject…
Reinforcement LearningA Reward-Petri-Net Interpretation of Temporal Behavior Trees
This paper introduces an interpretation of Temporal Behavior Trees (TBTs) as Reward-Petri-Nets (RPNs) for reinforcement learning (RL). Designing reward functions for complex, long-horizon robotic tasks is notoriously dif…
Reinforcement LearningLearning Interpretable Models of Aircraft Handling Behaviour by Reinforcement Learning from Human Feedback
We propose a method to capture the handling abilities of fast jet pilots in a software model via reinforcement learning (RL) from human preference feedback. We use pairwise preferences over simulated flight trajectories …
Reinforcement Learning (RL)Learning Intrinsic Symbolic Rewards in Reinforcement Learning
Learning effective policies for sparse objectives is a key challenge in Deep Reinforcement Learning (RL). A common approach is to design task-related dense rewards to improve task learnability. While such rewards are eas…
Deep Reinforcement LearningMuJoCoreinforcement-learningReinforcement Learning+1Toward Interpretable Deep Reinforcement Learning with Linear Model U-Trees
Deep Reinforcement Learning (DRL) has achieved impressive success in many applications. A key component of many DRL models is a neural network representing a Q function, to estimate the expected cumulative reward followi…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)