paper-with-me

Papers

Learning Invariant Reward Functions through Trajectory Interventions

2021-09-29 · Ivan Ovinnikov, Eugene Bykovets, Joachim M. Buhmann

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity of such demonstrations potentially leads to the absorption of spurious correlations in the data by the learning model, which as a result, exhibits behavioural overfitting to the expert dataset when trained on the obtained reward function. We study the generalization properties of the maximum entropy method for solving the inverse reinforcement learning problem for both exact and approximate formulations and demonstrate that by applying an instantiation of the invariant risk minimization principle, we can recover reward functions which induce better performing policies across domains in the transfer setting.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Pairwise Proximal Policy Optimization: Harnessing Relative Feedback for LLM Alignment

2023-09-30 · Tianhao Wu, Banghua Zhu, Ruoyu Zhang, Zhaojin Wen 외

Large Language Models (LLMs) can acquire extensive world knowledge through pre-training on large corpora. However, due to exposure to low-quality data, LLMs may exhibit harmful behavior without aligning with human values…

reinforcement-learningReinforcement LearningWorld Knowledge

Invariant Reasoning Directions in Latent Trajectories of Language Models

2026-06-28 · Arun Vignesh Malarkkan, Manan Roy Choudhury, Utkarsh Byahut, Yash Ravindra Charde 외 arxiv

Latent reasoning models perform multi-step inference directly in hidden-state space, yet the structure of these latent reasoning trajectories remains poorly understood. We show that contrastive refinement signals between…

TIER: Trajectory-Invariant Execution Rewards for Multi-Step Tool Composition

2026-05-16 · Anay Kulkarni, ChiaEn Lu, Dheeraj Mekala, Jayanth Srinivasa 외 arxiv

Tool use enables large language models to solve complex tasks through sequences of API calls, yet existing reinforcement learning approaches fail to scale to multi-step composition settings. Outcome-based rewards provide…

Reinforcement Learning

Learning Time-Invariant Reward Functions through Model-Based Inverse Reinforcement Learning

2021-07-07 · Todor Davchev, Sarah Bechtle, Subramanian Ramamoorthy, Franziska Meier

Inverse reinforcement learning is a paradigm motivated by the goal of learning general reward functions from demonstrated behaviours. Yet the notion of generality for learnt costs is often evaluated in terms of robustnes…

reinforcement-learningReinforcement Learning (RL)

Accelerating the Evolution of Personalized Automated Lane Change through Lesson Learning

2024-05-13 · Jia Hu, Mingyue Lei, Haoran Wang, Zeyu Liu 외

Personalization is crucial for the widespread adoption of advanced driver assistance system. To match up with each user's preference, the online evolution capability is a must. However, conventional evolution methods lea…

Computational EfficiencyModel Predictive ControlTrajectory Planning