Cross-Domain Policy Adaptation via Value-Guided Data Filtering

2023-05-28 · NeurIPS 2023 11

Generalizing policies across different domains with dynamics mismatch poses a significant challenge in reinforcement learning. For example, a robot learns the policy in a simulator, but when it is deployed in the real world, the dynamics of the environment may be different. Given the source and target domain with dynamics mismatch, we consider the online dynamics adaptation problem, in which case the agent can access sufficient source domain data while online interactions with the target domain are limited. Existing research has attempted to solve the problem from the dynamics discrepancy perspective. In this work, we reveal the limitations of these methods and explore the problem from the value difference perspective via a novel insight on the value consistency across domains. Specifically, we present the Value-Guided Data Filtering (VGDF) algorithm, which selectively shares transitions from the source domain based on the proximity of paired value targets across the two domains. Empirical results on various environments with kinematic and morphology shifts demonstrate that our method achieves superior performance compared to prior approaches.

📄 PDF Abstract BibTeX arXiv:2305.17625

Code (1)

kavka1/vgdf pytorch

DADiff: Diffusion-Driven Cross-Domain Policy Adaptation for Reinforcement Learning

2026-07-17 · Hanyang Chen, Anirudh Satheesh, Longchao Da, Hua Wei arxiv

Transferring policies across domains poses a vital challenge in reinforcement learning, due to the dynamics mismatch between the source and target domains. In this paper, we consider the setting of online dynamics adapta…

Representation Learning Reinforcement Learning Domain Adaptation

LangTime: A Language-Guided Unified Model for Time Series Forecasting with Proximal Policy Optimization

2025-03-11 · Wenzhe Niu, Zongxia Xie, Yanru Sun, wei he 외

Recent research has shown an increasing interest in utilizing pre-trained large language models (LLMs) for a variety of time series applications. However, there are three main challenges when using LLMs as foundational m…

Domain Adaptation Domain Generalization reinforcement-learning Reinforcement Learning+2

OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis

2026-07-27 · Zihan Li, Feiyang Liu, Dandan Shan, Ruibo Wang 외 hf

Biomedical image analysis spans diverse modalities and tasks, yet real-world deployment is hindered by severe distribution shifts across scanners, protocols, and patient populations. High-performing models consequently r…

Test-time Adaptation

HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systems

2026-06-01 · Mingju Chen, Can Lv, Guibin Zhang, Heng Chang 외 arxiv

LLM agents are increasingly expected to operate across heterogeneous task regimes that require distinct execution paradigms. This challenges fixed agent systems and motivates system-level meta-adaptation beyond isolated …

Cross-Domain Energy-Guided Diffusion Generation for Off-Dynamics Reinforcement Learning

2026-05-24 · Yu Yang, Yihong Guo, Anqi Liu, Pan Xu arxiv

Off-dynamics offline reinforcement learning seeks to learn a target-domain policy from a large source dataset and a limited target dataset under mismatched transition dynamics. Existing approaches such as reward augmenta…

Reinforcement Learning Offline RL