Offline Multitask Representation Learning for Reinforcement Learning

2024-03-18 · Haque Ishfaq, Thanh Nguyen-Tang, Songtao Feng, Raman Arora, Mengdi Wang, Ming Yin, Doina Precup

We study offline multitask representation learning in reinforcement learning (RL), where a learner is provided with an offline dataset from different tasks that share a common representation and is asked to learn the shared representation. We theoretically investigate offline multitask low-rank RL, and propose a new algorithm called MORL for offline multitask representation learning. Furthermore, we examine downstream RL in reward-free, offline and online scenarios, where a new task is introduced to the agent that shares the same representation as the upstream offline tasks. Our theoretical results demonstrate the benefits of using the learned representation from the upstream offline task instead of directly learning the representation of the low-rank model.

📄 PDF Abstract BibTeX arXiv:2403.11574

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Representation Learning

Generalisation in Multitask Fitted Q-Iteration and Offline Q-learning

2025-12-23 · Kausthubh Manda, Raghuram Bharadwaj Diddigi arxiv

We study offline multitask reinforcement learning in settings where multiple tasks share a low-rank representation of their action-value functions. In this regime, a learner is provided with fixed datasets collected from…

Reinforcement Learning

Provable Benefit of Multitask Representation Learning in Reinforcement Learning

2022-06-13 · Yuan Cheng, Songtao Feng, Jing Yang, Hong Zhang 외

As representation learning becomes a powerful technique to reduce sample complexity in reinforcement learning (RL) in practice, theoretical understanding of its advantage is still limited. In this paper, we theoretically…

Offline RL reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Incremental Hierarchical Reinforcement Learning with Multitask LMDPs

2018-09-27 · Adam C Earle, Andrew M Saxe, Benjamin Rosman

Exploration is a well known challenge in Reinforcement Learning. One principled way of overcoming this challenge is to find a hierarchical abstraction of the base problem and explore at these higher levels, rather than i…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Premier-TACO is a Few-Shot Policy Learner: Pretraining Multitask Representation via Temporal Action-Driven Contrastive Loss

2024-02-09 · Ruijie Zheng, Yongyuan Liang, Xiyao Wang, Shuang Ma 외

We present Premier-TACO, a multitask feature representation learning approach designed to improve few-shot policy learning efficiency in sequential decision-making tasks. Premier-TACO leverages a subset of multitask offl…

Computational Efficiency continuous-control Continuous Control Contrastive Learning+5

Learning Massively Multitask World Models for Continuous Control

2025-11-24 · Nicklas Hansen, Hao Su, Xiaolong Wang arxiv

General-purpose control demands agents that act across many tasks and embodiments, yet research on reinforcement learning (RL) for continuous control remains dominated by single-task or offline regimes, reinforcing a vie…

Reinforcement Learning Continuous Control