TD-MPC-Opt: Distilling Model-Based Multi-Task Reinforcement Learning Agents

2025-07-02 · Dmytro Kuzmenko, Nadiya Shvai arxiv

We present a novel approach to knowledge transfer in model-based reinforcement learning, addressing the critical challenge of deploying large world models in resource-constrained environments. Our method efficiently distills a high-capacity multi-task agent (317M parameters) into a compact model (1M parameters) on the MT30 benchmark, significantly improving performance across diverse tasks. Our distilled model achieves a state-of-the-art normalized score of 28.45, surpassing the original 1M parameter model score of 18.93. This improvement demonstrates the ability of our distillation technique to capture and consolidate complex multi-task knowledge. We further optimize the distilled model through FP16 post-training quantization, reducing its size by $\sim$50\%. Our approach addresses practical deployment limitations and offers insights into knowledge representation in large world models, paving the way for more efficient and accessible multi-task reinforcement learning systems in robotics and other resource-constrained applications. Code available at https://github.com/dmytro-kuzmenko/td-mpc-opt.

📄 PDF Abstract BibTeX arXiv:2507.01823

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability

2017-03-17 · ICML 2017 8 · Shayegan Omidshafiei, Jason Pazis, Christopher Amato, Jonathan P. How 외

Many real-world tasks involve multiple agents with partial observability and limited communication. Learning is challenging in these settings due to local viewpoints of agents, which perceive the world as non-stationary …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Information-Bottleneck-Based Behavior Representation Learning for Multi-agent Reinforcement learning

2021-09-29 · Yue Jin, Shuangqing Wei, Jian Yuan, Xudong Zhang

In multi-agent deep reinforcement learning, extracting sufficient and compact information of other agents is critical to attain efficient convergence and scalability of an algorithm. In canonical frameworks, distilling o…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Distilling Reinforcement Learning into Single-Batch Datasets

2025-08-12 · Connor Wilhelm, Dan Ventura arxiv

Dataset distillation compresses a large dataset into a small synthetic dataset such that learning on the synthetic dataset approximates learning on the original. Training on the distilled dataset can be performed in as l…

Reinforcement Learning Atari Games

Putting the Iterative Training of Decision Trees to the Test on a Real-World Robotic Task

2024-12-06 · Raphael C. Engelhardt, Marcel J. Meinen, Moritz Lange, Laurenz Wiskott 외

In previous research, we developed methods to train decision trees (DT) as agents for reinforcement learning tasks, based on deep reinforcement learning (DRL) networks. The samples from which the DTs are built, use the e…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

From Pixels to Digital Agents: An Empirical Study on the Taxonomy and Technological Trends of Reinforcement Learning Environments

2026-03-25 · Lijing Luo, Yiben Luo, Alexey Gorbatovski, Sergey Kovalchuk 외 arxiv

The remarkable progress of reinforcement learning (RL) is intrinsically tied to the environments used to train and evaluate artificial agents. Moving beyond traditional qualitative reviews, this work presents a large-sca…

Zero-shot Generalization Reinforcement Learning Physical Simulations Logical Reasoning