Re-examining Routing Networks for Multi-task Learning
We re-examine Routing Networks, an approach to multi-task learning that uses reinforcement learning to decide parameter sharing with the goal of maximizing knowledge transfer between related tasks while avoiding task interference. These benefits come with the cost of solving a more difficult optimization problem. We argue that the success of this model depends on a few key assumptions and, when they are not satisfied, the difficulty of learning a good route can outweigh the benefits of the approach. In these cases, a simple unlearned routing strategy, which we propose, achieves the best results.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Task Learningreinforcement-learningReinforcement Learning (RL)Transfer LearningSimilar Papers 제목 키워드 기반
Understanding Multilingualism in Mixture-of-Experts LLMs: Routing Mechanism, Expert Specialization, and Layerwise Steering
Mixture-of-Experts (MoE) architectures have shown strong multilingual capabilities, yet the internal mechanisms underlying performance gains and cross-language differences remain insufficiently understood. In this work, …
Adaptive Droplet Routing in Digital Microfluidic Biochips Using Deep Reinforcement Learning
We present and investigate a novel application domain for deep reinforcement learning (RL): droplet routing on digital microfluidic biochips (DMFBs). A DMFB, composed of a two-dimensional electrode array, manipulates dis…
Deep Reinforcement LearningOpenAI Gymreinforcement-learningReinforcement Learning (RL)Routing to the Right Expertise: A Trustworthy Judge for Instruction-based Image Editing
Instruction-based Image Editing (IIE) models have made significantly improvement due to the progress of multimodal large language models (MLLMs) and diffusion models, which can understand and reason about complex editing…
Gumbel-Matrix Routing for Flexible Multi-task Learning
This paper proposes a novel per-task routing method for multi-task applications. Multi-task neural networks can learn to transfer knowledge across different tasks by using parameter sharing. However, sharing parameters b…
Multi-Task LearningNot All Tasks Are Equally Difficult: Multi-Task Deep Reinforcement Learning with Dynamic Depth Routing
Multi-task reinforcement learning endeavors to accomplish a set of different tasks with a single policy. To enhance data efficiency by sharing parameters across multiple tasks, a common practice segments the network into…
AllDeep Reinforcement Learning