paper-with-me

Papers

Shared-unique Features and Task-aware Prioritized Sampling on Multi-task Reinforcement Learning

2024-06-02 · Po-Shao Lin, Jia-Fong Yeh, Yi-Ting Chen, Winston H. Hsu

We observe that current state-of-the-art (SOTA) methods suffer from the performance imbalance issue when performing multi-task reinforcement learning (MTRL) tasks. While these methods may achieve impressive performance on average, they perform extremely poorly on a few tasks. To address this, we propose a new and effective method called STARS, which consists of two novel strategies: a shared-unique feature extractor and task-aware prioritized sampling. First, the shared-unique feature extractor learns both shared and task-specific features to enable better synergy of knowledge between different tasks. Second, the task-aware sampling strategy is combined with the prioritized experience replay for efficient learning on tasks with poor performance. The effectiveness and stability of our STARS are verified through experiments on the mainstream Meta-World benchmark. From the results, our STARS statistically outperforms current SOTA methods and alleviates the performance imbalance issue. Besides, we visualize the learned features to support our claims and enhance the interpretability of STARS.

📄 PDF Abstract BibTeX arXiv:2406.00761

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…
Prioritized Experience Replay Prioritized Experience Replay is a type of experience replay in reinforcement learning where we more frequently replay…

Similar Papers 제목 키워드 기반

Prioritized Inverse Kinematics: Desired Task Trajectories in Nonsingular Task Spaces

2019-10-23

A prioritized inverse kinematics (PIK) solution can be considered as a (regulation or output tracking) control law of a dynamical system with prioritized multiple outputs. We propose a method that guarantees that a joint…

Personalized PCA: Decoupling Shared and Unique Features

2022-07-17 · Naichen Shi, Raed Al Kontar

In this paper, we tackle a significant challenge in PCA: heterogeneity. When data are collected from different sources with heterogeneous trends while still sharing some congruency, it is critical to extract shared knowl…

Video SegmentationVideo Semantic Segmentation

Dyna-Style Planning with Linear Function Approximation and Prioritized Sweeping

2012-06-13 · Richard S. Sutton, Csaba Szepesvari, Alborz Geramifard, Michael P. Bowling

We consider the problem of efficiently learning optimal control policies and value functions over large state spaces in an online setting in which estimates must be available after each interaction with the world. This p…

Distributed Prioritized Experience Replay

2018-03-02 · ICLR 2018 1 · Dan Horgan, John Quan, David Budden, Gabriel Barth-Maron 외

We propose a distributed architecture for deep reinforcement learning at scale, that enables agents to learn effectively from orders of magnitude more data than previously possible. The algorithm decouples acting from le…

Atari GamesDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1

Data Science Kitchen at GermEval 2021: A Fine Selection of Hand-Picked Features, Delivered Fresh from the Oven

2021-09-06 · GermEval 2021 9 · Niclas Hildebrandt, Benedikt Boenninghoff, Dennis Orth, Christopher Schymura

This paper presents the contribution of the Data Science Kitchen at GermEval 2021 shared task on the identification of toxic, engaging, and fact-claiming comments. The task aims at extending the identification of offensi…

Fact CheckingFeature Engineering