홈 › Papers

Learning how to Interact with a Complex Interface using Hierarchical Reinforcement Learning

2022-04-21 · Gheorghe Comanici, Amelia Glaese, Anita Gergely, Daniel Toyama, Zafarali Ahmed, Tyler Jackson, Philippe Hamel, Doina Precup

Hierarchical Reinforcement Learning (HRL) allows interactive agents to decompose complex problems into a hierarchy of sub-tasks. Higher-level tasks can invoke the solutions of lower-level tasks as if they were primitive actions. In this work, we study the utility of hierarchical decompositions for learning an appropriate way to interact with a complex interface. Specifically, we train HRL agents that can interface with applications in a simulated Android device. We introduce a Hierarchical Distributed Deep Reinforcement Learning architecture that learns (1) subtasks corresponding to simple finger gestures, and (2) how to combine these gestures to solve several Android tasks. Our approach relies on goal conditioning and can be used more generally to convert any base RL agent into an HRL agent. We use the AndroidEnv environment to evaluate our approach. For the experiments, the HRL agent uses a distributed version of the popular DQN algorithm to train different components of the hierarchy. While the native action space is completely intractable for simple DQN agents, our architecture can be used to establish an effective way to interact with different tasks, significantly improving the performance of the same DQN agent over different levels of abstraction.

📄 PDF Abstract BibTeX arXiv:2204.10374

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningHierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

BASE 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Enhancing Reinforcement Learning with discrete interfaces to learn the Dyck Language

2021-10-27 · Florian Dietz, Dietrich Klakow

Even though most interfaces in the real world are discrete, no efficient way exists to train neural networks to make use of them, yet. We enhance an Interaction Network (a Reinforcement Learning architecture) with discre…

reinforcement-learning Reinforcement Learning (RL)

Antibody-Antigen Docking and Design via Hierarchical Equivariant Refinement

2022-07-14 · Wengong Jin, Regina Barzilay, Tommi Jaakkola

Computational antibody design seeks to automatically create an antibody that binds to an antigen. The binding affinity is governed by the 3D binding interface where antibody residues (paratope) closely interact with anti…

Atomic Forces Decoder

Agent Lightning: Train ANY AI Agents with Reinforcement Learning

2025-08-05 · Xufang Luo, Yuge Zhang, Zhiyuan He, Zilong Wang 외 arxiv

We present Agent Lightning, a flexible and extensible framework that enables Reinforcement Learning (RL)-based training of Large Language Models (LLMs) for any AI agent. Unlike existing methods that tightly couple RL tra…

Reinforcement Learning

Reinforcement Learning Neural Turing Machines - Revised

2015-05-04 · Wojciech Zaremba, Ilya Sutskever

The Neural Turing Machine (NTM) is more expressive than all previously considered models because of its external memory. It can be viewed as a broader effort to use abstract external Interfaces and to learn a parametric …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

An Extensible Interactive Interface for Agent Design

2019-06-06 · Matthew Rahtz, James Fang, Anca D. Dragan, Dylan Hadfield-Menell

In artificial intelligence, we often specify tasks through a reward function. While this works well in some settings, many tasks are hard to specify this way. In deep reinforcement learning, for example, directly specify…

Deep Reinforcement Learning Reinforcement Learning Reinforcement Learning (RL)