Hierarchical Reinforcement Learning for Temporal Pattern Prediction

2023-10-09 · Faith Johnson, Kristin Dana

In this work, we explore the use of hierarchical reinforcement learning (HRL) for the task of temporal sequence prediction. Using a combination of deep learning and HRL, we develop a stock agent to predict temporal price sequences from historical stock price data and a vehicle agent to predict steering angles from first person, dash cam images. Our results in both domains indicate that a type of HRL, called feudal reinforcement learning, provides significant improvements to training speed and stability and prediction accuracy over standard RL. A key component to this success is the multi-resolution structure that introduces both temporal and spatial abstraction into the network hierarchy.

📄 PDF Abstract BibTeX arXiv:2310.05695

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning Prediction reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

CAM Class activation maps could be used to interpret the prediction decision made by the convolutional neural network (CNN). Image source: [Learning Deep Features for…

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

A Neurally-Inspired Hierarchical Prediction Network for Spatiotemporal Sequence Learning and Prediction

2019-01-25 · Jie-Lin Qiu, Ge Huang, Tai Sing Lee

In this paper we developed a hierarchical network model, called Hierarchical Prediction Network (HPNet), to understand how spatiotemporal memories might be learned and encoded in the recurrent circuits in the visual cort…

Clustering Prediction

HTMRL: Biologically Plausible Reinforcement Learning with Hierarchical Temporal Memory

2020-09-18 · Jakob Struye, Kevin Mets, Steven Latré

Building Reinforcement Learning (RL) algorithms which are able to adapt to continuously evolving tasks is an open research challenge. One technology that is known to inherently handle such non-stationary input patterns w…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Enhancing Temporal Link Prediction with HierTKG: A Hierarchical Temporal Knowledge Graph Framework

2024-12-16 · Mariam Almutairi, Melike Yildiz Aktas, Nawar Wali, Shutonu Mitra 외

The rapid spread of misinformation on social media, especially during crises, challenges public decision-making. To address this, we propose HierTKG, a framework combining Temporal Graph Networks (TGN) and hierarchical p…

Decision Making Link Prediction Misinformation

Learning Hierarchical Representations of Electronic Health Records for Clinical Outcome Prediction

2019-03-20 · Lu-chen Liu, Haoran Li, Zhiting Hu, Haoran Shi 외

Clinical outcome prediction based on the Electronic Health Record (EHR) plays a crucial role in improving the quality of healthcare. Conventional deep sequential models fail to capture the rich temporal patterns encoded …

ICU Admission

Learning to Sit: Synthesizing Human-Chair Interactions via Hierarchical Control

2019-08-20 · Yu-Wei Chao, Jimei Yang, Weifeng Chen, Jia Deng

Recent progress on physics-based character animation has shown impressive breakthroughs on human motion synthesis, through imitating motion capture data via deep reinforcement learning. However, results have mostly been …

Deep Reinforcement Learning Hierarchical Reinforcement Learning motion prediction Motion Synthesis+3