Feudal Steering: Hierarchical Learning for Steering Angle Prediction

2020-06-11 · Faith Johnson, Kristin Dana

We consider the challenge of automated steering angle prediction for self driving cars using egocentric road images. In this work, we explore the use of feudal networks, used in hierarchical reinforcement learning (HRL), to devise a vehicle agent to predict steering angles from first person, dash-cam images of the Udacity driving dataset. Our method, Feudal Steering, is inspired by recent work in HRL consisting of a manager network and a worker network that operate on different temporal scales and have different goals. The manager works at a temporal scale that is relatively coarse compared to the worker and has a higher level, task-oriented goal space. Using feudal learning to divide the task into manager and worker sub-networks provides more accurate and robust prediction. Temporal abstraction in driving allows more complex primitives than the steering angle at a single time instance. Composite actions comprise a subroutine or skill that can be re-used throughout the driving sequence. The associated subroutine id is the manager network's goal, so that the manager seeks to succeed at the high level task (e.g. a sharp right turn, a slight right turn, moving straight in traffic, or moving straight unencumbered by traffic). The steering angle at a particular time instance is the worker network output which is regulated by the manager's high level task. We demonstrate state-of-the art steering angle prediction results on the Udacity dataset.

📄 PDF Abstract BibTeX arXiv:2006.06869

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning PredictionSelf-Driving Cars

Hierarchical Reinforcement Learning for Temporal Pattern Prediction

2023-10-09 · Faith Johnson, Kristin Dana

In this work, we explore the use of hierarchical reinforcement learning (HRL) for the task of temporal sequence prediction. Using a combination of deep learning and HRL, we develop a stock agent to predict temporal price…

Hierarchical Reinforcement Learning Prediction reinforcement-learning Reinforcement Learning

Self-Driving Car Steering Angle Prediction Based on Image Recognition

2019-12-11 · Shuyang Du, Haoli Guo, Andrew Simpson

Self-driving vehicles have expanded dramatically over the last few years. Udacity has release a dataset containing, among other data, a set of images with the steering angle captured during driving. The Udacity challenge…

Transfer Learning

Enhancing Accuracy and Robustness of Steering Angle Prediction with Attention Mechanism

2022-11-21 · Swetha Nadella, Pramiti Barua, Jeremy C. Hagler, David J. Lamb 외

In this paper, our focus is on enhancing steering angle prediction for autonomous driving tasks. We initiate our exploration by investigating two veins of widely adopted deep neural architectures, namely ResNets and Ince…

Adversarial Robustness Autonomous Driving Efficient Neural Network Prediction

Towards Increasing the Robustness of Predictive Steering-Control Autonomous Navigation Systems Against Dash Cam Image Angle Perturbations Due to Pothole Encounters

2023-10-06 · Shivam Aarya

Vehicle manufacturers are racing to create autonomous navigation and steering control algorithms for their vehicles. These software are made to handle various real-life scenarios such as obstacle avoidance and lane maneu…

Autonomous Navigation Steering Control

Aggregated Sparse Attention for Steering Angle Prediction

2018-03-15 · Sen He, Dmitry Kangin, Yang Mi, Nicolas Pugeault

In this paper, we apply the attention mechanism to autonomous driving for steering angle prediction. We propose the first model, applying the recently introduced sparse attention mechanism to visual domain, as well as th…

Autonomous Driving Prediction