Regularizing Neural Networks for Future Trajectory Prediction via Inverse Reinforcement Learning Framework
Predicting distant future trajectories of agents in a dynamic scene is not an easy problem because the future trajectory of an agent is affected by not only his/her past trajectory but also the scene contexts. To tackle this problem, we propose a model based on recurrent neural networks (RNNs) and a novel method for training the model. The proposed model is based on an encoder-decoder architecture where the encoder encodes inputs (past trajectories and scene context information) while the decoder produces a trajectory from the context vector given by the encoder. We train the networks of the proposed model to produce a future trajectory, which is the closest to the true trajectory, while maximizing a reward from a reward function. The reward function is also trained at the same time to maximize the margin between the rewards from the ground-truth trajectory and its estimate. The reward function plays the role of a regularizer for the proposed model so the trained networks are able to better utilize the scene context information for the prediction task. We evaluated the proposed model on several public datasets. Experimental results show that the prediction performance of the proposed model is much improved by the regularization, which outperforms the-state-of-the-arts in terms of accuracy. The implementation codes are available at https://github.com/d1024choi/traj-pred-irl/.
Code (1)
Tasks
Decoderreinforcement-learningReinforcement LearningReinforcement Learning (RL)Trajectory PredictionSimilar Papers 제목 키워드 기반
Scene Induced Multi-Modal Trajectory Forecasting via Planning
We address multi-modal trajectory forecasting of agents in unknown scenes by formulating it as a planning problem. We present an approach consisting of three models; a goal prediction model to identify potential goals of…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Trajectory ForecastingIDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving
End-to-end autonomous driving has emerged as a compelling paradigm for learning planning directly from sensor observations, while recent world-model-based approaches further enrich this paradigm by enabling explicit reas…
Autonomous DrivingSocialTraj: Two-Stage Socially-Aware Trajectory Prediction for Autonomous Driving via Conditional Diffusion Model
Accurate trajectory prediction of surrounding vehicles (SVs) is crucial for autonomous driving systems to avoid misguided decisions and potential accidents. However, achieving reliable predictions in highly dynamic and c…
Reinforcement LearningTrajectory PredictionAutonomous DrivingProbabilistic Prediction of Interactive Driving Behavior via Hierarchical Inverse Reinforcement Learning
Autonomous vehicles (AVs) are on the road. To safely and efficiently interact with other road participants, AVs have to accurately predict the behavior of surrounding vehicles and plan accordingly. Such prediction should…
Autonomous VehiclesPredictionreinforcement-learningReinforcement Learning+1Trajectory Forecasts in Unknown Environments Conditioned on Grid-Based Plans
We address the problem of forecasting pedestrian and vehicle trajectories in unknown environments, conditioned on their past motion and scene structure. Trajectory forecasting is a challenging problem due to the large va…
Reinforcement LearningTrajectory ForecastingTrajectory Prediction