PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulation
Predicting the future motion of traffic agents is crucial for safe and efficient autonomous driving. To this end, we present PredictionNet, a deep neural network (DNN) that predicts the motion of all surrounding traffic agents together with the ego-vehicle's motion. All predictions are probabilistic and are represented in a simple top-down rasterization that allows an arbitrary number of agents. Conditioned on a multi-layer map with lane information, the network outputs future positions, velocities, and backtrace vectors jointly for all agents including the ego-vehicle in a single pass. Trajectories are then extracted from the output. The network can be used to simulate realistic traffic, and it produces competitive results on popular benchmarks. More importantly, it has been used to successfully control a real-world vehicle for hundreds of kilometers, by combining it with a motion planning/control subsystem. The network runs faster than real-time on an embedded GPU, and the system shows good generalization (across sensory modalities and locations) due to the choice of input representation. Furthermore, we demonstrate that by extending the DNN with reinforcement learning (RL), it can better handle rare or unsafe events like aggressive maneuvers and crashes.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingGPUMotion PlanningReinforcement Learning (RL)Traffic PredictionSimilar Papers 제목 키워드 기반
Right in Time: Reactive Reasoning in Regulated Traffic Spaces
Exact inference in probabilistic First-Order Logic offers a promising yet computationally costly approach for regulating the behavior of autonomous agents in shared traffic spaces. While prior methods have combined logic…
Probabilistic Traffic Forecasting with Dynamic Regression
This paper proposes a dynamic regression (DR) framework that enhances existing deep spatiotemporal models by incorporating structured learning for the error process in traffic forecasting. The framework relaxes the assum…
regressionTime SeriesTime Series AnalysisTime Series ForecastingA Framework for Probabilistic Generic Traffic Scene Prediction
In a given scenario, simultaneously and accurately predicting every possible interaction of traffic participants is an important capability for autonomous vehicles. The majority of current researches focused on the predi…
Autonomous VehiclesDecision MakingMotion PlanningPredictionA Unified Probabilistic Approach to Traffic Conflict Detection
Traffic conflict detection is essential for proactive road safety by identifying potential collisions before they occur. Existing methods rely on surrogate safety measures tailored to specific interactions (e.g., car-fol…
Autonomous DrivingLink Representation Learning for Probabilistic Travel Time Estimation
Travel time estimation is a crucial application in navigation apps and web mapping services. Current deterministic and probabilistic methods primarily focus on modeling individual trips, assuming independence among trips…
Data AugmentationRepresentation LearningTravel Time Estimation