Robust Trajectory Prediction against Adversarial Attacks
Trajectory prediction using deep neural networks (DNNs) is an essential component of autonomous driving (AD) systems. However, these methods are vulnerable to adversarial attacks, leading to serious consequences such as collisions. In this work, we identify two key ingredients to defend trajectory prediction models against adversarial attacks including (1) designing effective adversarial training methods and (2) adding domain-specific data augmentation to mitigate the performance degradation on clean data. We demonstrate that our method is able to improve the performance by 46% on adversarial data and at the cost of only 3% performance degradation on clean data, compared to the model trained with clean data. Additionally, compared to existing robust methods, our method can improve performance by 21% on adversarial examples and 9% on clean data. Our robust model is evaluated with a planner to study its downstream impacts. We demonstrate that our model can significantly reduce the severe accident rates (e.g., collisions and off-road driving).
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingData AugmentationPredictionTrajectory PredictionSimilar Papers 제목 키워드 기반
Evaluating randomized smoothing as a defense against adversarial attacks in trajectory prediction
Accurate and robust trajectory prediction is essential for safe and efficient autonomous driving, yet recent work has shown that even state-of-the-art prediction models are highly vulnerable to inputs being mildly pertur…
Trajectory PredictionAutonomous DrivingTrajRS: Towards Certified Robustness in Pedestrian Trajectory Prediction
The robustness of trajectory prediction models is crucial for developing safe autonomous driving systems. Adversarial attacks on trajectory prediction can significantly impair the accuracy of predicted trajectories, lead…
Trajectory PredictionAutonomous DrivingRealistic Adversarial Attacks for Robustness Evaluation of Trajectory Prediction Models via Future State Perturbation
Trajectory prediction is a key element of autonomous vehicle systems, enabling them to anticipate and react to the movements of other road users. Evaluating the robustness of prediction models against adversarial attacks…
Autonomous VehiclesPredictionTrajectory PredictionTargeted Adversarial Attacks against Neural Network Trajectory Predictors
Trajectory prediction is an integral component of modern autonomous systems as it allows for envisioning future intentions of nearby moving agents. Due to the lack of other agents' dynamics and control policies, deep neu…
Adversarial AttackTrajectory ForecastingTrajectory PredictionAdversarial Backdoor Attack by Naturalistic Data Poisoning on Trajectory Prediction in Autonomous Driving
In autonomous driving, behavior prediction is fundamental for safe motion planning, hence the security and robustness of prediction models against adversarial attacks are of paramount importance. We propose a novel adver…
Autonomous DrivingBackdoor AttackData PoisoningMotion Planning+2