On-Board Pedestrian Trajectory Prediction Using Behavioral Features
This paper presents a novel approach to pedestrian trajectory prediction for on-board camera systems, which utilizes behavioral features of pedestrians that can be inferred from visual observations. Our proposed method, called Behavior-Aware Pedestrian Trajectory Prediction (BA-PTP), processes multiple input modalities, i.e. bounding boxes, body and head orientation of pedestrians as well as their pose, with independent encoding streams. The encodings of each stream are fused using a modality attention mechanism, resulting in a final embedding that is used to predict future bounding boxes in the image. In experiments on two datasets for pedestrian behavior prediction, we demonstrate the benefit of using behavioral features for pedestrian trajectory prediction and evaluate the effectiveness of the proposed encoding strategy. Additionally, we investigate the relevance of different behavioral features on the prediction performance based on an ablation study.
Code (0)
등록된 구현이 없습니다.
Tasks
Pedestrian Trajectory PredictionPredictionTrajectory PredictionSimilar Papers 제목 키워드 기반
BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction
Trajectory prediction allows better decision-making in applications of autonomous vehicles or surveillance by predicting the short-term future movement of traffic agents. It is classified into pedestrian or heterogeneous…
Autonomous VehiclesPredictionPseudo LabelTrajectory PredictionGSGFormer: Generative Social Graph Transformer for Multimodal Pedestrian Trajectory Prediction
Pedestrian trajectory prediction, vital for selfdriving cars and socially-aware robots, is complicated due to intricate interactions between pedestrians, their environment, and other Vulnerable Road Users. This paper pre…
Graph Neural NetworkPedestrian Trajectory PredictionTrajectory PredictionPedestrian and Ego-Vehicle Trajectory Prediction From Monocular Camera
Predicting future pedestrian trajectory is a crucial component of autonomous driving systems, as recognizing critical situations based only on current pedestrian position may come too late for any meaningful correcti…
Autonomous DrivingPedestrian Trajectory PredictionPose PredictionPosition+1Action-based Contrastive Learning for Trajectory Prediction
Trajectory prediction is an essential task for successful human robot interaction, such as in autonomous driving. In this work, we address the problem of predicting future pedestrian trajectories in a first person view s…
Autonomous DrivingContrastive LearningPredictionTrajectory PredictionContext-aware Multi-task Learning for Pedestrian Intent and Trajectory Prediction
The advancement of socially-aware autonomous vehicles hinges on precise modeling of human behavior. Within this broad paradigm, the specific challenge lies in accurately predicting pedestrian's trajectory and intention. …
Autonomous VehiclesMulti-Task LearningPredictionTrajectory Prediction