Graph-SIM: A Graph-based Spatiotemporal Interaction Modelling for Pedestrian Action Prediction
One of the most crucial yet challenging tasks for autonomous vehicles in urban environments is predicting the future behaviour of nearby pedestrians, especially at points of crossing. Predicting behaviour depends on many social and environmental factors, particularly interactions between road users. Capturing such interactions requires a global view of the scene and dynamics of the road users in three-dimensional space. This information, however, is missing from the current pedestrian behaviour benchmark datasets. Motivated by these challenges, we propose 1) a novel graph-based model for predicting pedestrian crossing action. Our method models pedestrians' interactions with nearby road users through clustering and relative importance weighting of interactions using features obtained from the bird's-eye-view. 2) We introduce a new dataset that provides 3D bounding box and pedestrian behavioural annotations for the existing nuScenes dataset. On the new data, our approach achieves state-of-the-art performance by improving on various metrics by more than 15% in comparison to existing methods. The dataset is available at https://github.com/huawei-noah/datasets/PePScenes.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesClusteringSimilar Papers 제목 키워드 기반
Flexible Multi-Generator Model with Fused Spatiotemporal Graph for Trajectory Prediction
Trajectory prediction plays a vital role in automotive radar systems, facilitating precise tracking and decision-making in autonomous driving. Generative adversarial networks with the ability to learn a distribution over…
Autonomous DrivingDecision MakingTrajectory PredictionTrajectory Learning with Graph Representations for Social Robot Navigation
Autonomous mobile robots are expected to exhibit socially compliant navigation for minimizing pedestrian disturbance. While capturing social interactions and incorporating pedestrian motion estimations into decision-maki…
Reinforcement LearningRobot NavigationESIA: An Energy-Based Spatiotemporal Interaction-Aware Framework for Pedestrian Intention Prediction
Recent advances in autonomous driving have motivated research on pedestrian intention prediction, which aims to infer future crossing decisions and actions by modeling temporal dynamics, social interactions, and environm…
Structured PredictionAutonomous DrivingMulticlass-SGCN: Sparse Graph-based Trajectory Prediction with Agent Class Embedding
Trajectory prediction of road users in real-world scenarios is challenging because their movement patterns are stochastic and complex. Previous pedestrian-oriented works have been successful in modelling the complex inte…
Trajectory PredictionSpatiotemporal Relationship Reasoning for Pedestrian Intent Prediction
Reasoning over visual data is a desirable capability for robotics and vision-based applications. Such reasoning enables forecasting of the next events or actions in videos. In recent years, various models have been devel…
Autonomous DrivingAutonomous VehiclesNavigatePrediction