Analysis over vision-based models for pedestrian action anticipation
Anticipating human actions in front of autonomous vehicles is a challenging task. Several papers have recently proposed model architectures to address this problem by combining multiple input features to predict pedestrian crossing actions. This paper focuses specifically on using images of the pedestrian's context as an input feature. We present several spatio-temporal model architectures that utilize standard CNN and Transformer modules to serve as a backbone for pedestrian anticipation. However, the objective of this paper is not to surpass state-of-the-art benchmarks but rather to analyze the positive and negative predictions of these models. Therefore, we provide insights on the explainability of vision-based Transformer models in the context of pedestrian action prediction. We will highlight cases where the model can achieve correct quantitative results but falls short in providing human-like explanations qualitatively, emphasizing the importance of investing in explainability for pedestrian action anticipation problems.
Code (0)
등록된 구현이 없습니다.
Tasks
Action AnticipationAutonomous VehiclesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pedestrian Action Anticipation using Contextual Feature Fusion in Stacked RNNs
One of the major challenges for autonomous vehicles in urban environments is to understand and predict other road users' actions, in particular, pedestrians at the point of crossing. The common approach to solving this p…
Action AnticipationAutonomous VehiclesPIE: A Large-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction
Pedestrian behavior anticipation is a key challenge in the design of assistive and autonomous driving systems suitable for urban environments. An intelligent system should be able to understand the intentions or underlyi…
Autonomous DrivingPredictionTrajectory PredictionVIENA2: A Driving Anticipation Dataset
Action anticipation is critical in scenarios where one needs to react before the action is finalized. This is, for instance, the case in automated driving, where a car needs to, e.g., avoid hitting pedestrians and respec…
Action AnticipationTAMFormer: Multi-Modal Transformer with Learned Attention Mask for Early Intent Prediction
Human intention prediction is a growing area of research where an activity in a video has to be anticipated by a vision-based system. To this end, the model creates a representation of the past, and subsequently, it prod…
PredictionText-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation
Anticipating future actions in a video is useful for many autonomous and assistive technologies. Most prior action anticipation work treat this as a vision modality problem, where the models learn the task information pr…
Action AnticipationTransfer Learning