paper-with-me

홈 › Papers

Analysis over vision-based models for pedestrian action anticipation

2023-05-27 · Lina Achaji, Julien Moreau, François Aioun, François Charpillet

Anticipating human actions in front of autonomous vehicles is a challenging task. Several papers have recently proposed model architectures to address this problem by combining multiple input features to predict pedestrian crossing actions. This paper focuses specifically on using images of the pedestrian's context as an input feature. We present several spatio-temporal model architectures that utilize standard CNN and Transformer modules to serve as a backbone for pedestrian anticipation. However, the objective of this paper is not to surpass state-of-the-art benchmarks but rather to analyze the positive and negative predictions of these models. Therefore, we provide insights on the explainability of vision-based Transformer models in the context of pedestrian action prediction. We will highlight cases where the model can achieve correct quantitative results but falls short in providing human-like explanations qualitatively, emphasizing the importance of investing in explainability for pedestrian action anticipation problems.

📄 PDF Abstract BibTeX arXiv:2305.17451

Code (0)

등록된 구현이 없습니다.

Tasks

Action AnticipationAutonomous Vehicles

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Pedestrian Action Anticipation using Contextual Feature Fusion in Stacked RNNs

2020-05-13 · Amir Rasouli, Iuliia Kotseruba, John K. Tsotsos

One of the major challenges for autonomous vehicles in urban environments is to understand and predict other road users' actions, in particular, pedestrians at the point of crossing. The common approach to solving this p…

Action AnticipationAutonomous Vehicles

PIE: A Large-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction

2019-10-01 · ICCV 2019 10 · Amir Rasouli, Iuliia Kotseruba, Toni Kunic, John K. Tsotsos

Pedestrian behavior anticipation is a key challenge in the design of assistive and autonomous driving systems suitable for urban environments. An intelligent system should be able to understand the intentions or underlyi…

Autonomous DrivingPredictionTrajectory Prediction

VIENA2: A Driving Anticipation Dataset

2018-10-22 · Mohammad Sadegh Aliakbarian, Fatemeh Sadat Saleh, Mathieu Salzmann, Basura Fernando 외

Action anticipation is critical in scenarios where one needs to react before the action is finalized. This is, for instance, the case in automated driving, where a car needs to, e.g., avoid hitting pedestrians and respec…

Action Anticipation

TAMFormer: Multi-Modal Transformer with Learned Attention Mask for Early Intent Prediction

2022-10-26 · Nada Osman, Guglielmo Camporese, Lamberto Ballan

Human intention prediction is a growing area of research where an activity in a video has to be anticipated by a vision-based system. To this end, the model creates a representation of the past, and subsequently, it prod…

Prediction

Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation

2022-10-12 · Sayontan Ghosh, Tanvi Aggarwal, Minh Hoai, Niranjan Balasubramanian

Anticipating future actions in a video is useful for many autonomous and assistive technologies. Most prior action anticipation work treat this as a vision modality problem, where the models learn the task information pr…

Action AnticipationTransfer Learning