“Seeing is Believing”: Pedestrian Trajectory Forecasting Using Visual Frustum of Attention
In this paper we show the importance of the head pose estimation in the task of trajectory forecasting. This cue, when produced by an oracle and injected in a novel socially-based energy minimization approach, allows to get state-of-the-art performances on four different forecasting benchmarks, without relying on additional information such as expected destination and desired speed, which are supposed to be know beforehand for most of the current forecasting techniques. Our approach uses the head pose estimation for two aims: 1) to define a view frustum of attention, highlighting the people a given subject is more interested about, in order to avoid collisions; 2) to give a shorttime estimation of what would be the desired destination point. Moreover, we show that when the head pose estimation is given by a real detector, though the performance decreases, it still remains at the level of the top score forecasting systems
Code (0)
등록된 구현이 없습니다.
Tasks
Head Pose EstimationPose EstimationTrajectory ForecastingSimilar Papers 제목 키워드 기반
Seeing but Not Believing: Probing the Disconnect Between Visual Attention and Answer Correctness in VLMs
Vision-Language Models (VLMs) achieve strong results on multimodal tasks such as visual question answering, yet they can still fail even when the correct visual evidence is present. In this work, we systematically invest…
Visual Question AnsweringForecasting Pedestrian Trajectory with Machine-Annotated Training Data
Reliable anticipation of pedestrian trajectory is imperative for the operation of autonomous vehicles and can significantly enhance the functionality of advanced driver assistance systems. While significant progress has …
Autonomous VehiclesPedestrian DetectionTrajectory ForecastingPEDESTRIANQA: A Benchmark for Vision-Language Models on Pedestrian Intention and Trajectory Prediction
Pedestrian intention and trajectory prediction are critical for the safe deployment of autonomous driving systems, directly influencing navigation decisions in complex traffic environments. Recent advances in large visio…
Trajectory ForecastingTrajectory PredictionAutonomous DrivingForecasting People Trajectories and Head Poses by Jointly Reasoning on Tracklets and Vislets
In this work, we explore the correlation between people trajectories and their head orientations. We argue that people trajectory and head pose forecasting can be modelled as a joint problem. Recent approaches on traject…
Trajectory ForecastingSocially-Informed Reconstruction for Pedestrian Trajectory Forecasting
Pedestrian trajectory prediction remains a challenge for autonomous systems, particularly due to the intricate dynamics of social interactions. Accurate forecasting requires a comprehensive understanding not only of each…
Pedestrian Trajectory PredictionTrajectory ForecastingTrajectory Prediction