How Can I See My Future? FvTraj: Using First-person View for Pedestrian Trajectory Prediction
This work presents a novel First-person View based Trajectory predicting model (FvTraj) to estimate the future trajectories of pedestrians in a scene given their observed trajectories and the corresponding first-person view images. First, we render first-person view images using our in-house built First-person View Simulator (FvSim), given the ground-level 2D trajectories. Then, based on multi-head attention mechanisms, we design a social-aware attention module to model social interactions between pedestrians, and a view-aware attention module to capture the relations between historical motion states and visual features from the first-person view images. Our results show the dynamic scene contexts with ego-motions captured by first-person view images via FvSim are valuable and effective for trajectory prediction. Using this simulated first-person view images, our well structured FvTraj model achieves state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Pedestrian Trajectory PredictionTrajectory PredictionSimilar Papers 제목 키워드 기반
Dissecting Person Re-identification from the Viewpoint of Viewpoint
Variations in visual factors such as viewpoint, pose, illumination and background, are usually viewed as important challenges in person re-identification (re-ID). In spite of acknowledging these factors to be influential…
Person Re-IdentificationT2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Prediction
Predicting pedestrian motion is essential for developing socially-aware robots that interact in a crowded environment. While the natural visual perspective for a social interaction setting is an egocentric view, the majo…
ImputationPedestrian Trajectory PredictionPredictionTrajectory Forecasting+1Occluded Person Re-Identification with Deep Learning: A Survey and Perspectives
Person re-identification (Re-ID) technology plays an increasingly crucial role in intelligent surveillance systems. Widespread occlusion significantly impacts the performance of person Re-ID. Occluded person Re-ID refers…
Occluded Person Re-IdentificationPerson Re-IdentificationOmniPerson: Unified Identity-Preserving Pedestrian Generation
Person re-identification (ReID) suffers from a lack of large-scale high-quality training data due to challenges in data privacy and annotation costs. While previous approaches have explored pedestrian generation for data…
Person Re-IdentificationImage Super-ResolutionData AugmentationVideo GenerationAction-based Contrastive Learning for Trajectory Prediction
Trajectory prediction is an essential task for successful human robot interaction, such as in autonomous driving. In this work, we address the problem of predicting future pedestrian trajectories in a first person view s…
Autonomous DrivingContrastive LearningPredictionTrajectory Prediction