Forecasting Pedestrian Trajectory with Machine-Annotated Training Data
Reliable anticipation of pedestrian trajectory is imperative for the operation of autonomous vehicles and can significantly enhance the functionality of advanced driver assistance systems. While significant progress has been made in the field of pedestrian detection, forecasting pedestrian trajectories remains a challenging problem due to the unpredictable nature of pedestrians and the huge space of potentially useful features. In this work, we present a deep learning approach for pedestrian trajectory forecasting using a single vehicle-mounted camera. Deep learning models that have revolutionized other areas in computer vision have seen limited application to trajectory forecasting, in part due to the lack of richly annotated training data. We address the lack of training data by introducing a scalable machine annotation scheme that enables our model to be trained using a large dataset without human annotation. In addition, we propose Dynamic Trajectory Predictor (DTP), a model for forecasting pedestrian trajectory up to one second into the future. DTP is trained using both human and machine-annotated data, and anticipates dynamic motion that is not captured by linear models. Experimental evaluation confirms the benefits of the proposed model.
Code (1)
Tasks
Autonomous VehiclesPedestrian DetectionTrajectory ForecastingSimilar Papers 제목 키워드 기반
Disentangling Human Dynamics for Pedestrian Locomotion Forecasting with Noisy Supervision
We tackle the problem of Human Locomotion Forecasting, a task for jointly predicting the spatial positions of several keypoints on the human body in the near future under an egocentric setting. In contrast to the previou…
Human DynamicsPose PredictionTrajectory ForecastingSocially-Informed Reconstruction for Pedestrian Trajectory Forecasting
Pedestrian trajectory prediction remains a challenge for autonomous systems, particularly due to the intricate dynamics of social interactions. Accurate forecasting requires a comprehensive understanding not only of each…
Pedestrian Trajectory PredictionTrajectory ForecastingTrajectory PredictionRealTraj: Towards Real-World Pedestrian Trajectory Forecasting
This paper jointly addresses three key limitations in conventional pedestrian trajectory forecasting: pedestrian perception errors, real-world data collection costs, and person ID annotation costs. We propose a novel fra…
Trajectory ForecastingPEDESTRIANQA: A Benchmark for Vision-Language Models on Pedestrian Intention and Trajectory Prediction
Pedestrian intention and trajectory prediction are critical for the safe deployment of autonomous driving systems, directly influencing navigation decisions in complex traffic environments. Recent advances in large visio…
Trajectory ForecastingTrajectory PredictionAutonomous DrivingMulti-Camera Trajectory Forecasting: Pedestrian Trajectory Prediction in a Network of Cameras
We introduce the task of multi-camera trajectory forecasting (MCTF), where the future trajectory of an object is predicted in a network of cameras. Prior works consider forecasting trajectories in a single camera view. O…
Pedestrian Trajectory PredictionTrajectory ForecastingTrajectory Prediction