Multi-Camera Trajectory Forecasting: Pedestrian Trajectory Prediction in a Network of Cameras
We introduce the task of multi-camera trajectory forecasting (MCTF), where the future trajectory of an object is predicted in a network of cameras. Prior works consider forecasting trajectories in a single camera view. Our work is the first to consider the challenging scenario of forecasting across multiple non-overlapping camera views. This has wide applicability in tasks such as re-identification and multi-target multi-camera tracking. To facilitate research in this new area, we release the Warwick-NTU Multi-camera Forecasting Database (WNMF), a unique dataset of multi-camera pedestrian trajectories from a network of 15 synchronized cameras. To accurately label this large dataset (600 hours of video footage), we also develop a semi-automated annotation method. An effective MCTF model should proactively anticipate where and when a person will re-appear in the camera network. In this paper, we consider the task of predicting the next camera a pedestrian will re-appear after leaving the view of another camera, and present several baseline approaches for this. The labeled database is available online: https://github.com/olly-styles/Multi-Camera-Trajectory-Forecasting.
Code (1)
Tasks
Pedestrian Trajectory PredictionTrajectory ForecastingTrajectory PredictionSimilar Papers 제목 키워드 기반
Forecasting Pedestrian Trajectory with Machine-Annotated Training Data
Reliable anticipation of pedestrian trajectory is imperative for the operation of autonomous vehicles and can significantly enhance the functionality of advanced driver assistance systems. While significant progress has …
Autonomous VehiclesPedestrian DetectionTrajectory ForecastingRealTraj: Towards Real-World Pedestrian Trajectory Forecasting
This paper jointly addresses three key limitations in conventional pedestrian trajectory forecasting: pedestrian perception errors, real-world data collection costs, and person ID annotation costs. We propose a novel fra…
Trajectory ForecastingT2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Prediction
Predicting pedestrian motion is essential for developing socially-aware robots that interact in a crowded environment. While the natural visual perspective for a social interaction setting is an egocentric view, the majo…
ImputationPedestrian Trajectory PredictionPredictionTrajectory Forecasting+1Cross-Camera Trajectories Help Person Retrieval in a Camera Network
We are concerned with retrieving a query person from multiple videos captured by a non-overlapping camera network. Existing methods often rely on purely visual matching or consider temporal constraints but ignore the spa…
Person RetrievalRe-RankingRetrievalSiT Dataset: Socially Interactive Pedestrian Trajectory Dataset for Social Navigation Robots
To ensure secure and dependable mobility in environments shared by humans and robots, social navigation robots should possess the capability to accurately perceive and predict the trajectories of nearby pedestrians. In t…