AutoTrajectory: Label-free Trajectory Extraction and Prediction from Videos using Dynamic Points
Current methods for trajectory prediction operate in supervised manners, and therefore require vast quantities of corresponding ground truth data for training. In this paper, we present a novel, label-free algorithm, AutoTrajectory, for trajectory extraction and prediction to use raw videos directly. To better capture the moving objects in videos, we introduce dynamic points. We use them to model dynamic motions by using a forward-backward extractor to keep temporal consistency and using image reconstruction to keep spatial consistency in an unsupervised manner. Then we aggregate dynamic points to instance points, which stand for moving objects such as pedestrians in videos. Finally, we extract trajectories by matching instance points for prediction training. To the best of our knowledge, our method is the first to achieve unsupervised learning of trajectory extraction and prediction. We evaluate the performance on well-known trajectory datasets and show that our method is effective for real-world videos and can use raw videos to further improve the performance of existing models.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ReconstructionPredictionTrajectory PredictionSimilar Papers 제목 키워드 기반
MoE-Enhanced Multi-Domain Feature Selection and Fusion for Fast Map-Free Trajectory Prediction
Trajectory prediction is crucial for the reliability and safety of autonomous driving systems, yet it remains a challenging task in complex interactive scenarios due to noisy trajectory observations and intricate agent i…
Information ExtractionTrajectory PredictionAutonomous DrivingPatch Ensembles for Robust Salmon Re-Identification with Weak Trajectory Labels
Salmon re-identification in commercial net-pens is challenging due to large populations, which impose strict accuracy requirements and make large-scale labeled data acquisition infeasible. Trajectory IDs can be used as p…
Learn to Quantify Social Interaction with Constraints for Pedestrian Walking
Long-term human path forecasting in crowds is critical for autonomous moving platforms (like autonomous driving cars and social robots) to avoid collision and make high-quality planning. Although the current research tak…
Trajectory PredictionAutonomous DrivingDenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets
Due to the stochasticity of human behaviors, predicting the future trajectories of road agents is challenging for autonomous driving. Recently, goal-based multi-trajectory prediction methods are proved to be effective, w…
Autonomous DrivingMotion Forecastingmotion predictionPrediction+1Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding
Reliable motion forecasting of surrounding agents is essential for ensuring the safe operation of autonomous vehicles. Many existing trajectory prediction methods rely heavily on high-definition (HD) maps as strong drivi…
Autonomous VehiclesDecoderKnowledge DistillationMotion Forecasting+1