SimAug: Learning Robust Representations from 3D Simulation for Pedestrian Trajectory Prediction in Unseen Cameras

2020-04-04 · Junwei Liang, Lu Jiang, Alexander Hauptmann

This paper focuses on the problem of predicting future trajectories of people in unseen scenarios and camera views. We propose a method to efficiently utilize multi-view 3D simulation data for training. Our approach finds the hardest camera view to mix up with adversarial data from the original camera view in training, thus enabling the model to learn robust representations that can generalize to unseen camera views. We refer to our method as SimAug. We show that SimAug achieves best results on three out-of-domain real-world benchmarks, as well as getting state-of-the-art in the Stanford Drone and the VIRAT/ActEV dataset with in-domain training data. We will release our models and code.

📄 PDF Abstract BibTeX arXiv:2004.02022

Code (1)

JunweiLiang/Multiverse/tree/master/SimAug 공식 구현

Tasks

Adversarial Attack Adversarial DefensePedestrian Trajectory PredictionTrajectory Forecasting Trajectory Prediction

Methods 이 논문이 사용한 방법론

SimAug SimAug, or Simulation as Augmentation, is a data augmentation method for trajectory prediction. It augments the representation such that it is robust to the variances in…

SimAug: Learning Robust Representations from Simulation for Trajectory Prediction

2020-08-01 · ECCV 2020 8 · Junwei Liang, Lu Jiang, Alexander Hauptmann

This paper studies the problem of predicting future trajectories of people in unseen cameras of novel scenarios and views. We approach this problem through the real-data-free setting in which the model is trained only on…

Adversarial Attack Adversarial Defense Pedestrian Trajectory Prediction Trajectory Forecasting+1

TrajFusionNet: Pedestrian Crossing Intention Prediction via Fusion of Sequential and Visual Trajectory Representations

2025-08-27 · François G. Landry, Moulay A. Akhloufi arxiv

With the introduction of vehicles with autonomous capabilities on public roads, predicting pedestrian crossing intention has emerged as an active area of research. The task of predicting pedestrian crossing intention inv…

Learning Pedestrian Actions to Ensure Safe Autonomous Driving

2023-05-22 · Jia Huang, Alvika Gautam, Srikanth Saripalli

To ensure safe autonomous driving in urban environments with complex vehicle-pedestrian interactions, it is critical for Autonomous Vehicles (AVs) to have the ability to predict pedestrians' short-term and immediate acti…

Autonomous Driving Autonomous Vehicles Prediction Trajectory Prediction

Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction

2022-07-20 · Inhwan Bae, Jin-Hwi Park, Hae-Gon Jeon

Modeling the dynamics of people walking is a problem of long-standing interest in computer vision. Many previous works involving pedestrian trajectory prediction define a particular set of individual actions to implicitl…

Pedestrian Trajectory Prediction Prediction Trajectory Prediction

CCF: Cross Correcting Framework for Pedestrian Trajectory Prediction

2024-06-02 · Pranav Singh Chib, Pravendra Singh

Accurately predicting future pedestrian trajectories is crucial across various domains. Due to the uncertainty in future pedestrian trajectories, it is important to learn complex spatio-temporal representations in multi-…

Decoder Pedestrian Trajectory Prediction Prediction Trajectory Prediction