paper-with-me

Papers

Multi-modal Motion Prediction using Temporal Ensembling with Learning-based Aggregation

2024-10-25 · Kai-Yin Hong, Chieh-Chih Wang, Wen-Chieh Lin

Recent years have seen a shift towards learning-based methods for trajectory prediction, with challenges remaining in addressing uncertainty and capturing multi-modal distributions. This paper introduces Temporal Ensembling with Learning-based Aggregation, a meta-algorithm designed to mitigate the issue of missing behaviors in trajectory prediction, which leads to inconsistent predictions across consecutive frames. Unlike conventional model ensembling, temporal ensembling leverages predictions from nearby frames to enhance spatial coverage and prediction diversity. By confirming predictions from multiple frames, temporal ensembling compensates for occasional errors in individual frame predictions. Furthermore, trajectory-level aggregation, often utilized in model ensembling, is insufficient for temporal ensembling due to a lack of consideration of traffic context and its tendency to assign candidate trajectories with incorrect driving behaviors to final predictions. We further emphasize the necessity of learning-based aggregation by utilizing mode queries within a DETR-like architecture for our temporal ensembling, leveraging the characteristics of predictions from nearby frames. Our method, validated on the Argoverse 2 dataset, shows notable improvements: a 4% reduction in minADE, a 5% decrease in minFDE, and a 1.16% reduction in the miss rate compared to the strongest baseline, QCNet, highlighting its efficacy and potential in autonomous driving.

📄 PDF Abstract BibTeX arXiv:2410.19606

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDiversitymotion predictionPredictionTrajectory Prediction

Similar Papers 제목 키워드 기반

Bootstrap Motion Forecasting With Self-Consistent Constraints

2022-04-12 · ICCV 2023 1 · Maosheng Ye, Jiamiao Xu, Xunnong Xu, Tengfei Wang 외

We present a novel framework to bootstrap Motion forecasting with Self-consistent Constraints (MISC). The motion forecasting task aims at predicting future trajectories of vehicles by incorporating spatial and temporal i…

Motion Forecasting

Motion Forecasting via Model-Based Risk Minimization

2024-09-16 · Aron Distelzweig, Eitan Kosman, Andreas Look, Faris Janjoš 외

Forecasting the future trajectories of surrounding agents is crucial for autonomous vehicles to ensure safe, efficient, and comfortable route planning. While model ensembling has improved prediction accuracy in various f…

Autonomous VehiclesmodelMotion ForecastingPrediction+1

Video Affective Effects Prediction with Multi-modal Fusion and Shot-Long Temporal Context

2019-09-01 · Jie Zhang, Yin Zhao, Longjun Cai, Chaoping Tu 외

Predicting the emotional impact of videos using machine learning is a challenging task considering the varieties of modalities, the complicated temporal contex of the video as well as the time dependency of the emotional…

Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results

2017-03-06 · NeurIPS 2017 12 · Antti Tarvainen, Harri Valpola

The recently proposed Temporal Ensembling has achieved state-of-the-art results in several semi-supervised learning benchmarks. It maintains an exponential moving average of label predictions on each training example, an…

Semi-Supervised Image ClassificationSemi-Supervised RGBD Semantic SegmentationSemi-Supervised Semantic SegmentationSource Free Object Detection

Vision-Motion-Reference Alignment for Referring Multi-Object Tracking via Multi-Modal Large Language Models

2025-11-21 · Weiyi Lv, Ning Zhang, Hanyang Sun, Haoran Jiang 외 arxiv

Referring Multi-Object Tracking (RMOT) extends conventional multi-object tracking (MOT) by introducing natural language references for multi-modal fusion tracking. RMOT benchmarks only describe the object's appearance, r…

Multi-Object Tracking