LiMTR: Time Series Motion Prediction for Diverse Road Users through Multimodal Feature Integration
Predicting the behavior of road users accurately is crucial to enable the safe operation of autonomous vehicles in urban or densely populated areas. Therefore, there has been a growing interest in time series motion prediction research, leading to significant advancements in state-of-the-art techniques in recent years. However, the potential of using LiDAR data to capture more detailed local features, such as a person's gaze or posture, remains largely unexplored. To address this, we develop a novel multimodal approach for motion prediction based on the PointNet foundation model architecture, incorporating local LiDAR features. Evaluation on the Waymo Open Dataset shows a performance improvement of 6.20% and 1.58% in minADE and mAP respectively, when integrated and compared with the previous state-of-the-art MTR. We open-source the code of our LiMTR model.
Code (1)
Tasks
Autonomous Vehiclesmotion predictionTime SeriesSimilar Papers 제목 키워드 기반
slimTrain -- A Stochastic Approximation Method for Training Separable Deep Neural Networks
Deep neural networks (DNNs) have shown their success as high-dimensional function approximators in many applications; however, training DNNs can be challenging in general. DNN training is commonly phrased as a stochastic…
SensitivityStochastic OptimizationBrain Emotional Learning-Based Prediction Model (For Long-Term Chaotic Prediction Applications)
This study suggests a new prediction model for chaotic time series inspired by the brain emotional learning of mammals. We describe the structure and function of this model, which is referred to as BELPM (Brain Emotional…
PredictionTime SeriesTime Series AnalysisUniMTS: Unified Pre-training for Motion Time Series
Motion time series collected from mobile and wearable devices such as smartphones and smartwatches offer significant insights into human behavioral patterns, with wide applications in healthcare, automation, IoT, and AR/…
Contrastive LearningTime SeriesTime Series ClassificationProbabilistic Transformer For Time Series Analysis
Generative modeling of multivariate time series has remained challenging partly due to the complex, non-deterministic dynamics across long-distance timesteps. In this paper, we propose deep probabilistic methods that com…
Human motion predictionmotion predictionState Space ModelsTime Series+2Enhancing Bandwidth Efficiency for Video Motion Transfer Applications using Deep Learning Based Keypoint Prediction
We propose a deep learning based novel prediction framework for enhanced bandwidth reduction in motion transfer enabled video applications such as video conferencing, virtual reality gaming and privacy preservation for p…
Optical Flow EstimationPredictionTime Series