paper-with-me

홈 › Papers

A Multi-Modal States based Vehicle Descriptor and Dilated Convolutional Social Pooling for Vehicle Trajectory Prediction

2020-03-07 · Huimin Zhang, Yafei Wang, Junjia Liu, Chengwei Li, Taiyuan Ma, Chengliang Yin

Precise trajectory prediction of surrounding vehicles is critical for decision-making of autonomous vehicles and learning-based approaches are well recognized for the robustness. However, state-of-the-art learning-based methods ignore 1) the feasibility of the vehicle's multi-modal state information for prediction and 2) the mutual exclusive relationship between the global traffic scene receptive fields and the local position resolution when modeling vehicles' interactions, which may influence prediction accuracy. Therefore, we propose a vehicle-descriptor based LSTM model with the dilated convolutional social pooling (VD+DCS-LSTM) to cope with the above issues. First, each vehicle's multi-modal state information is employed as our model's input and a new vehicle descriptor encoded by stacked sparse auto-encoders is proposed to reflect the deep interactive relationships between various states, achieving the optimal feature extraction and effective use of multi-modal inputs. Secondly, the LSTM encoder is used to encode the historical sequences composed of the vehicle descriptor and a novel dilated convolutional social pooling is proposed to improve modeling vehicles' spatial interactions. Thirdly, the LSTM decoder is used to predict the probability distribution of future trajectories based on maneuvers. The validity of the overall model was verified over the NGSIM US-101 and I-80 datasets and our method outperforms the latest benchmark.

📄 PDF Abstract BibTeX arXiv:2003.03480

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesDecision MakingDecoderTrajectory Prediction

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Multiple Emotion Descriptors Estimation at the ABAW3 Challenge

2022-03-24 · Didan Deng

To describe complex emotional states, psychologists have proposed multiple emotion descriptors: sparse descriptors like facial action units; continuous descriptors like valence and arousal; and discrete class descriptors…

SDC - Stacked Dilated Convolution: A Unified Descriptor Network for Dense Matching Tasks

2019-04-05 · René Schuster, Oliver Wasenmüller, Christian Unger, Didier Stricker

Dense pixel matching is important for many computer vision tasks such as disparity and flow estimation. We present a robust, unified descriptor network that considers a large context region with high spatial variance. Ou…

Optical Flow EstimationStereo MatchingStereo Matching Hand

SDC - Stacked Dilated Convolution: A Unified Descriptor Network for Dense Matching Tasks

2019-06-01 · CVPR 2019 6 · Rene Schuster, Oliver Wasenmuller, Christian Unger, Didier Stricker

Dense pixel matching is important for many computer vision tasks such as disparity and flow estimation. We present a robust, unified descriptor network that considers a large context region with high spatial variance. O…

Optical Flow EstimationStereo MatchingStereo Matching Hand

Enhancing fractal descriptors on images by combining boundary and interior of Minkowski dilation

2014-12-26 · Marcos W. S. Oliveira, Dalcimar Casanova, João B. Florindo, Odemir Martinez Bruno

This work proposes to obtain novel fractal descriptors from gray-level texture images by combining information from interior and boundary measures of the Minkowski dilation applied to the texture surface. At first, the i…

MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition

2021-04-12 · Jacek Komorowski, Monika Wysoczanska, Tomasz Trzcinski

We introduce a discriminative multimodal descriptor based on a pair of sensor readings: a point cloud from a LiDAR and an image from an RGB camera. Our descriptor, named MinkLoc++, can be used for place recognition, re-l…

3D Place RecognitionAutonomous VehiclesMetric LearningMultimodal Deep Learning+2