paper-with-me

Papers

TENET: Transformer Encoding Network for Effective Temporal Flow on Motion Prediction

2022-06-30 · Yuting Wang, Hangning Zhou, Zhigang Zhang, Chen Feng, Huadong Lin, Chaofei Gao, Yizhi Tang, Zhenting Zhao, Shiyu Zhang, Jie Guo, Xuefeng Wang, Ziyao Xu, Chi Zhang

This technical report presents an effective method for motion prediction in autonomous driving. We develop a Transformer-based method for input encoding and trajectory prediction. Besides, we propose the Temporal Flow Header to enhance the trajectory encoding. In the end, an efficient K-means ensemble method is used. Using our Transformer network and ensemble method, we win the first place of Argoverse 2 Motion Forecasting Challenge with the state-of-the-art brier-minFDE score of 1.90.

📄 PDF Abstract BibTeX arXiv:2207.00170

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingMotion Forecastingmotion predictionPredictionTrajectory Prediction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

RouteNet-Gauss: Hardware-Enhanced Network Modeling with Machine Learning

2025-01-15 · Carlos Güemes-Palau, Miquel Ferriol-Galmés, Jordi Paillisse-Vilanova, Albert López-Brescó 외

Network simulation is pivotal in network modeling, assisting with tasks ranging from capacity planning to performance estimation. Traditional approaches such as Discrete Event Simulation (DES) face limitations in terms o…

A Time-Aware Transformer Based Model for Suicide Ideation Detection on Social Media

2020-11-01 · EMNLP 2020 11 · Ramit Sawhney, Harshit Joshi, Saumya Gandhi, Rajiv Ratn Shah

Social media{'}s ubiquity fosters a space for users to exhibit suicidal thoughts outside of traditional clinical settings. Understanding the build-up of such ideation is critical for the identification of at-risk users a…

GateNet: A novel Neural Network Architecture for Automated Flow Cytometry Gating

2023-12-12 · Lukas Fisch, Michael O. Heming, Andreas Schulte-Mecklenbeck, Catharina C. Gross 외

Flow cytometry is widely used to identify cell populations in patient-derived fluids such as peripheral blood (PB) or cerebrospinal fluid (CSF). While ubiquitous in research and clinical practice, flow cytometry requires…

GPU

RemoteNet: Remote Sensing Image Segmentation Network based on Global-Local Information

2023-02-25 · Satyawant Kumar, Abhishek Kumar, Dong-Gyu Lee

Remotely captured images possess an immense scale and object appearance variability due to the complex scene. It becomes challenging to capture the underlying attributes in the global and local context for their segmenta…

DecoderImage SegmentationScene UnderstandingSegmentation+1

GIFnets: Differentiable GIF Encoding Framework

2020-06-24 · CVPR 2020 6 · Innfarn Yoo, Xiyang Luo, Yilin Wang, Feng Yang 외

Graphics Interchange Format (GIF) is a widely used image file format. Due to the limited number of palette colors, GIF encoding often introduces color banding artifacts. Traditionally, dithering is applied to reduce colo…