paper-with-me

홈 › Papers

STT: Stateful Tracking with Transformers for Autonomous Driving

2024-04-30 · Longlong Jing, Ruichi Yu, Xu Chen, Zhengli Zhao, Shiwei Sheng, Colin Graber, Qi Chen, Qinru Li, Shangxuan Wu, Han Deng, Sangjin Lee, Chris Sweeney, Qiurui He, Wei-Chih Hung, Tong He, Xingyi Zhou, Farshid Moussavi, Zijian Guo, Yin Zhou, Mingxing Tan, Weilong Yang, CongCong Li

Tracking objects in three-dimensional space is critical for autonomous driving. To ensure safety while driving, the tracker must be able to reliably track objects across frames and accurately estimate their states such as velocity and acceleration in the present. Existing works frequently focus on the association task while either neglecting the model performance on state estimation or deploying complex heuristics to predict the states. In this paper, we propose STT, a Stateful Tracking model built with Transformers, that can consistently track objects in the scenes while also predicting their states accurately. STT consumes rich appearance, geometry, and motion signals through long term history of detections and is jointly optimized for both data association and state estimation tasks. Since the standard tracking metrics like MOTA and MOTP do not capture the combined performance of the two tasks in the wider spectrum of object states, we extend them with new metrics called S-MOTA and MOTPS that address this limitation. STT achieves competitive real-time performance on the Waymo Open Dataset.

📄 PDF Abstract BibTeX arXiv:2405.00236

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingState Estimation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Driving

2024-02-28 · Jiacheng Lin, Jiajun Chen, Kunyu Peng, Xuan He 외

This paper introduces the task of Auditory Referring Multi-Object Tracking (AR-MOT), which dynamically tracks specific objects in a video sequence based on audio expressions and appears as a challenging problem in autono…

Autonomous DrivingMulti-Object TrackingObjectObject Tracking+1

Visual Perception System for Autonomous Driving

2023-03-03 · Qi Zhang, Siyuan Gou, Wenbin Li

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, w…

Autonomous DrivingCamera Localizationobject-detectionObject Detection+2

A Survey of Vision Transformers in Autonomous Driving: Current Trends and Future Directions

2024-03-12 · Quoc-Vinh Lai-Dang

This survey explores the adaptation of visual transformer models in Autonomous Driving, a transition inspired by their success in Natural Language Processing. Surpassing traditional Recurrent Neural Networks in tasks lik…

Autonomous DrivingDecoderLane Detectionobject-detection+4

UniLION: Towards Unified Autonomous Driving Model with Linear Group RNNs

2025-11-03 · Zhe Liu, Jinghua Hou, Xiaoqing Ye, Jingdong Wang 외 arxiv

Although transformers have demonstrated remarkable capabilities across various domains, their quadratic attention mechanisms introduce significant computational overhead when processing long-sequence data. In this paper,…

3D Object DetectionTemporal Sequences3D Object TrackingAutonomous Driving

Autonomous Driving Implementation in an Experimental Environment

2021-05-23 · Namig Aliyev, Oguzhan Sezer, Mehmet Turan Guzel

Autonomous systems require identifying the environment and it has a long way to go before putting it safely into practice. In autonomous driving systems, the detection of obstacles and traffic lights are of importance as…

Autonomous DrivingOptical Flow Estimation