paper-with-me

Papers

Learning End-to-end Autonomous Driving using Guided Auxiliary Supervision

2018-08-30 · Ashish Mehta, Adithya Subramanian, Anbumani Subramanian

Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main task of predicting the driving commands. Our framework involves an end-to-end trainable network for imitating the expert demonstrator's driving commands. The network intermediately predicts visual affordances and action primitives through direct supervision which provide the aforementioned auxiliary supervised guidance. We demonstrate that such joint learning and supervised guidance facilitates hierarchical task decomposition, assisting the agent to learn faster, achieve better driving performance and increases transparency of the otherwise black-box end-to-end network. We run our experiments to validate the MT-LfD framework in CARLA, an open-source urban driving simulator. We introduce multiple non-player agents in CARLA and induce temporal noise in them for realistic stochasticity.

📄 PDF Abstract BibTeX arXiv:1808.10393

Code (1)

AshishMehtaIO/MTLfD-CARLA tf

Tasks

Autonomous DrivingMulti-Task Learning

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…

Similar Papers 제목 키워드 기반

Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Driving

2026-07-05 · Zhiran Yan, Gordon Elger arxiv

Traditional semantic segmentation models operate under a closed-set assumption and struggle to recognize unknown or unexpected objects-an essential capability for autonomous driving. As a result, such models often miscla…

Semantic SegmentationAutonomous Driving

TGRIP: A Text-Guided Approach to Vehicle Instance Prediction in Autonomous Driving

2026-07-06 · Miguel Antunes-García, Santiago Montiel-Marín, Fabio Sánchez-García, Rodrigo Gutiérrez-Moreno 외 arxiv

Bird's-Eye View (BEV) end-to-end instance prediction has emerged as a robust paradigm for autonomous driving perception, effectively mitigating the error propagation inherent in traditional modular pipelines. However, cu…

Autonomous Driving

NavigScene: Bridging Local Perception and Global Navigation for Beyond-Visual-Range Autonomous Driving

2025-07-07 · Qucheng Peng, Chen Bai, Guoxiang Zhang, Bo Xu 외 arxiv

Autonomous driving systems have made significant advances in Q&A, perception, prediction, and planning based on local visual information, yet they struggle to incorporate broader navigational context that human drivers r…

Reinforcement LearningAutonomous Driving

LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model

2026-05-21 · Xiaodong Mei, Diankun Zhang, Hongwei Xie, Guang Chen 외 arxiv

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene un…

Representation LearningImage ReconstructionScene UnderstandingAutonomous Driving

TraVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval

2026-08-13 · Yi-Chung Chen, Philip Jacobson, Tom Lampo, Yiren Lu 외 arxiv

Efficiently retrieving relevant clips from large-scale driving logs is essential for data curation, model development, and safety analysis. Structured and rule-based retrieval systems can explicitly target driving events…

Video Retrieval