paper-with-me

홈 › Papers

PRIX: Learning to Plan from Raw Pixels for End-to-End Autonomous Driving

2025-07-23 · Maciej K. Wozniak, Lianhang Liu, Yixi Cai, Patric Jensfelt arxiv

While end-to-end autonomous driving models show promising results, their practical deployment is often hindered by large model sizes, a reliance on expensive LiDAR sensors and computationally intensive BEV feature representations. This limits their scalability, especially for mass-market vehicles equipped only with cameras. To address these challenges, we propose PRIX (Plan from Raw Pixels). Our novel and efficient end-to-end driving architecture operates using only camera data, without explicit BEV representation and forgoing the need for LiDAR. PRIX leverages a visual feature extractor coupled with a generative planning head to predict safe trajectories from raw pixel inputs directly. A core component of our architecture is the Context-aware Recalibration Transformer (CaRT), a novel module designed to effectively enhance multi-level visual features for more robust planning. We demonstrate through comprehensive experiments that PRIX achieves state-of-the-art performance on the NavSim and nuScenes benchmarks, matching the capabilities of larger, multimodal diffusion planners while being significantly more efficient in terms of inference speed and model size, making it a practical solution for real-world deployment. Our work is open-source and the code will be at https://maxiuw.github.io/prix.

📄 PDF Abstract BibTeX arXiv:2507.17596

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

Safety Metrics for Semantic Segmentation in Autonomous Driving

2021-05-21 · Chih-Hong Cheng, Alois Knoll, Hsuan-Cheng Liao

Within the context of autonomous driving, safety-related metrics for deep neural networks have been widely studied for image classification and object detection. In this paper, we further consider safety-aware correctnes…

Autonomous DrivingClusteringimage-classificationImage Classification+3

Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data

2022-03-30 · CVPR 2022 1 · Corentin Sautier, Gilles Puy, Spyros Gidaris, Alexandre Boulch 외

Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in autonomous driving to allow a vehicle to act safely in its 3D environment. The best performing methods in 3D semantic segmentation o…

3D Object Detection3D Semantic SegmentationAutonomous Drivingobject-detection+3

MIM4D: Masked Modeling with Multi-View Video for Autonomous Driving Representation Learning

2024-03-13 · Jialv Zou, Bencheng Liao, Qian Zhang, Wenyu Liu 외

Learning robust and scalable visual representations from massive multi-view video data remains a challenge in computer vision and autonomous driving. Existing pre-training methods either rely on expensive supervised lear…

3D Object DetectionAutonomous DrivingBEV Segmentationobject-detection+2

Feature Selective Small Object Detection via Knowledge-based Recurrent Attentive Neural Network

2018-03-13 · Kai Yi, Zhiqiang Jian, Shitao Chen, Nanning Zheng

At present, the performance of deep neural network in general object detection is comparable to or even surpasses that of human beings. However, due to the limitations of deep learning itself, the small proportion of fea…

Autonomous DrivingDecision MakingObjectobject-detection+3

Effects of Explanation Specificity on Passengers in Autonomous Driving

2023-07-02 · Daniel Omeiza, Raunak Bhattacharyya, Nick Hawes, Marina Jirotka 외

The nature of explanations provided by an explainable AI algorithm has been a topic of interest in the explainable AI and human-computer interaction community. In this paper, we investigate the effects of natural languag…

Autonomous DrivingExplanation GenerationSpecificity