Driving Scene Perception Network: Real-time Joint Detection, Depth Estimation and Semantic Segmentation

2018-03-10 · Liangfu Chen, Zeng Yang, Jianjun Ma, Zheng Luo

As the demand for enabling high-level autonomous driving has increased in recent years and visual perception is one of the critical features to enable fully autonomous driving, in this paper, we introduce an efficient approach for simultaneous object detection, depth estimation and pixel-level semantic segmentation using a shared convolutional architecture. The proposed network model, which we named Driving Scene Perception Network (DSPNet), uses multi-level feature maps and multi-task learning to improve the accuracy and efficiency of object detection, depth estimation and image segmentation tasks from a single input image. Hence, the resulting network model uses less than 850 MiB of GPU memory and achieves 14.0 fps on NVIDIA GeForce GTX 1080 with a 1024x512 input image, and both precision and efficiency have been improved over combination of single tasks.

📄 PDF Abstract BibTeX arXiv:1803.03778

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Depth EstimationGPUImage Segmentation Multi-Task Learning object-detection Object Detection Segmentation Semantic Segmentation

StreamYOLO: Real-time Object Detection for Streaming Perception

2022-07-21 · Jinrong Yang, Songtao Liu, Zeming Li, Xiaoping Li 외

The perceptive models of autonomous driving require fast inference within a low latency for safety. While existing works ignore the inevitable environmental changes after processing, streaming perception jointly evaluate…

Autonomous Driving Object object-detection Object Detection+1

LiDAR-BEVMTN: Real-Time LiDAR Bird's-Eye View Multi-Task Perception Network for Autonomous Driving

2023-07-17 · Sambit Mohapatra, Senthil Yogamani, Varun Ravi Kumar, Stefan Milz 외

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, …

3D Object Detection Autonomous Driving Motion Estimation Motion Segmentation+6

A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving

2026-07-06 · Argho Dey, Yunfei Yin, Swachha Ray, Md Minhazul Islam 외 arxiv

Safe operation of autonomous vehicles in dense urban traffic depends on perception and planning that remain reliable when onboard sensing is degraded. In real driving conditions, camera observations are frequently corrup…

Computational Efficiency Autonomous Vehicles Scene Understanding Trajectory Planning

nuCarla: A nuScenes-Style Bird's-Eye View Perception Dataset for CARLA Simulation

2025-11-12 · Zhijie Qiao, Zhong Cao, Henry X. Liu arxiv

End-to-end (E2E) autonomous driving heavily relies on closed-loop simulation, where perception, planning, and control are jointly trained and evaluated in interactive environments. Yet, most existing datasets are collect…

Autonomous Driving

RadarMP: Motion Perception for 4D mmWave Radar in Autonomous Driving

2025-11-15 · Ruiqi Cheng, Huijun Di, Jian Li, Feng Liu 외 arxiv

Accurate 3D scene motion perception significantly enhances the safety and reliability of an autonomous driving system. Benefiting from its all-weather operational capability and unique perceptual properties, 4D mmWave ra…

Point Cloud Generation Autonomous Vehicles Autonomous Driving