Task-Driven Deep Image Enhancement Network for Autonomous Driving in Bad Weather
Visual perception in autonomous driving is a crucial part of a vehicle to navigate safely and sustainably in different traffic conditions. However, in bad weather such as heavy rain and haze, the performance of visual perception is greatly affected by several degrading effects. Recently, deep learning-based perception methods have addressed multiple degrading effects to reflect real-world bad weather cases but have shown limited success due to 1) high computational costs for deployment on mobile devices and 2) poor relevance between image enhancement and visual perception in terms of the model ability. To solve these issues, we propose a task-driven image enhancement network connected to the high-level vision task, which takes in an image corrupted by bad weather as input. Specifically, we introduce a novel low memory network to reduce most of the layer connections of dense blocks for less memory and computational cost while maintaining high performance. We also introduce a new task-driven training strategy to robustly guide the high-level task model suitable for both high-quality restoration of images and highly accurate perception. Experiment results demonstrate that the proposed method improves the performance among lane and 2D object detection, and depth estimation largely under adverse weather in terms of both low memory and accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
2D Object DetectionAutonomous DrivingDepth EstimationImage EnhancementNavigateobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DarkDriving: A Real-World Day and Night Aligned Dataset for Autonomous Driving in the Dark Environment
The low-light conditions are challenging to the vision-centric perception systems for autonomous driving in the dark environment. In this paper, we propose a new benchmark dataset (named DarkDriving) to investigate the l…
Autonomous DrivingOD-RASE: Ontology-Driven Risk Assessment and Safety Enhancement for Autonomous Driving
Although autonomous driving systems demonstrate high perception performance, they still face limitations when handling rare situations or complex road structures. Such road infrastructures are designed for human drivers,…
Autonomous DrivingRainSD: Rain Style Diversification Module for Image Synthesis Enhancement using Feature-Level Style Distribution
Autonomous driving technology nowadays targets to level 4 or beyond, but the researchers are faced with some limitations for developing reliable driving algorithms in diverse challenges. To promote the autonomous vehicle…
Autonomous DrivingAutonomous VehiclesDataset GenerationImage Generation+8HawkDrive: A Transformer-driven Visual Perception System for Autonomous Driving in Night Scene
Many established vision perception systems for autonomous driving scenarios ignore the influence of light conditions, one of the key elements for driving safety. To address this problem, we present HawkDrive, a novel per…
Autonomous DrivingDepth EstimationEdge-computingSegmentation+1AllWeatherNet:Unified Image Enhancement for Autonomous Driving under Adverse Weather and Lowlight-conditions
Adverse conditions like snow, rain, nighttime, and fog, pose challenges for autonomous driving perception systems. Existing methods have limited effectiveness in improving essential computer vision tasks, such as semanti…
Autonomous DrivingDeep AttentionImage EnhancementRain Removal+1