Night-time Scene Parsing with a Large Real Dataset
Although huge progress has been made on scene analysis in recent years, most existing works assume the input images to be in day-time with good lighting conditions. In this work, we aim to address the night-time scene parsing (NTSP) problem, which has two main challenges: 1) labeled night-time data are scarce, and 2) over- and under-exposures may co-occur in the input night-time images and are not explicitly modeled in existing pipelines. To tackle the scarcity of night-time data, we collect a novel labeled dataset, named {\it NightCity}, of 4,297 real night-time images with ground truth pixel-level semantic annotations. To our knowledge, NightCity is the largest dataset for NTSP. In addition, we also propose an exposure-aware framework to address the NTSP problem through augmenting the segmentation process with explicitly learned exposure features. Extensive experiments show that training on NightCity can significantly improve NTSP performances and that our exposure-aware model outperforms the state-of-the-art methods, yielding top performances on our dataset as well as existing datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Scene ParsingSemantic SegmentationSimilar Papers 제목 키워드 기반
Boosting Night-time Scene Parsing with Learnable Frequency
Night-Time Scene Parsing (NTSP) is essential to many vision applications, especially for autonomous driving. Most of the existing methods are proposed for day-time scene parsing. They rely on modeling pixel intensity-bas…
Autonomous DrivingScene ParsingPIG: Prompt Images Guidance for Night-Time Scene Parsing
Night-time scene parsing aims to extract pixel-level semantic information in night images, aiding downstream tasks in understanding scene object distribution. Due to limited labeled night image datasets, unsupervised dom…
Data AugmentationDomain AdaptationPseudo LabelScene Parsing+1What's There in the Dark
Scene Parsing is an important cog for modern autonomous driving systems. Most of the works in semantic segmentation pertains to day-time scenes with favourable weather and illumination conditions. In this paper, we propo…
Autonomous DrivingScene ParsingSemantic SegmentationWhat's There in the Dark
Scene Parsing is an important cog for modern autonomousdriving systems. Most of the works in semantic segmenta-tion pertains to day-time scenes with favourable weather andillumination conditions. In this p…
Scene ParsingSemantic SegmentationImproving Panoptic Segmentation for Nighttime or Low-Illumination Urban Driving Scenes
Autonomous vehicles and driving systems use scene parsing as an essential tool to understand the surrounding environment. Panoptic segmentation is a state-of-the-art technique which proves to be pivotal in this use case.…
Autonomous VehiclesPanoptic SegmentationScene ParsingSegmentation