Real-time Semantic Segmentation with Context Aggregation Network
With the increasing demand of autonomous systems, pixelwise semantic segmentation for visual scene understanding needs to be not only accurate but also efficient for potential real-time applications. In this paper, we propose Context Aggregation Network, a dual branch convolutional neural network, with significantly lower computational costs as compared to the state-of-the-art, while maintaining a competitive prediction accuracy. Building upon the existing dual branch architectures for high-speed semantic segmentation, we design a cheap high resolution branch for effective spatial detailing and a context branch with light-weight versions of global aggregation and local distribution blocks, potent to capture both long-range and local contextual dependencies required for accurate semantic segmentation, with low computational overheads. We evaluate our method on two semantic segmentation datasets, namely Cityscapes dataset and UAVid dataset. For Cityscapes test set, our model achieves state-of-the-art results with mIOU of 75.9%, at 76 FPS on an NVIDIA RTX 2080Ti and 8 FPS on a Jetson Xavier NX. With regards to UAVid dataset, our proposed network achieves mIOU score of 63.5% with high execution speed (15 FPS).
Code (0)
등록된 구현이 없습니다.
Tasks
Real-Time Semantic SegmentationScene UnderstandingSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Multi-Branch Aggregation Network for Real-Time Semantic Segmentation in Street Scenes
Real-time semantic segmentation, which aims to achieve high segmentation accuracy at real-time inference speed, has received substantial attention over the past few years. However, many state-of-the-art real-time semanti…
DecoderGPUReal-Time Semantic SegmentationSegmentation+1FarSee-Net: Real-Time Semantic Segmentation by Efficient Multi-scale Context Aggregation and Feature Space Super-resolution
Real-time semantic segmentation is desirable in many robotic applications with limited computation resources. One challenge of semantic segmentation is to deal with the object scale variations and leverage the context. H…
GPUReal-Time Semantic SegmentationSemantic SegmentationSuper-ResolutionBiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation
The low-level details and high-level semantics are both essential to the semantic segmentation task. However, to speed up the model inference, current approaches almost always sacrifice the low-level details, which leads…
Real-Time Semantic SegmentationSegmentationSemantic SegmentationReal-Time Semantic Segmentation via Auto Depth, Downsampling Joint Decision and Feature Aggregation
To satisfy the stringent requirements on computational resources in the field of real-time semantic segmentation, most approaches focus on the hand-crafted design of light-weight segmentation networks. Recently, Neural A…
GPUNeural Architecture SearchReal-Time Semantic SegmentationSegmentation+1Active Learning with Context Sampling and One-vs-Rest Entropy for Semantic Segmentation
Multi-class semantic segmentation remains a cornerstone challenge in computer vision. Yet, dataset creation remains excessively demanding in time and effort, especially for specialized domains. Active Learning (AL) mitig…
Active LearningBoundary DetectionSegmentationSemantic Segmentation