MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes
This work addresses the semantic segmentation of images of street scenes for autonomous vehicles based on a new RGB-Thermal dataset, which is also introduced in this paper. An increasing interest in self-driving vehicles has brought the adaptation of semantic segmentation to self-driving systems. However, recent research relating to semantic segmentation is mainly based on RGB images acquired during times of poor visibility at night and under adverse weather conditions. Furthermore, most of these methods only focused on improving performance while ignoring time consumption. The aforementioned problems prompted us to propose a new convolutional neural network architecture for multi-spectral image segmentation that enables the segmentation accuracy to be retained during real-time operation. We benchmarked our method by creating an RGB-Thermal dataset in which thermal and RGB images are combined. We showed that the segmentation accuracy was significantly increased by adding thermal infrared information.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesImage SegmentationReal-Time Semantic SegmentationSegmentationSemantic SegmentationThermal Image SegmentationSimilar Papers 제목 키워드 기반
MFNet: Multi-Feature Fusion Network for Real-Time Semantic Segmentation in Road Scenes
Although high-accuracy networks have been applied to semantic segmentation at present, their inference speeds remain slow. A trade-off between accuracy and speed is demanded for real-time applications. To approach this p…
Real-Time Semantic SegmentationSemantic SegmentationAttention-based Multi-modal Fusion Network for Semantic Scene Completion
This paper presents an end-to-end 3D convolutional network named attention-based multi-modal fusion network (AMFNet) for the semantic scene completion (SSC) task of inferring the occupancy and semantic labels of a volume…
2D Semantic Segmentation3D Semantic Scene CompletionSegmentationSemantic SegmentationLMFNet: An Efficient Multimodal Fusion Approach for Semantic Segmentation in High-Resolution Remote Sensing
Despite the rapid evolution of semantic segmentation for land cover classification in high-resolution remote sensing imagery, integrating multiple data modalities such as Digital Surface Model (DSM), RGB, and Near-infrar…
Land Cover ClassificationSemantic SegmentationCSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenes
Semantic segmentation, as a crucial component of complex visual interpretation, plays a fundamental role in autonomous vehicle vision systems. Recent studies have significantly improved the accuracy of semantic segmentat…
Autonomous VehiclesImage SegmentationReal-Time Semantic SegmentationRGBD Semantic Segmentation+4Context-Aware Interaction Network for RGB-T Semantic Segmentation
RGB-T semantic segmentation is a key technique for autonomous driving scenes understanding. For the existing RGB-T semantic segmentation methods, however, the effective exploration of the complementary relationship betwe…
Autonomous DrivingSemantic SegmentationThermal Image Segmentation