paper-with-me

홈 › Papers

Real-time Fusion Network for RGB-D Semantic Segmentation Incorporating Unexpected Obstacle Detection for Road-driving Images

2020-02-24 · Lei Sun, Kailun Yang, Xinxin Hu, Weijian Hu, Kaiwei Wang

Semantic segmentation has made striking progress due to the success of deep convolutional neural networks. Considering the demands of autonomous driving, real-time semantic segmentation has become a research hotspot these years. However, few real-time RGB-D fusion semantic segmentation studies are carried out despite readily accessible depth information nowadays. In this paper, we propose a real-time fusion semantic segmentation network termed RFNet that effectively exploits complementary cross-modal information. Building on an efficient network architecture, RFNet is capable of running swiftly, which satisfies autonomous vehicles applications. Multi-dataset training is leveraged to incorporate unexpected small obstacle detection, enriching the recognizable classes required to face unforeseen hazards in the real world. A comprehensive set of experiments demonstrates the effectiveness of our framework. On Cityscapes, Our method outperforms previous state-of-the-art semantic segmenters, with excellent accuracy and 22Hz inference speed at the full 2048x1024 resolution, outperforming most existing RGB-D networks.

📄 PDF Abstract BibTeX arXiv:2002.10570

Code (1)

AHupuJR/RFNet 공식 구현 pytorch

Tasks

Autonomous DrivingAutonomous VehiclesReal-Time Semantic SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

On the Overconfidence Problem in Semantic 3D Mapping

2023-11-16 · Joao Marcos Correia Marques, Albert Zhai, Shenlong Wang, Kris Hauser

Semantic 3D mapping, the process of fusing depth and image segmentation information between multiple views to build 3D maps annotated with object classes in real-time, is a recent topic of interest. This paper highlights…

Image SegmentationSemantic Segmentation

Boundary Corrected Multi-scale Fusion Network for Real-time Semantic Segmentation

2022-03-01 · Tianjiao Jiang, Yi Jin, Tengfei Liang, Xu Wang 외

Image semantic segmentation aims at the pixel-level classification of images, which has requirements for both accuracy and speed in practical application. Existing semantic segmentation methods mainly rely on the high-re…

Real-Time Semantic SegmentationScene ParsingSegmentationSemantic Segmentation

DiffMap: Enhancing Map Segmentation with Map Prior Using Diffusion Model

2024-05-03 · Peijin Jia, Tuopu Wen, Ziang Luo, Mengmeng Yang 외

Constructing high-definition (HD) maps is a crucial requirement for enabling autonomous driving. In recent years, several map segmentation algorithms have been developed to address this need, leveraging advancements in B…

Autonomous DrivingSegmentationSemantic Segmentation

MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objects

2018-04-24 · Martin Rünz, Maud Buffier, Lourdes Agapito

We present MaskFusion, a real-time, object-aware, semantic and dynamic RGB-D SLAM system that goes beyond traditional systems which output a purely geometric map of a static scene. MaskFusion recognizes, segments and ass…

ObjectObject RecognitionObject SLAMSegmentation+3

InvSeg: Test-Time Prompt Inversion for Semantic Segmentation

2024-10-15 · Jiayi Lin, Jiabo Huang, Jian Hu, Shaogang Gong

Visual-textual correlations in the attention maps derived from text-to-image diffusion models are proven beneficial to dense visual prediction tasks, e.g., semantic segmentation. However, a significant challenge arises d…

Image GenerationOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic SegmentationSegmentation+1