paper-with-me

홈 › Papers

Restricted Deformable Convolution based Road Scene Semantic Segmentation Using Surround View Cameras

2018-01-02 · Liuyuan Deng, Ming Yang, Hao Li, Tianyi Li, Bing Hu, Chunxiang Wang

Understanding the surrounding environment of the vehicle is still one of the challenges for autonomous driving. This paper addresses 360-degree road scene semantic segmentation using surround view cameras, which are widely equipped in existing production cars. First, in order to address large distortion problem in the fisheye images, Restricted Deformable Convolution (RDC) is proposed for semantic segmentation, which can effectively model geometric transformations by learning the shapes of convolutional filters conditioned on the input feature map. Second, in order to obtain a large-scale training set of surround view images, a novel method called zoom augmentation is proposed to transform conventional images to fisheye images. Finally, an RDC based semantic segmentation model is built; the model is trained for real-world surround view images through a multi-task learning architecture by combining real-world images with transformed images. Experiments demonstrate the effectiveness of the RDC to handle images with large distortions, and that the proposed approach shows a good performance using surround view cameras with the help of the transformed images.

📄 PDF Abstract BibTeX arXiv:1801.00708

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingMulti-Task LearningSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Deformable Convolution Deformable convolutions add 2D offsets to the regular grid sampling locations in the standard convolution. It enables free…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Driving

2024-07-23 · Anam Manzoor, Aryan Singh, Ganesh Sistu, Reenu Mohandas 외

This study investigates the effectiveness of modern Deformable Convolutional Neural Networks (DCNNs) for semantic segmentation tasks, particularly in autonomous driving scenarios with fisheye images. These images, provid…

Autonomous DrivingSegmentationSemantic Segmentation

Spatiotemporal Deformable Scene Graphs for Complex Activity Detection

2021-04-16 · Salman Khan, Fabio Cuzzolin

Long-term complex activity recognition and localisation can be crucial for decision making in autonomous systems such as smart cars and surgical robots. Here we address the problem via a novel deformable, spatiotemporal …

Action DetectionActivity DetectionActivity RecognitionAutonomous Driving+1

Spatiotemporal Event Graphs for Dynamic Scene Understanding

2023-12-11 · Salman Khan

Dynamic scene understanding is the ability of a computer system to interpret and make sense of the visual information present in a video of a real-world scene. In this thesis, we present a series of frameworks for dynami…

Action DetectionActivity DetectionAutonomous DrivingContinual Learning+3

Efficient Dynamic Scene Deblurring Using Spatially Variant Deconvolution Network With Optical Flow Guided Training

2020-06-01 · CVPR 2020 6 · Yuan Yuan, Wei Su, Dandan Ma

In order to remove the non-uniform blur of images captured from dynamic scenes, many deep learning based methods design deep networks for large receptive fields and strong fitting capabilities, or use multi-scale strateg…

DeblurringImage RestorationOptical Flow Estimation

AD-SAM: Fine-Tuning the Segment Anything Vision Foundation Model for Autonomous Driving Perception

2025-10-30 · Mario Camarena, Het Patel, Fatemeh Nazari, Evangelos Papalexakis 외 arxiv

This paper presents the Autonomous Driving Segment Anything Model (AD-SAM), a fine-tuned vision foundation model for semantic segmentation in autonomous driving (AD). AD-SAM extends the Segment Anything Model (SAM) with …

Semantic SegmentationDomain GeneralizationAutonomous Driving