Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Driving
This study investigates the effectiveness of modern Deformable Convolutional Neural Networks (DCNNs) for semantic segmentation tasks, particularly in autonomous driving scenarios with fisheye images. These images, providing a wide field of view, pose unique challenges for extracting spatial and geometric information due to dynamic changes in object attributes. Our experiments focus on segmenting the WoodScape fisheye image dataset into ten distinct classes, assessing the Deformable Networks' ability to capture intricate spatial relationships and improve segmentation accuracy. Additionally, we explore different loss functions to address class imbalance issues and compare the performance of conventional CNN architectures with Deformable Convolution-based CNNs, including Vanilla U-Net and Residual U-Net architectures. The significant improvement in mIoU score resulting from integrating Deformable CNNs demonstrates their effectiveness in handling the geometric distortions present in fisheye imagery, exceeding the performance of traditional CNN architectures. This underscores the significant role of Deformable convolution in enhancing semantic segmentation performance for fisheye imagery.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Restricted Deformable Convolution based Road Scene Semantic Segmentation Using Surround View Cameras
Understanding the surrounding environment of the vehicle is still one of the challenges for autonomous driving. This paper addresses 360-degree road scene semantic segmentation using surround view cameras, which are wide…
Autonomous DrivingMulti-Task LearningSegmentationSemantic SegmentationAD-SAM: Fine-Tuning the Segment Anything Vision Foundation Model for Autonomous Driving Perception
This paper presents the Autonomous Driving Segment Anything Model (AD-SAM), a fine-tuned vision foundation model for semantic segmentation in autonomous driving (AD). AD-SAM extends the Segment Anything Model (SAM) with …
Semantic SegmentationDomain GeneralizationAutonomous DrivingSpatiotemporal Deformable Scene Graphs for Complex Activity Detection
Long-term complex activity recognition and localisation can be crucial for decision making in autonomous systems such as smart cars and surgical robots. Here we address the problem via a novel deformable, spatiotemporal …
Action DetectionActivity DetectionActivity RecognitionAutonomous Driving+1Deformable-Heatmap-Segmentation for Automobile Visual Perception
Semantic segmentation of road elements in 2D images is a crucial task in the recognition of some static objects such as lane lines and free space. In this paper, we propose DHSNet,which extracts the objects features with…
Semantic SegmentationTwin Deformable Point Convolutions for Point Cloud Semantic Segmentation in Remote Sensing Scenes
Thanks to the application of deep learning technology in point cloud processing of the remote sensing field, point cloud segmentation has become a research hotspot in recent years, which can be applied to real-world 3D, …
Point Cloud SegmentationSegmentationSemantic Segmentation