Real-Time Freespace Segmentation on Autonomous Robots for Detection of Obstacles and Drop-Offs
Mobile robots navigating in indoor and outdoor environments must be able to identify and avoid unsafe terrain. Although a significant amount of work has been done on the detection of standing obstacles (solid obstructions), not much work has been done on the detection of negative obstacles (e.g. dropoffs, ledges, downward stairs). We propose a method of terrain safety segmentation using deep convolutional networks. Our custom semantic segmentation architecture uses a single camera as input and creates a freespace map distinguishing safe terrain and obstacles. We then show how this freespace map can be used for real-time navigation on an indoor robot. The results show that our system generalizes well, is suitable for real-time operation, and runs at around 55 fps on a small indoor robot powered by a low-power embedded GPU.
Code (0)
등록된 구현이 없습니다.
Tasks
GPUSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Cross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baseline
As one of the fundamental functions of autonomous driving system, freespace detection aims at classifying each pixel of the image captured by the camera as drivable or non-drivable. Current works of freespace detection h…
Autonomous DrivingDomain AdaptationSemantic SegmentationUnsupervised Domain AdaptationSNE-RoadSeg+: Rethinking Depth-Normal Translation and Deep Supervision for Freespace Detection
Freespace detection is a fundamental component of autonomous driving perception. Recently, deep convolutional neural networks (DCNNs) have achieved impressive performance for this task. In particular, SNE-RoadSeg, our pr…
Autonomous DrivingSurface Normal EstimationTranslationSNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detection
Freespace detection is an essential component of visual perception for self-driving cars. The recent efforts made in data-fusion convolutional neural networks (CNNs) have significantly improved semantic driving scene seg…
Scene SegmentationSelf-Driving CarsSemantic SegmentationTowards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark
Off-road nighttime autonomous driving suffers from unreliable visible-light perception, making infrared modality crucial for accurate freespace detection. However, progress remains limited due to the scarcity of annotate…
Autonomous DrivingSafe Local Motion Planning With Self-Supervised Freespace Forecasting
Safe local motion planning for autonomous driving in dynamic environments requires forecasting how the scene evolves. Practical autonomy stacks adopt a semantic object-centric representation of a dynamic scene and bu…
Autonomous DrivingMotion Planningobject-detectionObject Detection+1