RailSem19: A Dataset for Semantic Rail Scene Understanding
Solving tasks for autonomous road vehicles using com-puter vision is a dynamic and active research field. How-ever, one aspect of autonomous transportation has receivedlittle contributions: the rail domain. In this paper, we intro-duce the first public dataset for semantic scene understand-ing for trains and trams: RailSem19. This dataset consistsof 8500 annotated short sequences from the ego-perspectiveof trains, including over 1000 examples with railway cross-ings and 1200 tram scenes. Since it is the first image datasettargeting the rail domain, a novel label policy has been de-signed from scratch. It focuses on rail-specific labels notcovered by any other datasets. In addition to manual an-notations in the form of geometric shapes, we also supplydense pixel-wise semantic labeling. The dense labeling isa semantic-aware combination of (a) the geometric shapesand (b) weakly supervised annotations generated by exist-ing semantic segmentation networks from the road domain.Finally, multiple experiments give a first impression on howthe new dataset can be used to improve semantic sceneunderstanding in the rail environment. We present proto-types for the image-based classification of trains, switches,switch states, platforms, buffer stops, rail traffic signs andrail traffic lights. Applying transfer learning, we presentan early prototype for pixel-wise semantic segmentation onrail scenes. The resulting predictions show that this newdata also significantly improves scene understanding in sit-uations where cars and trains interact
Code (0)
등록된 구현이 없습니다.
Tasks
Scene UnderstandingSemantic SegmentationTransfer LearningSimilar Papers 제목 키워드 기반
RailSafeNet: Visual Scene Understanding for Tram Safety
Tram-human interaction safety is an important challenge, given that trams frequently operate in densely populated areas, where collisions can range from minor injuries to fatal outcomes. This paper addresses the issue fr…
Semantic SegmentationScene UnderstandingObject DetectionTrain Ego-Path Detection on Railway Tracks Using End-to-End Deep Learning
This paper introduces the task of "train ego-path detection", a refined approach to railway track detection designed for intelligent onboard vision systems. Whereas existing research lacks precision and often considers a…
Train Ego-Path DetectionEdge-Enabled Real-time Railway Track Segmentation
Accurate and rapid railway track segmentation can assist automatic train driving and is a key step in early warning to fixed or moving obstacles on the railway track. However, certain existing algorithms tailored for tra…
GPUQuantizationSegmentationFrom depth image to semantic scene synthesis through point cloud classification and labeling: Application to assistive systems
The aim of this work is to provide a semantic scene synthesis from depth image. First, depth image is segmented and each segment is classified in the context of assistive systems using a deep learning network. Second, in…
Point Cloud ClassificationAutonomous Hiking Trail Navigation via Semantic Segmentation and Geometric Analysis
Natural environments pose significant challenges for autonomous robot navigation, particularly due to their unstructured and ever-changing nature. Hiking trails, with their dynamic conditions influenced by weather, veget…
NavigateRobot NavigationSemantic Segmentation