Improving Road Segmentation in Challenging Domains Using Similar Place Priors
Road segmentation in challenging domains, such as night, snow or rain, is a difficult task. Most current approaches boost performance using fine-tuning, domain adaptation, style transfer, or by referencing previously acquired imagery. These approaches share one or more of three significant limitations: a reliance on large amounts of annotated training data that can be costly to obtain, both anticipation of and training data from the type of environmental conditions expected at inference time, and/or imagery captured from a previous visit to the location. In this research, we remove these restrictions by improving road segmentation based on similar places. We use Visual Place Recognition (VPR) to find similar but geographically distinct places, and fuse segmentations for query images and these similar place priors using a Bayesian approach and novel segmentation quality metric. Ablation studies show the need to re-evaluate notions of VPR utility for this task. We demonstrate the system achieving state-of-the-art road segmentation performance across multiple challenging condition scenarios including night time and snow, without requiring any prior training or previous access to the same geographical locations. Furthermore, we show that this method is network agnostic, improves multiple baseline techniques and is competitive against methods specialised for road prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationRoad SegmentationSegmentationStyle TransferVisual Place RecognitionSimilar Papers 제목 키워드 기반
Convolutional Prompting for Broad-Domain Retinal Vessel Segmentation
Previous research on retinal vessel segmentation is targeted at a specific image domain, mostly color fundus photography (CFP). In this paper we make a brave attempt to attack a more challenging task of broad-domain reti…
Retinal Vessel SegmentationSegmentationAttEntropy: On the Generalization Ability of Supervised Semantic Segmentation Transformers to New Objects in New Domains
In addition to impressive performance, vision transformers have demonstrated remarkable abilities to encode information they were not trained to extract. For example, this information can be used to perform segmentation …
Depth EstimationObjectScene SegmentationSegmentation+1Multi-modal Visual Place Recognition in Dynamics-Invariant Perception Space
Visual place recognition is one of the essential and challenging problems in the fields of robotics. In this letter, we for the first time explore the use of multi-modal fusion of semantic and visual modalities in dynami…
SegmentationSemantic SegmentationVisual Place RecognitionBoundary-based MWE segmentation with text partitioning
This work presents a fine-grained, text-chunking algorithm designed for the task of multiword expressions (MWEs) segmentation. As a lexical class, MWEs include a wide variety of idioms, whose automatic identification are…
ChunkingSegmentationDeciding What's Fair: Challenges of Applying Reinforcement Learning in Online Marketplaces
Reinforcement learning (RL) techniques offer a versatile and powerful extension to the toolkit for computer scientists and marketplace designers for their use in online marketplaces. As the use of these techniques contin…
Fairnessreinforcement-learningReinforcement Learning (RL)