Long-term Visual Localization using Semantically Segmented Images
Robust cross-seasonal localization is one of the major challenges in long-term visual navigation of autonomous vehicles. In this paper, we exploit recent advances in semantic segmentation of images, i.e., where each pixel is assigned a label related to the type of object it represents, to attack the problem of long-term visual localization. We show that semantically labeled 3-D point maps of the environment, together with semantically segmented images, can be efficiently used for vehicle localization without the need for detailed feature descriptors (SIFT, SURF, etc.). Thus, instead of depending on hand-crafted feature descriptors, we rely on the training of an image segmenter. The resulting map takes up much less storage space compared to a traditional descriptor based map. A particle filter based semantic localization solution is compared to one based on SIFT-features, and even with large seasonal variations over the year we perform on par with the larger and more descriptive SIFT-features, and are able to localize with an error below 1 m most of the time.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesDescriptiveSemantic SegmentationVisual LocalizationVisual NavigationSimilar Papers 제목 키워드 기반
Semantic Pose Verification for Outdoor Visual Localization with Self-supervised Contrastive Learning
Any city-scale visual localization system has to overcome long-term appearance changes, such as varying illumination conditions or seasonal changes between query and database images. Since semantic content is more robust…
Contrastive LearningSemantic SimilaritySemantic Textual SimilarityVisual LocalizationCoarse-To-Fine Visual Localization Using Semantic Compact Map
Robust visual localization for urban vehicles remains challenging and unsolved. The limitation of computation efficiency and memory size has made it harder for large-scale applications. Since semantic information serves …
TranslationVisual LocalizationTraining Semantic Descriptors for Image-Based Localization
Vision based solutions for the localization of vehicles have become popular recently. We employ an image retrieval based visual localization approach. The database images are kept with GPS coordinates and the location of…
Image-Based LocalizationImage RetrievalPositionRetrieval+1Semantic Image Alignment for Vehicle Localization
Accurate and reliable localization is a fundamental requirement for autonomous vehicles to use map information in higher-level tasks such as navigation or planning. In this paper, we present a novel approach to vehicle l…
Autonomous VehiclesSemantic SegmentationVisual LocalizationNetwork Uncertainty Informed Semantic Feature Selection for Visual SLAM
In order to facilitate long-term localization using a visual simultaneous localization and mapping (SLAM) algorithm, careful feature selection can help ensure that reference points persist over long durations and the run…
feature selectionSemantic SegmentationSimultaneous Localization and MappingVisual Odometry