Semantic Match Consistency for Long-Term Visual Localization
Robust and accurate visual localization across large appearance variations due to changes in time of day, seasons, or changes of the environment is a challenging problem which is of importance to application areas such as navigation of autonomous robots. Traditional feature-based methods often struggle in these conditions due to the significant number of erroneous matches between the image and the 3D model. In this paper, we present a method for scoring the individual correspondences by exploiting semantic information about the query image and the scene. In this way, erroneous correspondences tend to get a low semantic consistency score, whereas correct correspondences tend to get a high score. By incorporating this information in a standard localization pipeline, we show that the localization performance can be significantly improved compared to the state-of-the-art, as evaluated on two challenging long-term localization benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Visual LocalizationSimilar Papers 제목 키워드 기반
Dense Semantic 3D Map Based Long-Term Visual Localization with Hybrid Features
Visual localization plays an important role in many applications. However, due to the large appearance variations such as season and illumination changes, as well as weather and day-night variations, it's still a big cha…
Visual LocalizationVisual Localization Using Semantic Segmentation and Depth Prediction
In this paper, we propose a monocular visual localization pipeline leveraging semantic and depth cues. We apply semantic consistency evaluation to rank the image retrieval results and a practical clustering technique to …
ClusteringDepth EstimationDepth PredictionImage Retrieval+5Visual Localization Using Sparse Semantic 3D Map
Accurate and robust visual localization under a wide range of viewing condition variations including season and illumination changes, as well as weather and day-night variations, is the key component for many computer vi…
Visual LocalizationLanguage-Guided Audio-Visual Learning for Long-Term Sports Assessment
Long-term sports assessment is a challenging task in video understanding since it requires judging complex movement variations and action-music coordination. However, there is no direct correlation between the divers…
audio-visual learningKnowledge GraphsVideo UnderstandingSoap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration
We study series-level cinematic remaking, a long-horizon video-to-video generation problem that localizes full episodes or films via stylization or actor replacement while strictly preserving narrative structure, motion …
Video Generation