paper-with-me

홈 › Papers

View-Invariant Localization using Semantic Objects in Changing Environments

2022-09-28 · Jacqueline Ankenbauer, Kaveh Fathian, Jonathan P. How

This paper proposes a novel framework for real-time localization and egomotion tracking of a vehicle in a reference map. The core idea is to map the semantic objects observed by the vehicle and register them to their corresponding objects in the reference map. While several recent works have leveraged semantic information for cross-view localization, the main contribution of this work is a view-invariant formulation that makes the approach directly applicable to any viewpoint configuration for which objects are detectable. Another distinctive feature is robustness to changes in the environment/objects due to a data association scheme suited for extreme outlier regimes (e.g., 90% association outliers). To demonstrate our framework, we consider an example of localizing a ground vehicle in a reference object map using only cars as objects. While only a stereo camera is used for the ground vehicle, we consider reference maps constructed a priori from ground viewpoints using stereo cameras and Lidar scans, and georeferenced aerial images captured at a different date to demonstrate the framework's robustness to different modalities, viewpoints, and environment changes. Evaluations on the KITTI dataset show that over a 3.7 km trajectory, localization occurs in 36 sec and is followed by real-time egomotion tracking with an average position error of 8.5 m in a Lidar reference map, and on an aerial object map where 77% of objects are outliers, localization is achieved in 71 sec with an average position error of 7.9 m.

📄 PDF Abstract BibTeX arXiv:2209.14426

Code (0)

등록된 구현이 없습니다.

Tasks

Position

Similar Papers 제목 키워드 기반

Retrieval-based Localization Based on Domain-invariant Feature Learning under Changing Environments

2019-09-23 · Hanjiang Hu, Hesheng Wang, Zhe Liu, Chenguang Yang 외

Visual localization is a crucial problem in mobile robotics and autonomous driving. One solution is to retrieve images with known pose from a database for the localization of query images. However, in environments with d…

Autonomous DrivingRetrievalTranslationVisual Localization

Towards View-invariant and Accurate Loop Detection Based on Scene Graph

2023-05-24 · Chuhao Liu, Shaojie Shen

Loop detection plays a key role in visual Simultaneous Localization and Mapping (SLAM) by correcting the accumulated pose drift. In indoor scenarios, the richly distributed semantic landmarks are view-point invariant and…

DescriptiveSimultaneous Localization and Mapping

S-BEV: Semantic Birds-Eye View Representation for Weather and Lighting Invariant 3-DoF Localization

2021-01-23 · Mokshith Voodarla, Shubham Shrivastava, Sagar Manglani, Ankit Vora 외

We describe a light-weight, weather and lighting invariant, Semantic Bird's Eye View (S-BEV) signature for vision-based vehicle re-localization. A topological map of S-BEV signatures is created during the first traversal…

Robust Visual Localization via Semantic-Guided Multi-Scale Transformer

2025-06-10 · Zhongtao Tian, Wenhao Huang, Zhidong Chen, Xiao Wei Sun

Visual localization remains challenging in dynamic environments where fluctuating lighting, adverse weather, and moving objects disrupt appearance cues. Despite advances in feature representation, current absolute pose r…

regressionScene UnderstandingVisual Localization

All-pairs Consistency Learning for Weakly Supervised Semantic Segmentation

2023-08-08 · Weixuan Sun, Yanhao Zhang, Zhen Qin, Zheyuan Liu 외

In this work, we propose a new transformer-based regularization to better localize objects for Weakly supervised semantic segmentation (WSSS). In image-level WSSS, Class Activation Map (CAM) is adopted to generate object…

AllObject LocalizationSemantic SegmentationWeakly supervised Semantic Segmentation+1