VSO: Visual Semantic Odometry
Robust data association is a core problem of visual odometry, where image-to-image correspondences provide constraints for camera pose and map estimation. Current state-of-the-art direct and indirect methods use short-term tracking to obtain continuous frame-to-frame constraints, while long-term constraints are established using loop closures. In this paper, we propose a novel visual semantic odometry (VSO) framework to enable medium-term continuous tracking of points using semantics. Our proposed framework can be easily integrated into existing direct and indirect visual odometry pipelines. Experiments on challenging real-world datasets demonstrate a significant improvement over state-of-the-art baselines in the context of autonomous driving simply by integrating our semantic constraints.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingVisual OdometrySimilar Papers 제목 키워드 기반
Pseudo-LiDAR for Visual Odometry
In the existing methods, LiDAR odometry shows superior performance, but visual odometry is still widely used for its price advantage. Conventionally, the task of visual odometry mainly rely on the input of continuous ima…
Stereo MatchingVisual OdometrySalientDSO: Bringing Attention to Direct Sparse Odometry
Although cluttered indoor scenes have a lot of useful high-level semantic information which can be used for mapping and localization, most Visual Odometry (VO) algorithms rely on the usage of geometric features such as p…
feature selectionScene ParsingVisual OdometryMVOFormer: Flow-Semantic Transformer for Robust Monocular Visual Odometry
Monocular visual odometry (MVO) is foundational to autonomous navigation and robotic localization. However, existing learning-based MVO approaches often struggle with either a lack of interpretable, complementary feature…
Zero-shot GeneralizationDomain GeneralizationVisual OdometrySemantic Nearest Neighbor Fields Monocular Edge Visual-Odometry
Recent advances in deep learning for edge detection and segmentation opens up a new path for semantic-edge-based ego-motion estimation. In this work, we propose a robust monocular visual odometry (VO) framework using cat…
Edge DetectionMonocular Visual OdometryMotion EstimationVisual OdometryViLiVO: Virtual LiDAR-Visual Odometry for an Autonomous Vehicle with a Multi-Camera System
In this paper, we present a multi-camera visual odometry (VO) system for an autonomous vehicle. Our system mainly consists of a virtual LiDAR and a pose tracker. We use a perspective transformation method to synthesize a…
Monocular Visual OdometryPose EstimationSemantic SegmentationVisual Odometry