paper-with-me

Papers

Robust Visual Localization via Semantic-Guided Multi-Scale Transformer

2025-06-10 · Zhongtao Tian, Wenhao Huang, Zhidong Chen, Xiao Wei Sun

Visual localization remains challenging in dynamic environments where fluctuating lighting, adverse weather, and moving objects disrupt appearance cues. Despite advances in feature representation, current absolute pose regression methods struggle to maintain consistency under varying conditions. To address this challenge, we propose a framework that synergistically combines multi-scale feature learning with semantic scene understanding. Our approach employs a hierarchical Transformer with cross-scale attention to fuse geometric details and contextual cues, preserving spatial precision while adapting to environmental changes. We improve the performance of this architecture with semantic supervision via neural scene representation during training, guiding the network to learn view-invariant features that encode persistent structural information while suppressing complex environmental interference. Experiments on TartanAir demonstrate that our approach outperforms existing pose regression methods in challenging scenarios with dynamic objects, illumination changes, and occlusions. Our findings show that integrating multi-scale processing with semantic guidance offers a promising strategy for robust visual localization in real-world dynamic environments.

📄 PDF Abstract BibTeX arXiv:2506.08526

Code (0)

등록된 구현이 없습니다.

Tasks

regressionScene UnderstandingVisual Localization

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Adam 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

AG-VAS: Anchor-Guided Zero-Shot Visual Anomaly Segmentation with Large Multimodal Models

2026-03-01 · Zhen Qu, Xian Tao, Xiaoyi Bao, Dingrong Wang 외 arxiv

Large multimodal models (LMMs) exhibit strong task generalization capabilities, offering new opportunities for zero-shot visual anomaly segmentation (ZSAS). However, existing LMM-based segmentation approaches still face …

Semantic-Guided Multi-Attention Localization for Zero-Shot Learning

2019-03-01 · NeurIPS 2019 12 · Yizhe Zhu, Jianwen Xie, Zhiqiang Tang, Xi Peng 외

Zero-shot learning extends the conventional object classification to the unseen class recognition by introducing semantic representations of classes. Existing approaches predominantly focus on learning the proper mapping…

TripletZero-Shot Learning

UniGeo: A Multi-modal Large Language Model for Text-Guided Cross-View Geo-Localization

2026-08-27 · Jiahao Wen, Hang Yu, Zhedong Zheng arxiv

Text-guided drone geo-localization aims to identify a target region in a large-scale image gallery from a natural-language description. Existing methods mainly formulate this task as direct matching between an open-ended…

Imit Diff: Semantics Guided Diffusion Transformer with Dual Resolution Fusion for Imitation Learning

2025-02-11 · Yuhang Dong, Haizhou Ge, Yupei Zeng, Jiangning Zhang 외

Visuomotor imitation learning enables embodied agents to effectively acquire manipulation skills from video demonstrations and robot proprioception. However, as scene complexity and visual distractions increase, existing…

Imitation LearningVisual Localization

Audio-Visual Semantic Graph Network for Audio-Visual Event Localization

2025-01-01 · CVPR 2025 1 · Liang Liu, Shuaiyong Li, Yongqiang Zhu

Audio-visual event localization (AVEL) aims to identify both the category and temporal boundaries of events that are both audible and visible in unconstrained videos. However, the inherent semantic gap between hetero…

audio-visual event localizationcross-modal alignment