Probabilistic Spatial Distribution Prior Based Attentional Keypoints Matching Network

2021-11-17 · Xiaoming Zhao, Jingmeng Liu, Xingming Wu, Weihai Chen, Fanghong Guo, Zhengguo Li

Keypoints matching is a pivotal component for many image-relevant applications such as image stitching, visual simultaneous localization and mapping (SLAM), and so on. Both handcrafted-based and recently emerged deep learning-based keypoints matching methods merely rely on keypoints and local features, while losing sight of other available sensors such as inertial measurement unit (IMU) in the above applications. In this paper, we demonstrate that the motion estimation from IMU integration can be used to exploit the spatial distribution prior of keypoints between images. To this end, a probabilistic perspective of attention formulation is proposed to integrate the spatial distribution prior into the attentional graph neural network naturally. With the assistance of spatial distribution prior, the effort of the network for modeling the hidden features can be reduced. Furthermore, we present a projection loss for the proposed keypoints matching network, which gives a smooth edge between matching and un-matching keypoints. Image matching experiments on visual SLAM datasets indicate the effectiveness and efficiency of the presented method.

📄 PDF Abstract BibTeX arXiv:2111.09006

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network Image StitchingMotion EstimationSimultaneous Localization and Mapping

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Attend and Guide (AG-Net): A Keypoints-driven Attention-based Deep Network for Image Recognition

2021-10-23 · Asish Bera, Zachary Wharton, Yonghuai Liu, Nik Bessis 외

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, …

Fine-Grained Image Recognition Image Classification

From Keypoints to Predictive Distributions: Post-Hoc Uncertainty for YOLO-Pose Models

2026-07-29 · Alexej Klushyn, Juan Rivero Sesma, Florian Seligmann, Richard Kurle 외 arxiv

YOLO-Pose models provide efficient keypoint localization, but do not quantify the associated spatial uncertainty. We introduce a lightweight post-hoc probabilistic extension that augments a trained YOLO-Pose model with c…

Siamese Attentional Keypoint Network for High Performance Visual Tracking

2019-04-23 · Peng Gao, Ruyue Yuan, Fei Wang, Liyi Xiao 외

In this paper, we investigate the impacts of three main aspects of visual tracking, i.e., the backbone network, the attentional mechanism, and the detection component, and propose a Siamese Attentional Keypoint Network, …

Visual Tracking Vocal Bursts Intensity Prediction

Probabilistic Vehicle Reconstruction Using a Multi-Task CNN

2021-02-21 · Max Coenen, Franz Rottensteiner

The retrieval of the 3D pose and shape of objects from images is an ill-posed problem. A common way to object reconstruction is to match entities such as keypoints, edges, or contours of a deformable 3D model, used as sh…

Object Reconstruction Retrieval Sensitivity

Learning Feature Matching via Matchable Keypoint-Assisted Graph Neural Network

2023-07-04 · Zizhuo Li, Jiayi Ma

Accurately matching local features between a pair of images is a challenging computer vision task. Previous studies typically use attention based graph neural networks (GNNs) with fully-connected graphs over keypoints wi…

Graph Neural Network Visual Localization