paper-with-me

Papers

ETO:Efficient Transformer-based Local Feature Matching by Organizing Multiple Homography Hypotheses

2024-10-30 · Junjie Ni, Guofeng Zhang, Guanglin Li, Yijin Li, Xinyang Liu, Zhaoyang Huang, Hujun Bao

We tackle the efficiency problem of learning local feature matching. Recent advancements have given rise to purely CNN-based and transformer-based approaches, each augmented with deep learning techniques. While CNN-based methods often excel in matching speed, transformer-based methods tend to provide more accurate matches. We propose an efficient transformer-based network architecture for local feature matching. This technique is built on constructing multiple homography hypotheses to approximate the continuous correspondence in the real world and uni-directional cross-attention to accelerate the refinement. On the YFCC100M dataset, our matching accuracy is competitive with LoFTR, a state-of-the-art transformer-based architecture, while the inference speed is boosted to 4 times, even outperforming the CNN-based methods. Comprehensive evaluations on other open datasets such as Megadepth, ScanNet, and HPatches demonstrate our method's efficacy, highlighting its potential to significantly enhance a wide array of downstream applications.

📄 PDF Abstract BibTeX arXiv:2410.22733

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

FMRT: Learning Accurate Feature Matching with Reconciliatory Transformer

2023-10-20 · Xinyu Zhang, Li Wang, Zhiqiang Jiang, Kun Dai 외

Local Feature Matching, an essential component of several computer vision tasks (e.g., structure from motion and visual localization), has been effectively settled by Transformer-based methods. However, these methods onl…

Homography EstimationPose EstimationVisual Localization

LoFLAT: Local Feature Matching using Focused Linear Attention Transformer

2024-10-30 · Naijian Cao, Renjie He, Yuchao Dai, Mingyi He

Local feature matching is an essential technique in image matching and plays a critical role in a wide range of vision-based applications. However, existing Transformer-based detector-free local feature matching methods …

Transformer based Fingerprint Feature Extraction

2022-09-08 · Saraansh Tandon, Anoop Namboodiri

Fingerprint feature extraction is a task that is solved using either a global or a local representation. State-of-the-art global approaches use heavy deep learning models to process the full fingerprint image at once, wh…

WT-MVSNet: Window-based Transformers for Multi-view Stereo

2022-05-28 · Jinli Liao, Yikang Ding, Yoli Shavit, Dihe Huang 외

Recently, Transformers were shown to enhance the performance of multi-view stereo by enabling long-range feature interaction. In this work, we propose Window-based Transformers (WT) for local feature matching and global …

TP3M: Transformer-based Pseudo 3D Image Matching with Reference Image

2024-05-14 · Liming Han, Zhaoxiang Liu, Shiguo Lian

Image matching is still challenging in such scenes with large viewpoints or illumination changes or with low textures. In this paper, we propose a Transformer-based pseudo 3D image matching method. It upgrades the 2D fea…

Homography EstimationImage to 3DPose EstimationVisual Localization