AbHE: All Attention-based Homography Estimation
Homography estimation is a basic computer vision task, which aims to obtain the transformation from multi-view images for image alignment. Unsupervised learning homography estimation trains a convolution neural network for feature extraction and transformation matrix regression. While the state-of-theart homography method is based on convolution neural networks, few work focuses on transformer which shows superiority in highlevel vision tasks. In this paper, we propose a strong-baseline model based on the Swin Transformer, which combines convolution neural network for local features and transformer module for global features. Moreover, a cross non-local layer is introduced to search the matched features within the feature maps coarsely. In the homography regression stage, we adopt an attention layer for the channels of correlation volume, which can drop out some weak correlation feature points. The experiment shows that in 8 Degree-of-Freedoms(DOFs) homography estimation our method overperforms the state-of-the-art method.
Code (0)
등록된 구현이 없습니다.
Tasks
AllHomography EstimationregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Homography Estimation with Coplanarity-Aware GAN
Estimating homography from an image pair is a fundamental problem in image alignment. Unsupervised learning methods have received increasing attention in this field due to their promising performance and label-free train…
Homography EstimationGeometrized Transformer for Self-Supervised Homography Estimation
For homography estimation, we propose Geometrized Transformer (GeoFormer), a new detector-free feature matching method. Current detector-free methods, e.g. LoFTR, lack an effective mean to accurately localize small a…
Homography EstimationLocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimation
Cross-resolution image alignment is a key problem in multiscale gigapixel photography, which requires to estimate homography matrix using images with large resolution gap. Existing deep homography methods concatenate the…
Homography EstimationRecurrent Homography Estimation Using Homography-Guided Image Warping and Focus Transformer
We propose the Recurrent homography estimation framework using Homography-guided image Warping and Focus transformer (FocusFormer), named RHWF. Both being appropriately absorbed into the recurrent framework, the homo…
Homography EstimationSSHNet: Unsupervised Cross-modal Homography Estimation via Problem Reformulation and Split Optimization
We propose a novel unsupervised cross-modal homography estimation learning framework, named Split Supervised Homography estimation Network (SSHNet). SSHNet reformulates the unsupervised cross-modal homography estimat…
Domain GeneralizationHomography Estimation