paper-with-me

홈 › Papers

Explicit homography estimation improves contrastive self-supervised learning

2021-01-12 · David Torpey, Richard Klein

The typical contrastive self-supervised algorithm uses a similarity measure in latent space as the supervision signal by contrasting positive and negative images directly or indirectly. Although the utility of self-supervised algorithms has improved recently, there are still bottlenecks hindering their widespread use, such as the compute needed. In this paper, we propose a module that serves as an additional objective in the self-supervised contrastive learning paradigm. We show how the inclusion of this module to regress the parameters of an affine transformation or homography, in addition to the original contrastive objective, improves both performance and learning speed. Importantly, we ensure that this module does not enforce invariance to the various components of the affine transform, as this is not always ideal. We demonstrate the effectiveness of the additional objective on two recent, popular self-supervised algorithms. We perform an extensive experimental analysis of the proposed method and show an improvement in performance for all considered datasets. Further, we find that although both the general homography and affine transformation are sufficient to improve performance and convergence, the affine transformation performs better in all cases.

📄 PDF Abstract BibTeX arXiv:2101.04713

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningHomography EstimationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Video-based Sequential Bayesian Homography Estimation for Soccer Field Registration

2023-11-17 · Paul J. Claasen, J. P. de Villiers

A novel Bayesian framework is proposed, which explicitly relates the homography of one video frame to the next through an affine transformation while explicitly modelling keypoint uncertainty. The literature has previous…

Homography EstimationKeypoint Detection

InterNet: Unsupervised Cross-modal Homography Estimation Based on Interleaved Modality Transfer and Self-supervised Homography Prediction

2024-09-26 · Junchen Yu, Si-Yuan Cao, Runmin Zhang, Chenghao Zhang 외

We propose a novel unsupervised cross-modal homography estimation framework, based on interleaved modality transfer and self-supervised homography prediction, named InterNet. InterNet integrates modality transfer and sel…

Domain GeneralizationHomography Estimation

Homography Estimation From the Common Self-Polar Triangle of Separate Ellipses

2016-06-01 · CVPR 2016 6 · Haifei Huang, HUI ZHANG, Yiu-ming Cheung

How to avoid ambiguity is a challenging problem for conic-based homography estimation. In this paper, we address the problem of homography estimation from two separate ellipses. We find that any two ellipses have a uniqu…

Homography Estimation

SSORN: Self-Supervised Outlier Removal Network for Robust Homography Estimation

2022-08-30 · Yi Li, Wenjie Pei, Zhenyu He

The traditional homography estimation pipeline consists of four main steps: feature detection, feature matching, outlier removal and transformation estimation. Recent deep learning models intend to address the homography…

Deep LearningDenoisingHomography Estimation

SCPNet: Unsupervised Cross-modal Homography Estimation via Intra-modal Self-supervised Learning

2024-07-11 · Runmin Zhang, Jun Ma, Si-Yuan Cao, Lun Luo 외

We propose a novel unsupervised cross-modal homography estimation framework based on intra-modal Self-supervised learning, Correlation, and consistent feature map Projection, namely SCPNet. The concept of intra-modal sel…

Homography EstimationSelf-Supervised Learning