The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs

2022-08-18 · Chris Rockwell, Justin Johnson, David F. Fouhey

We present a simple baseline for directly estimating the relative pose (rotation and translation, including scale) between two images. Deep methods have recently shown strong progress but often require complex or multi-stage architectures. We show that a handful of modifications can be applied to a Vision Transformer (ViT) to bring its computations close to the Eight-Point Algorithm. This inductive bias enables a simple method to be competitive in multiple settings, often substantially improving over the state of the art with strong performance gains in limited data regimes.

📄 PDF Abstract BibTeX arXiv:2208.08988

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive BiasPose Prediction Translation

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Position-Wise Feed-Forward Layer 설명 없음

Residual Connection 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Adam 설명 없음

Towards Exact Computation of Inductive Bias

2024-06-22 · Akhilan Boopathy, William Yue, Jaedong Hwang, Abhiram Iyer 외

Much research in machine learning involves finding appropriate inductive biases (e.g. convolutional neural networks, momentum-based optimizers, transformers) to promote generalization on tasks. However, quantification of…

Inductive Bias

The no-free-lunch theorems of supervised learning

2022-02-09 · Tom F. Sterkenburg, Peter D. Grünwald

The no-free-lunch theorems promote a skeptical conclusion that all possible machine learning algorithms equally lack justification. But how could this leave room for a learning theory, that shows that some algorithms are…

Inductive Bias Learning Theory Philosophy

Exploiting Inductive Bias in Transformer for Point Cloud Classification and Segmentation

2023-04-27 · Zihao Li, Pan Gao, Hui Yuan, Ran Wei 외

Discovering inter-point connection for efficient high-dimensional feature extraction from point coordinate is a key challenge in processing point cloud. Most existing methods focus on designing efficient local feature ex…

3D Object Classification 3D Part Segmentation Inductive Bias Point Cloud Classification+1

Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild

2025-03-13 · CVPR 2025 1 · Damien Teney, Liangze Jiang, Florin Gogianu, Ehsan Abbasnejad

Neural architectures tend to fit their data with relatively simple functions. This "simplicity bias" is widely regarded as key to their success. This paper explores the limits of this principle. Building on recent findin…

image-classification Image Classification

Robust Domain Adaptation: Representations, Weights and Inductive Bias

2020-06-24 · Victor Bouvier, Philippe Very, Clément Chastagnol, Myriam Tami 외

Unsupervised Domain Adaptation (UDA) has attracted a lot of attention in the last ten years. The emergence of Domain Invariant Representations (IR) has improved drastically the transferability of representations from a l…

Domain Adaptation Inductive Bias Unsupervised Domain Adaptation