paper-with-me

Papers

Unitary-Group Invariant Kernels and Features from Transformed Unlabeled Data

2015-11-18 · Dipan K. Pal, Marios Savvides

The study of representations invariant to common transformations of the data is important to learning. Most techniques have focused on local approximate invariance implemented within expensive optimization frameworks lacking explicit theoretical guarantees. In this paper, we study kernels that are invariant to the unitary group while having theoretical guarantees in addressing practical issues such as (1) unavailability of transformed versions of labelled data and (2) not observing all transformations. We present a theoretically motivated alternate approach to the invariant kernel SVM. Unlike previous approaches to the invariant SVM, the proposed formulation solves both issues mentioned. We also present a kernel extension of a recent technique to extract linear unitary-group invariant features addressing both issues and extend some guarantees regarding invariance and stability. We present experiments on the UCI ML datasets to illustrate and validate our methods.

📄 PDF Abstract BibTeX arXiv:1511.05943

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Max-Margin Invariant Features from Transformed Unlabeled Data

2017-10-24 · Dipan K. Pal, Ashwin A. Kannan, Gautam Arakalgud, Marios Savvides

The study of representations invariant to common transformations of the data is important to learning. Most techniques have focused on local approximate invariance implemented within expensive optimization frameworks lac…

Face RecognitionOne-Shot Learning

Max-Margin Invariant Features from Transformed Unlabelled Data

2017-12-01 · NeurIPS 2017 12 · Dipan Pal, Ashwin Kannan, Gautam Arakalgud, Marios Savvides

The study of representations invariant to common transformations of the data is important to learning. Most techniques have focused on local approximate invariance implemented within expensive optimization frameworks lac…

Face RecognitionOne-Shot Learning

Discriminative Invariant Kernel Features: A Bells-and-Whistles-Free Approach to Unsupervised Face Recognition and Pose Estimation

2016-06-01 · CVPR 2016 6 · Dipan K. Pal, Felix Juefei-Xu, Marios Savvides

We propose an explicitly discriminative and `simple' approach to generate invariance to nuisance transformations modeled as unitary. In practice, the approach works well to handle non-unitary transformations as well. Our…

Face RecognitionPose EstimationUnsupervised face recognition

Harmonics of Learning: Universal Fourier Features Emerge in Invariant Networks

2023-12-13 · Giovanni Luca Marchetti, Christopher Hillar, Danica Kragic, Sophia Sanborn

In this work, we formally prove that, under certain conditions, if a neural network is invariant to a finite group then its weights recover the Fourier transform on that group. This provides a mathematical explanation fo…

Learning Theory

GIFT: Learning Transformation-Invariant Dense Visual Descriptors via Group CNNs

2019-11-14 · NeurIPS 2019 12 · Yuan Liu, Zehong Shen, Zhixuan Lin, Sida Peng 외

Finding local correspondences between images with different viewpoints requires local descriptors that are robust against geometric transformations. An approach for transformation invariance is to integrate out the trans…

Pose Estimation