paper-with-me

홈 › Papers

Fast geometric learning with symbolic matrices

2020-12-01 · NeurIPS 2020 12 · Jean Feydy, Joan Glaunès, Benjamin Charlier, Michael Bronstein

Geometric methods rely on tensors that can be encoded using a symbolic formula and data arrays, such as kernel and distance matrices. We present an extension for standard machine learning frameworks that provides comprehensive support for this abstraction on CPUs and GPUs: our toolbox combines a versatile, transparent user interface with fast runtimes and low memory usage. Unlike general purpose acceleration frameworks such as XLA, our library turns generic Python code into binaries whose performances are competitive with state-of-the-art geometric libraries - such as FAISS for nearest neighbor search - with the added benefit of flexibility. We perform an extensive evaluation on a broad class of problems: Gaussian modelling, K-nearest neighbors search, geometric deep learning, non-Euclidean embeddings and optimal transport theory. In practice, for geometric problems that involve 1k to 1M samples in dimension 1 to 100, our library speeds up baseline GPU implementations by up to two orders of magnitude.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

GPU

Similar Papers 제목 키워드 기반

Diagonal RNNs in Symbolic Music Modeling

2017-04-18 · Y. Cem Subakan, Paris Smaragdis

In this paper, we propose a new Recurrent Neural Network (RNN) architecture. The novelty is simple: We use diagonal recurrent matrices instead of full. This results in better test likelihood and faster convergence compar…

Music Modeling

A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matrices

2022-03-09 · Michael Hersche, Mustafa Zeqiri, Luca Benini, Abu Sebastian 외

Neither deep neural networks nor symbolic AI alone has approached the kind of intelligence expressed in humans. This is mainly because neural networks are not able to decompose joint representations to obtain distinct ob…

Logical Reasoning

Approximate Joint Diagonalization and Geometric Mean of Symmetric Positive Definite Matrices

2015-05-26 · Marco Congedo, Bijan Afsari, Alexandre Barachant, Maher Moakher

We explore the connection between two problems that have arisen independently in the signal processing and related fields: the estimation of the geometric mean of a set of symmetric positive definite (SPD) matrices and t…

Time Series Analysis

A new metric on the manifold of kernel matrices with application to matrix geometric means

2012-12-01 · NeurIPS 2012 12 · Suvrit Sra

Symmetric positive definite (spd) matrices are remarkably pervasive in a multitude of scientific disciplines, including machine learning and optimization. We consider the fundamental task of measuring distances between t…

Inductive Geometric Matrix Midranges

2020-06-02 · Graham W. Van Goffrier, Cyrus Mostajeran, Rodolphe Sepulchre

Covariance data as represented by symmetric positive definite (SPD) matrices are ubiquitous throughout technical study as efficient descriptors of interdependent systems. Euclidean analysis of SPD matrices, while computa…

Clustering