paper-with-me

Papers

Fast Kronecker product kernel methods via generalized vec trick

2016-01-07 · Antti Airola, Tapio Pahikkala

Kronecker product kernel provides the standard approach in the kernel methods literature for learning from graph data, where edges are labeled and both start and end vertices have their own feature representations. The methods allow generalization to such new edges, whose start and end vertices do not appear in the training data, a setting known as zero-shot or zero-data learning. Such a setting occurs in numerous applications, including drug-target interaction prediction, collaborative filtering and information retrieval. Efficient training algorithms based on the so-called vec trick, that makes use of the special structure of the Kronecker product, are known for the case where the training data is a complete bipartite graph. In this work we generalize these results to non-complete training graphs. This allows us to derive a general framework for training Kronecker product kernel methods, as specific examples we implement Kronecker ridge regression and support vector machine algorithms. Experimental results demonstrate that the proposed approach leads to accurate models, while allowing order of magnitude improvements in training and prediction time.

📄 PDF Abstract BibTeX arXiv:1601.01507

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative FilteringInformation RetrievalRetrieval

Similar Papers 제목 키워드 기반

Generalized vec trick for fast learning of pairwise kernel models

2020-09-02 · Markus Viljanen, Antti Airola, Tapio Pahikkala

Pairwise learning corresponds to the supervised learning setting where the goal is to make predictions for pairs of objects. Prominent applications include predicting drug-target or protein-protein interactions, or custo…

Metric Learning

Sketching for Kronecker Product Regression and P-splines

2017-12-27 · Huaian Diao, Zhao Song, Wen Sun, David P. Woodruff

TensorSketch is an oblivious linear sketch introduced in Pagh'13 and later used in Pham, Pagh'13 in the context of SVMs for polynomial kernels. It was shown in Avron, Nguyen, Woodruff'14 that TensorSketch provides a subs…

regression

Kronecker Determinantal Point Processes

2016-05-26 · NeurIPS 2016 12 · Zelda Mariet, Suvrit Sra

Determinantal Point Processes (DPPs) are probabilistic models over all subsets a ground set of $N$ items. They have recently gained prominence in several applications that rely on "diverse" subsets. However, their applic…

Point ProcessesStochastic Optimization

Scalable Pairwise Kernel Learning with Stochastic Vec Trick

2026-06-15 · Napsu Karmitsa, Tapio Pahikkala, Antti Airola arxiv

Pairwise learning is a specialized form of supervised learning that focuses on predicting outcomes for pairs of objects. In this work, we introduce SPaiK, a new scalable kernel learning method tailored for pairwise setti…

Fast inference with Kronecker-sparse matrices

2024-05-23 · Antoine Gonon, Léon Zheng, Pascal Carrivain, Quoc-Tung Le

This paper benchmarks and improves existing GPU matrix multiplication algorithms specialized for Kronecker-sparse matrices, whose sparsity patterns are described by Kronecker products. These matrices have recently gained…

GPUManagement