paper-with-me

홈 › Papers

Structure-Aware Random Fourier Kernel for Graphs

2021-12-01 · NeurIPS 2021 12 · Jinyuan Fang, Qiang Zhang, Zaiqiao Meng, Shangsong Liang

Gaussian Processes (GPs) define distributions over functions and their generalization capabilities depend heavily on the choice of kernels. In this paper, we propose a novel structure-aware random Fourier (SRF) kernel for GPs that brings several benefits when modeling graph-structured data. First, SRF kernel is defined with a spectral distribution based on the Fourier duality given by the Bochner's theorem, transforming the kernel learning problem to a distribution inference problem. Second, SRF kernel admits a random Fourier feature formulation that makes the kernel scalable for optimization. Third, SRF kernel enables to leverage geometric structures by taking subgraphs as inputs. To effectively optimize GPs with SRF kernel, we develop a variational EM algorithm, which alternates between an inference procedure (E-step) and a learning procedure (M-step). Experimental results on five real-world datasets show that our model can achieve state-of-the-art performance in two typical graph learning tasks, i.e., object classification and link prediction.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesGraph LearningLink Prediction

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…

Similar Papers 제목 키워드 기반

Random Fourier Features for Operator-Valued Kernels

2016-05-09 · Romain Brault, Florence d'Alché-Buc, Markus Heinonen

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these metho…

Multi-Task LearningTranslation

Random Fourier Features for Kernel Ridge Regression: Approximation Bounds and Statistical Guarantees

2018-04-26 · ICML 2017 8 · Haim Avron, Michael Kapralov, Cameron Musco, Christopher Musco 외

Random Fourier features is one of the most popular techniques for scaling up kernel methods, such as kernel ridge regression. However, despite impressive empirical results, the statistical properties of random Fourier fe…

regression

Adaptive Random Fourier Features Kernel LMS

2022-07-14 · Wei Gao, Jie Chen, Cédric Richard, Wentao Shi 외

We propose the adaptive random Fourier features Gaussian kernel LMS (ARFF-GKLMS). Like most kernel adaptive filters based on stochastic gradient descent, this algorithm uses a preset number of random Fourier features to …

Orthogonal Random Features: Explicit Forms and Sharp Inequalities

2023-10-11 · Nizar Demni, Hachem Kadri

Random features have been introduced to scale up kernel methods via randomization techniques. In particular, random Fourier features and orthogonal random features were used to approximate the popular Gaussian kernel. Ra…

Data Dependent Kernel Approximation using Pseudo Random Fourier Features

2017-11-27 · Bharath Bhushan Damodaran, Nicolas Courty, Philippe-Henri Gosselin

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus…