paper-with-me

홈 › Papers

Geometrically Inspired Kernel Machines for Collaborative Learning Beyond Gradient Descent

2024-07-05 · Mohit Kumar, Alexander Valentinitsch, Magdalena Fuchs, Mathias Brucker, Juliana Bowles, Adnan Husakovic, Ali Abbas, Bernhard A. Moser

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For classification problems, this approach allows us to learn bounded geometric structures around given data points and hence solve the global model learning problem in an efficient way by exploiting convexity properties of the related optimisation problem in a Reproducing Kernel Hilbert Space (RKHS). In this way, we can reduce classification problems to determining the closest bounded geometric structure from a given data point. Further advantages that come with our solution is that our approach does not require clients to perform multiple epochs of local optimisation using stochastic gradient descent, nor require rounds of communication between client/server for optimising the global model. We highlight that numerous experiments have shown that the proposed method is a competitive alternative to the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2407.04335

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A data-efficient geometrically inspired polynomial kernel for robot inverse dynamics

2019-04-30 · Alberto Dalla Libera, Ruggero Carli

In this paper, we introduce a novel data-driven inverse dynamics estimator based on Gaussian Process Regression. Driven by the fact that the inverse dynamics can be described as a polynomial function on a suitable input …

On Mitigating the Utility-Loss in Differentially Private Learning: A new Perspective by a Geometrically Inspired Kernel Approach

2023-04-03 · Mohit Kumar, Bernhard A. Moser, Lukas Fischer

Privacy-utility tradeoff remains as one of the fundamental issues of differentially private machine learning. This paper introduces a geometrically inspired kernel-based approach to mitigate the accuracy-loss issue in cl…

Federated LearningPrivacy PreservingRepresentation Learning

No More DeLuLu: Physics-Inspired Kernel Networks for Geometrically-Grounded Neural Computation

2026-02-22 · Taha Bouhsine arxiv

We introduce the yat-product, a kernel operator combining quadratic alignment with inverse-square proximity. We prove it is a Mercer kernel, analytic, Lipschitz on bounded domains, and self-regularizing, admitting a uniq…

Learning theory estimates with observations from general stationary stochastic processes

2016-05-10 · Hanyuan Hang, Yunlong Feng, Ingo Steinwart, Johan A. K. Suykens

This paper investigates the supervised learning problem with observations drawn from certain general stationary stochastic processes. Here by \emph{general}, we mean that many stationary stochastic processes can be inclu…

Learning Theoryquantile regression

Spectral Truncation Kernels: Noncommutativity in $C^*$-algebraic Kernel Machines

2024-05-28 · Yuka Hashimoto, Ayoub Hafid, Masahiro Ikeda, Hachem Kadri

$C^*$-algebra-valued kernels could pave the way for the next generation of kernel machines. To further our fundamental understanding of learning with $C^*$-algebraic kernels, we propose a new class of positive definite k…