paper-with-me

Papers

On kernel-based statistical learning theory in the mean field limit

2023-09-21 · NeurIPS 2023 11

In many applications of machine learning, a large number of variables are considered. Motivated by machine learning of interacting particle systems, we consider the situation when the number of input variables goes to infinity. First, we continue the recent investigation of the mean field limit of kernels and their reproducing kernel Hilbert spaces, completing the existing theory. Next, we provide results relevant for approximation with such kernels in the mean field limit, including a representer theorem. Finally, we use these kernels in the context of statistical learning in the mean field limit, focusing on Support Vector Machines. In particular, we show mean field convergence of empirical and infinite-sample solutions as well as the convergence of the corresponding risks. On the one hand, our results establish rigorous mean field limits in the context of kernel methods, providing new theoretical tools and insights for large-scale problems. On the other hand, our setting corresponds to a new form of limit of learning problems, which seems to have not been investigated yet in the statistical learning theory literature.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On kernel-based statistical learning in the mean field limit

2023-10-27 · Christian Fiedler, Michael Herty, Sebastian Trimpe

In many applications of machine learning, a large number of variables are considered. Motivated by machine learning of interacting particle systems, we consider the situation when the number of input variables goes to in…

Learning Theory

Reproducing kernel Hilbert spaces in the mean field limit

2023-02-28 · Christian Fiedler, Michael Herty, Michael Rom, Chiara Segala 외

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods res…

Mean field limits for discrete-time dynamical systems via kernel mean embeddings

2023-12-11 · Christian Fiedler, Michael Herty, Sebastian Trimpe

Mean field limits are an important tool in the context of large-scale dynamical systems, in particular, when studying multiagent and interacting particle systems. While the continuous-time theory is well-developed, few w…

Kernel Smoothing, Mean Shift, and Their Learning Theory with Directional Data

2020-10-23 · Yikun Zhang, Yen-Chi Chen

Directional data consist of observations distributed on a (hyper)sphere, and appear in many applied fields, such as astronomy, ecology, and environmental science. This paper studies both statistical and computational pro…

AstronomyClusteringLearning Theory

Unified field theoretical approach to deep and recurrent neuronal networks

2021-12-10 · Kai Segadlo, Bastian Epping, Alexander van Meegen, David Dahmen 외

Understanding capabilities and limitations of different network architectures is of fundamental importance to machine learning. Bayesian inference on Gaussian processes has proven to be a viable approach for studying rec…

Bayesian InferenceGaussian Processes