paper-with-me

Papers

Convergence of the generalization error for deep gradient flow methods for PDEs

2025-12-31 · Chenguang Liu, Antonis Papapantoleon, Jasper Rou arxiv

The aim of this article is to provide a firm mathematical foundation for the application of deep gradient flow methods (DGFMs) for the solution of (high-dimensional) partial differential equations (PDEs). We decompose the generalization error of DGFMs into an approximation and a training error. We first show that the solution of PDEs that satisfy reasonable and verifiable assumptions can be approximated by neural networks, thus the approximation error tends to zero as the number of neurons tends to infinity. Then, we derive the gradient flow that the training process follows in the ``wide network limit'' and analyze the limit of this flow as the training time tends to infinity. These results combined show that the generalization error of DGFMs tends to zero as the number of neurons and the training time tend to infinity.

📄 PDF Abstract BibTeX arXiv:2512.25017

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Optimal Confidence Band for Kernel Gradient Flow Estimator

2026-05-07 · Yuqian Cheng, Zhuo Chen, Qian Lin arxiv

In this paper, we investigate the supremum-norm generalization error and the uniform inference for a specific class of kernel regression methods, namely the kernel gradient flows. Under the widely adopted capacity-source…

Short optimization paths lead to good generalization

2021-09-29 · Fusheng Liu, Haizhao Yang, Qianxiao Li

Optimization and generalization are two essential aspects of machine learning. In this paper, we propose a framework to connect optimization with generalization by analyzing the generalization error based on the length o…

BIG-bench Machine Learningregression

From Optimization Dynamics to Generalization Bounds via Łojasiewicz Gradient Inequality

2022-02-22 · Fusheng Liu, Haizhao Yang, Soufiane Hayou, Qianxiao Li

Optimization and generalization are two essential aspects of statistical machine learning. In this paper, we propose a framework to connect optimization with generalization by analyzing the generalization error based on …

BIG-bench Machine LearningGeneralization Boundsregression

Fisher-Rao Gradient Flows of Linear Programs and State-Action Natural Policy Gradients

2024-03-28 · Johannes Müller, Semih Çaycı, Guido Montúfar

Kakade's natural policy gradient method has been studied extensively in recent years, showing linear convergence with and without regularization. We study another natural gradient method based on the Fisher information m…

Theoretical Foundation of Flow-Based Time Series Generation: Provable Approximation, Generalization, and Efficiency

2025-03-18 · Jiangxuan Long, Zhao Song, Chiwun Yang

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, i…

Time SeriesTime Series ForecastingTime Series Generation