paper-with-me

홈 › Papers

Optimal score function estimation via derivatives constraints

2026-06-17 · Thomas Bonis, Thanh Mai Pham Ngoc, Viet Chi Tran arxiv

We consider the problem of score function estimation via empirical risk minimization. We first start with the question of inferring the score function of a probability measure $μ$ with density on the flat torus from a sample of distribution $μ$. We show that constraining the hypothesis space to a Sobolev ball is sufficient to prevent overfitting and obtaining minimax estimation rates. We then consider the problem of score function estimation in the context of score-based generative modeling. Again, under a conjecture tying the score estimation rates to the quality of the output of a score-based generative model, we obtain minimax rates for such an approach using score function estimators obtained by constraining the hypothesis class to a Sobolev ball.

📄 PDF Abstract BibTeX arXiv:2606.19084

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Nearly Optimal VC-Dimension and Pseudo-Dimension Bounds for Deep Neural Network Derivatives

2023-05-15 · NeurIPS 2023 11

This paper addresses the problem of nearly optimal Vapnik--Chervonenkis dimension (VC-dimension) and pseudo-dimension estimations of the derivative functions of deep neural networks (DNNs). Two important applications of …

Operator learningPhysics-informed machine learning

On the Estimation of Derivatives Using Plug-in Kernel Ridge Regression Estimators

2020-06-02 · Zejian Liu, Meng Li

We study the problem of estimating the derivatives of a regression function, which has a wide range of applications as a key nonparametric functional of unknown functions. Standard analysis may be tailored to specific de…

Gaussian Processesregression

Differentiable Neural Networks with RePU Activation: with Applications to Score Estimation and Isotonic Regression

2023-05-01 · Guohao Shen, Yuling Jiao, Yuanyuan Lin, Jian Huang

We study the properties of differentiable neural networks activated by rectified power unit (RePU) functions. We show that the partial derivatives of RePU neural networks can be represented by RePUs mixed-activated netwo…

regression

Optimal estimators of cross-partial derivatives and surrogates of functions

2024-07-05 · Matieyendou Lamboni

Computing cross-partial derivatives using fewer model runs is relevant in modeling, such as stochastic approximation, derivative-based ANOVA, exploring complex models, and active subspaces. This paper introduces surrogat…

Sensitivity

Autoregressive Score Matching

2020-10-24 · NeurIPS 2020 12 · Chenlin Meng, Lantao Yu, Yang song, Jiaming Song 외

Autoregressive models use chain rule to define a joint probability distribution as a product of conditionals. These conditionals need to be normalized, imposing constraints on the functional families that can be used. To…

DenoisingDensity EstimationImage DenoisingImage Generation