paper-with-me

Papers

Equation Discovery with Bayesian Spike-and-Slab Priors and Efficient Kernels

2023-10-09 · Da Long, Wei W. Xing, Aditi S. Krishnapriyan, Robert M. Kirby, Shandian Zhe, Michael W. Mahoney

Discovering governing equations from data is important to many scientific and engineering applications. Despite promising successes, existing methods are still challenged by data sparsity and noise issues, both of which are ubiquitous in practice. Moreover, state-of-the-art methods lack uncertainty quantification and/or are costly in training. To overcome these limitations, we propose a novel equation discovery method based on Kernel learning and BAyesian Spike-and-Slab priors (KBASS). We use kernel regression to estimate the target function, which is flexible, expressive, and more robust to data sparsity and noises. We combine it with a Bayesian spike-and-slab prior -- an ideal Bayesian sparse distribution -- for effective operator selection and uncertainty quantification. We develop an expectation-propagation expectation-maximization (EP-EM) algorithm for efficient posterior inference and function estimation. To overcome the computational challenge of kernel regression, we place the function values on a mesh and induce a Kronecker product construction, and we use tensor algebra to enable efficient computation and optimization. We show the advantages of KBASS on a list of benchmark ODE and PDE discovery tasks.

📄 PDF Abstract BibTeX arXiv:2310.05387

Code (1)

long-da/kbass 공식 구현 jax

Tasks

Equation Discoveryregressiontensor algebraUncertainty Quantification

Similar Papers 제목 키워드 기반

Bayesian high-dimensional linear regression with generic spike-and-slab priors

2019-12-19 · Bai Jiang, Qiang Sun

Spike-and-slab priors are popular Bayesian solutions for high-dimensional linear regression problems. Previous theoretical studies on spike-and-slab methods focus on specific prior formulations and use prior-dependent co…

Model SelectionregressionVocal Bursts Intensity Prediction

Generalized Cumulative Shrinkage Process Priors with Applications to Sparse Bayesian Factor Analysis

2023-03-01 · Sylvia Frühwirth-Schnatter

The paper discusses shrinkage priors which impose increasing shrinkage in a sequence of parameters. We review the cumulative shrinkage process (CUSP) prior of Legramanti et al. (2020), which is a spike-and-slab shrinkage…

Variable fusion for Bayesian linear regression via spike-and-slab priors

2020-03-30 · Shengyi Wu, Kaito Shimamura, Kohei Yoshikawa, Kazuaki. Murayama 외

In linear regression models, fusion of coefficients is used to identify predictors having similar relationships with a response. This is called variable fusion. This paper presents a novel variable fusion method in terms…

regression

Bayesian $l_0$-regularized Least Squares

2017-05-31 · Nicholas G. Polson, Lei Sun

Bayesian $l_0$-regularized least squares is a variable selection technique for high dimensional predictors. The challenge is optimizing a non-convex objective function via search over model space consisting of all possib…

Computational EfficiencyVariable Selection

Scalable Spike-and-Slab

2022-04-04 · Niloy Biswas, Lester Mackey, Xiao-Li Meng

Spike-and-slab priors are commonly used for Bayesian variable selection, due to their interpretability and favorable statistical properties. However, existing samplers for spike-and-slab posteriors incur prohibitive comp…

Variable Selection