paper-with-me

홈 › Papers

Additive interaction modelling using I-priors

2020-07-30 · Wicher Bergsma, Haziq Jamil

Additive regression models with interactions are widely studied in the literature, using methods such as splines or Gaussian process regression. However, these methods can pose challenges for estimation and model selection, due to the presence of many smoothing parameters and the lack of suitable criteria. We propose to address these challenges by extending the I-prior methodology (Bergsma, 2020) to multiple covariates, which may be multidimensional. The I-prior methodology has some advantages over other methods, such as Gaussian process regression and Tikhonov regularization, both theoretically and practically. In particular, the I-prior is a proper prior, is based on minimal assumptions, yields an admissible posterior mean, and estimation of the scale (or smoothing) parameters can be done using an EM algorithm with simple E and M steps. Moreover, we introduce a parsimonious specification of models with interactions, which has two benefits: (i) it reduces the number of scale parameters and thus facilitates the estimation of models with interactions, and (ii) it enables straightforward model selection (among models with different interactions) based on the marginal likelihood.

📄 PDF Abstract BibTeX arXiv:2007.15766

Code (1)

haziqj/iprior-interaction 공식 구현

Tasks

Model SelectionMulti-class Classificationregression

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Variational Inference for Additive Main and Multiplicative Interaction Effects Models

2022-06-29 · AntÔnia A. L. Dos Santos, Rafael A. Moral, Danilo A. Sarti, Andrew C. Parnell

In plant breeding the presence of a genotype by environment (GxE) interaction has a strong impact on cultivation decision making and the introduction of new crop cultivars. The combination of linear and bilinear terms ha…

Decision MakingVariational Inference

Minimax Signal Detection in Sparse Additive Models

2023-04-19 · Subhodh Kotekal, Chao GAO

Sparse additive models are an attractive choice in circumstances calling for modelling flexibility in the face of high dimensionality. We study the signal detection problem and establish the minimax separation rate for t…

Additive models

Using generalized additive models to decompose time series and waveforms, and dissect heart-lung interaction physiology

2022-06-13 · Journal of Clinical Monitoring and Computing 2022 6 · Johannes Enevoldsen, Gavin L Simpson, Simon T Vistisen

Common physiological time series and waveforms are composed of repeating cardiac and respiratory cycles. Often, the cardiac effect is the primary interest, but for, e.g., fluid responsiveness prediction, the respiratory …

Additive modelsMedical waveform analysisTime SeriesTime Series Analysis

Rethinking Log Odds: Linear Probability Modelling and Expert Advice in Interpretable Machine Learning

2022-11-11 · Danial Dervovic, Nicolas Marchesotti, Freddy Lecue, Daniele Magazzeni

We introduce a family of interpretable machine learning models, with two broad additions: Linearised Additive Models (LAMs) which replace the ubiquitous logistic link function in General Additive Models (GAMs); and Subsc…

Additive modelsBinary ClassificationInterpretable Machine Learning

TopicNet: Making Additive Regularisation for Topic Modelling Accessible

2020-05-01 · LREC 2020 5 · Victor Bulatov, Vasiliy Alekseev, Konstantin Vorontsov, Darya Polyudova 외

This paper introduces TopicNet, a new Python module for topic modeling. This package, distributed under the MIT license, focuses on bringing additive regularization topic modelling (ARTM) to non-specialists using a gener…

Model Selection