Additive interaction modelling using I-priors
Additive regression models with interactions are widely studied in the literature, using methods such as splines or Gaussian process regression. However, these methods can pose challenges for estimation and model selection, due to the presence of many smoothing parameters and the lack of suitable criteria. We propose to address these challenges by extending the I-prior methodology (Bergsma, 2020) to multiple covariates, which may be multidimensional. The I-prior methodology has some advantages over other methods, such as Gaussian process regression and Tikhonov regularization, both theoretically and practically. In particular, the I-prior is a proper prior, is based on minimal assumptions, yields an admissible posterior mean, and estimation of the scale (or smoothing) parameters can be done using an EM algorithm with simple E and M steps. Moreover, we introduce a parsimonious specification of models with interactions, which has two benefits: (i) it reduces the number of scale parameters and thus facilitates the estimation of models with interactions, and (ii) it enables straightforward model selection (among models with different interactions) based on the marginal likelihood.
Code (1)
Tasks
Model SelectionMulti-class ClassificationregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Variational Inference for Additive Main and Multiplicative Interaction Effects Models
In plant breeding the presence of a genotype by environment (GxE) interaction has a strong impact on cultivation decision making and the introduction of new crop cultivars. The combination of linear and bilinear terms ha…
Decision MakingVariational InferenceMinimax Signal Detection in Sparse Additive Models
Sparse additive models are an attractive choice in circumstances calling for modelling flexibility in the face of high dimensionality. We study the signal detection problem and establish the minimax separation rate for t…
Additive modelsUsing generalized additive models to decompose time series and waveforms, and dissect heart-lung interaction physiology
Common physiological time series and waveforms are composed of repeating cardiac and respiratory cycles. Often, the cardiac effect is the primary interest, but for, e.g., fluid responsiveness prediction, the respiratory …
Additive modelsMedical waveform analysisTime SeriesTime Series AnalysisRethinking Log Odds: Linear Probability Modelling and Expert Advice in Interpretable Machine Learning
We introduce a family of interpretable machine learning models, with two broad additions: Linearised Additive Models (LAMs) which replace the ubiquitous logistic link function in General Additive Models (GAMs); and Subsc…
Additive modelsBinary ClassificationInterpretable Machine LearningTopicNet: Making Additive Regularisation for Topic Modelling Accessible
This paper introduces TopicNet, a new Python module for topic modeling. This package, distributed under the MIT license, focuses on bringing additive regularization topic modelling (ARTM) to non-specialists using a gener…
Model Selection