paper-with-me

홈 › Papers

Gaussian Process Neural Additive Models

2024-02-19 · Wei zhang, Brian Barr, John Paisley

Deep neural networks have revolutionized many fields, but their black-box nature also occasionally prevents their wider adoption in fields such as healthcare and finance, where interpretable and explainable models are required. The recent development of Neural Additive Models (NAMs) is a significant step in the direction of interpretable deep learning for tabular datasets. In this paper, we propose a new subclass of NAMs that use a single-layer neural network construction of the Gaussian process via random Fourier features, which we call Gaussian Process Neural Additive Models (GP-NAM). GP-NAMs have the advantage of a convex objective function and number of trainable parameters that grows linearly with feature dimensionality. It suffers no loss in performance compared to deeper NAM approaches because GPs are well-suited for learning complex non-parametric univariate functions. We demonstrate the performance of GP-NAM on several tabular datasets, showing that it achieves comparable or better performance in both classification and regression tasks with a large reduction in the number of parameters.

📄 PDF Abstract BibTeX arXiv:2402.12518

Code (1)

wei2624/gpnam 공식 구현 pytorch

Tasks

Additive modelsExplainable Models

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…
GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…
NAM Neural Additive Models (NAMs) make restrictions on the structure of neural networks, which yields a family of models that are inherently interpretable while suffering little…

Similar Papers 제목 키워드 기반

Additive Gaussian Processes Revisited

2022-06-20 · Xiaoyu Lu, Alexis Boukouvalas, James Hensman

Gaussian Process (GP) models are a class of flexible non-parametric models that have rich representational power. By using a Gaussian process with additive structure, complex responses can be modelled whilst retaining in…

Gaussian Processes

Projection Pursuit Gaussian Process Regression

2020-04-01 · Gecheng Chen, Rui Tuo

A primary goal of computer experiments is to reconstruct the function given by the computer code via scattered evaluations. Traditional isotropic Gaussian process models suffer from the curse of dimensionality, when the …

regression

Additive Gaussian Processes

2011-12-19 · NeurIPS 2011 12 · David Duvenaud, Hannes Nickisch, Carl Edward Rasmussen

We introduce a Gaussian process model of functions which are additive. An additive function is one which decomposes into a sum of low-dimensional functions, each depending on only a subset of the input variables. Additiv…

Additive modelsGaussian Processesregression

Scalable GAM using sparse variational Gaussian processes

2018-12-28 · Vincent Adam, Nicolas Durrande, ST John

Generalized additive models (GAMs) are a widely used class of models of interest to statisticians as they provide a flexible way to design interpretable models of data beyond linear models. We here propose a scalable and…

Additive modelsGaussian ProcessesVariational Inference

On Additive Gaussian Processes for Wind Farm Power Prediction

2026-03-18 · Simon M. Brealy, Lawrence A. Bull, Daniel S. Brennan, Pauline Beltrando 외 arxiv

Population-based Structural Health Monitoring (PBSHM) aims to share information between similar machines or structures. This paper takes a population-level perspective, exploring the use of additive Gaussian processes to…

Gaussian Processes