paper-with-me

홈 › Papers

Non-stationary Gaussian process discriminant analysis with variable selection for high-dimensional functional data

2021-09-29 · W Yu, S Wade, H D Bondell, L Azizi

High-dimensional classification and feature selection tasks are ubiquitous with the recent advancement in data acquisition technology. In several application areas such as biology, genomics and proteomics, the data are often functional in their nature and exhibit a degree of roughness and non-stationarity. These structures pose additional challenges to commonly used methods that rely mainly on a two-stage approach performing variable selection and classification separately. We propose in this work a novel Gaussian process discriminant analysis (GPDA) that combines these steps in a unified framework. Our model is a two-layer non-stationary Gaussian process coupled with an Ising prior to identify differentially-distributed locations. Scalable inference is achieved via developing a variational scheme that exploits advances in the use of sparse inverse covariance matrices. We demonstrate the performance of our methodology on simulated datasets and two proteomics datasets: breast cancer and SARS-CoV-2. Our approach distinguishes itself by offering explainability as well as uncertainty quantification in addition to low computational cost, which are crucial to increase trust and social acceptance of data-driven tools.

📄 PDF Abstract BibTeX arXiv:2109.14171

Code (1)

weichangyu10/gpdapublic 공식 구현

Tasks

feature selectionUncertainty QuantificationVariable Selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

A State-Space Approach to Nonstationary Discriminant Analysis

2025-08-22 · Shuilian Xie, Mahdi Imani, Edward R. Dougherty, Ulisses M. Braga-Neto arxiv

Classical discriminant analysis assumes identically distributed training data, yet in many applications observations are collected over time and the class-conditional distributions drift. This population drift renders st…

The Geometry of Nonlinear Embeddings in Kernel Discriminant Analysis

2020-05-12 · Jiae Kim, Yoonkyung Lee, Zhiyu Liang

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the lim…

Latent Gaussian Process Regression

2017-07-18 · Erik Bodin, Neill D. F. Campbell, Carl Henrik Ek

We introduce Latent Gaussian Process Regression which is a latent variable extension allowing modelling of non-stationary multi-modal processes using GPs. The approach is built on extending the input space of a regressio…

regression

Efficient EM Training of Gaussian Mixtures with Missing Data

2012-09-04 · Olivier Delalleau, Aaron Courville, Yoshua Bengio

In data-mining applications, we are frequently faced with a large fraction of missing entries in the data matrix, which is problematic for most discriminant machine learning algorithms. A solution that we explore in this…

Missing Values

Analysis of Nonstationary Time Series Using Locally Coupled Gaussian Processes

2016-10-31 · Luca Ambrogioni, Eric Maris

The analysis of nonstationary time series is of great importance in many scientific fields such as physics and neuroscience. In recent years, Gaussian process regression has attracted substantial attention as a robust an…

Gaussian ProcessesTime SeriesTime Series Analysis