Interpolating Discriminant Functions in High-Dimensional Gaussian Latent Mixtures
This paper considers binary classification of high-dimensional features under a postulated model with a low-dimensional latent Gaussian mixture structure and non-vanishing noise. A generalized least squares estimator is used to estimate the direction of the optimal separating hyperplane. The estimated hyperplane is shown to interpolate on the training data. While the direction vector can be consistently estimated as could be expected from recent results in linear regression, a naive plug-in estimate fails to consistently estimate the intercept. A simple correction, that requires an independent hold-out sample, renders the procedure minimax optimal in many scenarios. The interpolation property of the latter procedure can be retained, but surprisingly depends on the way the labels are encoded.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationregressionVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Minimax Supervised Clustering in the Anisotropic Gaussian Mixture Model: A new take on Robust Interpolation
We study the supervised clustering problem under the two-component anisotropic Gaussian mixture model in high dimensions and in the non-asymptotic setting. We first derive a lower and a matching upper bound for the minim…
ClusteringFast Classification Rates for High-dimensional Gaussian Generative Models
We consider the problem of binary classification when the covariates conditioned on the each of the response values follow multivariate Gaussian distributions. We focus on the setting where the covariance matrices for th…
Binary ClassificationClassificationGeneral Classificationregression+1High-Dimensional Tensor Discriminant Analysis with Incomplete Tensors
Tensor classification is gaining importance across fields, yet handling partially observed data remains challenging. In this paper, we introduce a novel approach to tensor classification with incomplete data, framed with…
A Recurrent Probabilistic Neural Network with Dimensionality Reduction Based on Time-series Discriminant Component Analysis
This paper proposes a probabilistic neural network developed on the basis of time-series discriminant component analysis (TSDCA) that can be used to classify high-dimensional time-series patterns. TSDCA involves the comp…
Dimensionality ReductionEEGElectroencephalogram (EEG)General Classification+2Low-dimensional Interpretable Kernels with Conic Discriminant Functions for Classification
Kernels are often developed and used as implicit mapping functions that show impressive predictive power due to their high-dimensional feature space representations. In this study, we gradually construct a series of simp…
ClassificationGeneral Classification