paper-with-me

Papers

Higher-Order Partial Least Squares (HOPLS): A Generalized Multi-Linear Regression Method

2012-07-05 · Qibin Zhao, Cesar F. Caiafa, Danilo P. Mandic, Zenas C. Chao, Yasuo Nagasaka, Naotaka Fujii, Liqing Zhang, Andrzej Cichocki

A new generalized multilinear regression model, termed the Higher-Order Partial Least Squares (HOPLS), is introduced with the aim to predict a tensor (multiway array) $\tensor{Y}$ from a tensor $\tensor{X}$ through projecting the data onto the latent space and performing regression on the corresponding latent variables. HOPLS differs substantially from other regression models in that it explains the data by a sum of orthogonal Tucker tensors, while the number of orthogonal loadings serves as a parameter to control model complexity and prevent overfitting. The low dimensional latent space is optimized sequentially via a deflation operation, yielding the best joint subspace approximation for both $\tensor{X}$ and $\tensor{Y}$. Instead of decomposing $\tensor{X}$ and $\tensor{Y}$ individually, higher order singular value decomposition on a newly defined generalized cross-covariance tensor is employed to optimize the orthogonal loadings. A systematic comparison on both synthetic data and real-world decoding of 3D movement trajectories from electrocorticogram (ECoG) signals demonstrate the advantages of HOPLS over the existing methods in terms of better predictive ability, suitability to handle small sample sizes, and robustness to noise.

📄 PDF Abstract BibTeX arXiv:1207.1230

Code (1)

arthurdehgan/HOPLS pytorch

Tasks

regression

Similar Papers 제목 키워드 기반

Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs

2019-11-05 · Zhiqiang Cai, Jingshuang Chen, Min Liu, Xinyu Liu

This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the …

Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory

2020-06-28 · Tao Luo, Haizhao Yang

The problem of solving partial differential equations (PDEs) can be formulated into a least-squares minimization problem, where neural networks are used to parametrize PDE solutions. A global minimizer corresponds to a n…

Sparse Partial Least Squares for Coarse Noisy Graph Alignment

2021-04-06 · Michael Weylandt, George Michailidis, T. Mitchell Roddenberry

Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different …

Prediction bounds for higher order total variation regularized least squares

2019-04-24 · Francesco Ortelli, Sara van de Geer

We establish adaptive results for trend filtering: least squares estimation with a penalty on the total variation of $(k-1)^{\rm th}$ order differences. Our approach is based on combining a general oracle inequality for …

DAPLSR: Data Augmentation Partial Least Squares Regression Model via Manifold Optimization

2025-04-23 · Haoran Chen, Jiapeng Liu, Jiafan Wang, Wenjun Shi

Traditional Partial Least Squares Regression (PLSR) models frequently underperform when handling data characterized by uneven categories. To address the issue, this paper proposes a Data Augmentation Partial Least Square…

Data Augmentationregression