paper-with-me

홈 › Papers

Multi-view Orthonormalized Partial Least Squares: Regularizations and Deep Extensions

2020-07-09 · Li Wang, Ren-cang Li, Wen-Wei

We establish a family of subspace-based learning method for multi-view learning using the least squares as the fundamental basis. Specifically, we investigate orthonormalized partial least squares (OPLS) and study its important properties for both multivariate regression and classification. Building on the least squares reformulation of OPLS, we propose a unified multi-view learning framework to learn a classifier over a common latent space shared by all views. The regularization technique is further leveraged to unleash the power of the proposed framework by providing three generic types of regularizers on its inherent ingredients including model parameters, decision values and latent projected points. We instantiate a set of regularizers in terms of various priors. The proposed framework with proper choices of regularizers not only can recast existing methods, but also inspire new models. To further improve the performance of the proposed framework on complex real problems, we propose to learn nonlinear transformations parameterized by deep networks. Extensive experiments are conducted to compare various methods on nine data sets with different numbers of views in terms of both feature extraction and cross-modal retrieval.

📄 PDF Abstract BibTeX arXiv:2007.05028

Code (0)

등록된 구현이 없습니다.

Tasks

Cross-Modal RetrievalMULTI-VIEW LEARNINGRetrieval

Similar Papers 제목 키워드 기반

Kernel Multivariate Analysis Framework for Supervised Subspace Learning: A Tutorial on Linear and Kernel Multivariate Methods

2013-10-18 · Jerónimo Arenas-García, Kaare Brandt Petersen, Gustavo Camps-Valls, Lars Kai Hansen

Feature extraction and dimensionality reduction are important tasks in many fields of science dealing with signal processing and analysis. The relevance of these techniques is increasing as current sensory devices are de…

Dimensionality ReductionGeneral Classification

Out-of-distribution robustness for multivariate analysis via causal regularisation

2024-03-04 · Homer Durand, Gherardo Varando, Nathan Mankovich, Gustau Camps-Valls

We propose a regularisation strategy of classical machine learning algorithms rooted in causality that ensures robustness against distribution shifts. Building upon the anchor regression framework, we demonstrate how inc…

Causal Inferenceregression

Multi-view Bayesian optimisation in reduced dimension for engineering design

2025-01-02 · Thomas A. Archbold, Ieva Kazlauskaite, Fehmi Cirak

Bayesian optimisation is an adaptive sampling strategy for constructing a Gaussian process surrogate to emulate a black-box computational model with the aim of efficiently searching for the global minimum. However, Gauss…

Bayesian OptimisationGaussian ProcessesMULTI-VIEW LEARNING

Normalization Gradients are Least-squares Residuals

2019-05-01 · ICLR 2019 5 · Yi Liu

Batch Normalization (BN) and its variants have seen widespread adoption in the deep learning community because they improve the training of deep neural networks. Discussions of why this normalization works so well remain…

A selective review of sufficient dimension reduction for multivariate response regression

2022-02-02 · Yuexiao Dong, Abdul-Nasah Soale, Michael D. Power

We review sufficient dimension reduction (SDR) estimators with multivariate response in this paper. A wide range of SDR methods are characterized as inverse regression SDR estimators or forward regression SDR estimators.…

Dimensionality Reductionregression