Trace Ratio Optimization with an Application to Multi-view Learning
A trace ratio optimization problem over the Stiefel manifold is investigated from the perspectives of both theory and numerical computations. At least three special cases of the problem have arisen from Fisher linear discriminant analysis, canonical correlation analysis, and unbalanced Procrustes problem, respectively. Necessary conditions in the form of nonlinear eigenvalue problem with eigenvector dependency are established and a numerical method based on the self-consistent field (SCF) iteration is designed and proved to be always convergent. As an application to multi-view subspace learning, a new framework and its instantiated concrete models are proposed and demonstrated on real world data sets. Numerical results show that the efficiency of the proposed numerical methods and effectiveness of the new multi-view subspace learning models.
Code (0)
등록된 구현이 없습니다.
Tasks
MULTI-VIEW LEARNINGMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PACT: Privileged Trace Co-Training for Multi-Turn Tool-Use Agents
Multi-turn tool-use agents must reason, call tools, and adapt to observations across several interaction turns. Post-training such agents is challenging, as reinforcement learning often suffers from sparse rewards and we…
Reinforcement LearningMKL-RT: Multiple Kernel Learning for Ratio-trace Problems via Convex Optimization
In the recent past, automatic selection or combination of kernels (or features) based on multiple kernel learning (MKL) approaches has been receiving significant attention from various research communities. Though MKL ha…
Cross-Modal RetrievalDimensionality ReductionRetrievalA Self-consistent-field Iteration for Orthogonal Canonical Correlation Analysis
We propose an efficient algorithm for solving orthogonal canonical correlation analysis (OCCA) in the form of trace-fractional structure and orthogonal linear projections. Even though orthogonality has been widely used a…
Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONA Survey of Model Architectures in Information Retrieval
This survey examines the evolution of model architectures in information retrieval (IR), focusing on two key aspects: backbone models for feature extraction and end-to-end system architectures for relevance estimation. T…
Information RetrievalmodelRetrievalSurveyAccelerated Training for Matrix-norm Regularization: A Boosting Approach
Sparse learning models typically combine a smooth loss with a nonsmooth penalty, such as trace norm. Although recent developments in sparse approximation have offered promising solution methods, current approaches either…
Multiview LearningSparse Learning