Variable Selection and Task Grouping for Multi-Task Learning
We consider multi-task learning, which simultaneously learns related prediction tasks, to improve generalization performance. We factorize a coefficient matrix as the product of two matrices based on a low-rank assumption. These matrices have sparsities to simultaneously perform variable selection and learn and overlapping group structure among the tasks. The resulting bi-convex objective function is minimized by alternating optimization where sub-problems are solved using alternating direction method of multipliers and accelerated proximal gradient descent. Moreover, we provide the performance bound of the proposed method. The effectiveness of the proposed method is validated for both synthetic and real-world datasets.
Code (1)
Tasks
Multi-Task LearningVariable SelectionSimilar Papers 제목 키워드 기반
Accuracy and stability of solar variable selection comparison under complicated dependence structures
In this paper we focus on the empirical variable-selection peformance of subsample-ordered least angle regression (Solar) -- a novel ultrahigh dimensional redesign of lasso -- on the empirical data with complicated depen…
Graph LearningregressionVariable SelectionGrouping effects of sparse CCA models in variable selection
The sparse canonical correlation analysis (SCCA) is a bi-multivariate association model that finds sparse linear combinations of two sets of variables that are maximally correlated with each other. In addition to the sta…
Variable SelectionHigh-Dimensional Screening Using Multiple Grouping of Variables
Screening is the problem of finding a superset of the set of non-zero entries in an unknown p-dimensional vector \beta* given n noisy observations. Naturally, we want this superset to be as small as possible. We propose …
Variable SelectionVocal Bursts Intensity PredictionStructured Learning in Time-dependent Cox Models
Cox models with time-dependent coefficients and covariates are widely used in survival analysis. In high-dimensional settings, sparse regularization techniques are employed for variable selection, but existing methods fo…
Survival AnalysisVariable SelectionG-FARS: Gradient-Field-based Auto-Regressive Sampling for 3D Part Grouping
This paper proposes a novel task named "3D part grouping". Suppose there is a mixed set containing scattered parts from various shapes. This task requires algorithms to find out every possible combination among all the p…
Graph Neural Network