paper-with-me

홈 › Papers

Multitask learning meets tensor factorization: task imputation via convex optimization

2014-12-01 · NeurIPS 2014 12 · Kishan Wimalawarne, Masashi Sugiyama, Ryota Tomioka

We study a multitask learning problem in which each task is parametrized by a weight vector and indexed by a pair of indices, which can be e.g, (consumer, time). The weight vectors can be collected into a tensor and the (multilinear-)rank of the tensor controls the amount of sharing of information among tasks. Two types of convex relaxations have recently been proposed for the tensor multilinear rank. However, we argue that both of them are not optimal in the context of multitask learning in which the dimensions or multilinear rank are typically heterogeneous. We propose a new norm, which we call the scaled latent trace norm and analyze the excess risk of all the three norms. The results apply to various settings including matrix and tensor completion, multitask learning, and multilinear multitask learning. Both the theory and experiments support the advantage of the new norm when the tensor is not equal-sized and we do not a priori know which mode is low rank.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Imputation

Similar Papers 제목 키워드 기반

BAMITA: Bayesian Multiple Imputation for Tensor Arrays

2024-10-30 · Ziren Jiang, Gen Li, Eric F. Lock

Data increasingly take the form of a multi-way array, or tensor, in several biomedical domains. Such tensors are often incompletely observed. For example, we are motivated by longitudinal microbiome studies in which seve…

ImputationMissing Values

Water Quality Data Imputation via A Fast Latent Factorization of Tensors with PID-based Optimizer

2025-03-10 · Qian Liu, Lan Wang, Bing Yang, Hao Wu

Water quality data can supply a substantial decision support for water resources utilization and pollution prevention. However, there are numerous missing values in water quality data due to inescapable factors like sens…

ImputationMissing Values

Robust Factorization of Real-world Tensor Streams with Patterns, Missing Values, and Outliers

2021-02-16 · Dongjin Lee, Kijung Shin

Consider multiple seasonal time series being collected in real-time, in the form of a tensor stream. Real-world tensor streams often include missing entries (e.g., due to network disconnection) and at the same time unexp…

ImputationMissing ValuesTime SeriesTime Series Analysis

Incremental Bayesian tensor learning for structural monitoring data imputation and response forecasting

2020-07-01 · Pu Ren, Xinyu Chen, Lijun Sun, Hao Sun

There has been increased interest in missing sensor data imputation, which is ubiquitous in the field of structural health monitoring (SHM) due to discontinuous sensing caused by sensor malfunction. To address this funda…

ImputationIncremental LearningStructural Health MonitoringTensor Decomposition

Generalized Least Squares Kernelized Tensor Factorization

2024-12-09 · MengYing Lei, Lijun Sun

Real-world datasets often contain missing or corrupted values. Completing multidimensional tensor-structured data with missing entries is essential for numerous applications. Smoothness-constrained low-rank factorization…

Image InpaintingImage ReconstructionImputation