paper-with-me

홈 › Papers

Learning Multiple Tasks with Multilinear Relationship Networks

2015-06-06 · NeurIPS 2017 12 · Mingsheng Long, Zhangjie Cao, Jian-Min Wang, Philip S. Yu

Deep networks trained on large-scale data can learn transferable features to promote learning multiple tasks. Since deep features eventually transition from general to specific along deep networks, a fundamental problem of multi-task learning is how to exploit the task relatedness underlying parameter tensors and improve feature transferability in the multiple task-specific layers. This paper presents Multilinear Relationship Networks (MRN) that discover the task relationships based on novel tensor normal priors over parameter tensors of multiple task-specific layers in deep convolutional networks. By jointly learning transferable features and multilinear relationships of tasks and features, MRN is able to alleviate the dilemma of negative-transfer in the feature layers and under-transfer in the classifier layer. Experiments show that MRN yields state-of-the-art results on three multi-task learning datasets.

📄 PDF Abstract BibTeX arXiv:1506.02117

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learning

Similar Papers 제목 키워드 기반

Multilinear Dirichlet Processes

2021-06-16 · XiaoLi Li

Dependent Dirichlet processes (DDP) have been widely applied to model data from distributions over collections of measures which are correlated in some way. On the other hand, in recent years, increasing research efforts…

A novel extension of Generalized Low-Rank Approximation of Matrices based on multiple-pairs of transformations

2018-08-31 · Soheil Ahmadi, Mansoor Rezghi

Dimensionality reduction is a main step in the learning process which plays an essential role in many applications. The most popular methods in this field like SVD, PCA, and LDA, only can be applied to data with vector f…

Dimensionality Reduction

Residual Tensor Train: A Quantum-inspired Approach for Learning Multiple Multilinear Correlations

2021-08-19 · YiWei Chen, Yu Pan, Daoyi Dong

States of quantum many-body systems are defined in a high-dimensional Hilbert space, where rich and complex interactions among subsystems can be modelled. In machine learning, complex multiple multilinear correlations ma…

Higher Order Reduced Rank Regression

2025-03-09 · Leia Greenberg, Haim Avron

Reduced Rank Regression (RRR) is a widely used method for multi-response regression. However, RRR assumes a linear relationship between features and responses. While linear models are useful and often provide a good appr…

regressionRiemannian optimization

Efficient Task Collaboration with Execution Uncertainty

2015-09-17 · Dengji Zhao, Sarvapali D. Ramchurn, Nicholas R. Jennings

We study a general task allocation problem, involving multiple agents that collaboratively accomplish tasks and where agents may fail to successfully complete the tasks assigned to them (known as execution uncertainty). …