paper-with-me

홈 › Papers

Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classification

2016-11-16 · CVPR 2017 7 · Yongxi Lu, Abhishek Kumar, Shuangfei Zhai, Yu Cheng, Tara Javidi, Rogerio Feris

Multi-task learning aims to improve generalization performance of multiple prediction tasks by appropriately sharing relevant information across them. In the context of deep neural networks, this idea is often realized by hand-designed network architectures with layers that are shared across tasks and branches that encode task-specific features. However, the space of possible multi-task deep architectures is combinatorially large and often the final architecture is arrived at by manual exploration of this space subject to designer's bias, which can be both error-prone and tedious. In this work, we propose a principled approach for designing compact multi-task deep learning architectures. Our approach starts with a thin network and dynamically widens it in a greedy manner during training using a novel criterion that promotes grouping of similar tasks together. Our Extensive evaluation on person attributes classification tasks involving facial and clothing attributes suggests that the models produced by the proposed method are fast, compact and can closely match or exceed the state-of-the-art accuracy from strong baselines by much more expensive models.

📄 PDF Abstract BibTeX arXiv:1611.05377

Code (1)

luyongxi/deep_share 공식 구현 caffe2

Tasks

AttributeGeneral ClassificationMulti-Task Learning

Similar Papers 제목 키워드 기반

Multi-task Highly Adaptive Lasso

2023-01-27 · Ivana Malenica, Rachael V. Phillips, Daniel Lazzareschi, Jeremy R. Coyle 외

We propose a novel, fully nonparametric approach for the multi-task learning, the Multi-task Highly Adaptive Lasso (MT-HAL). MT-HAL simultaneously learns features, samples and task associations important for the common m…

Multi-Task Learning

Adaptive Pattern Extraction Multi-Task Learning for Multi-Step Conversion Estimations

2023-01-06 · Xuewen Tao, Mingming Ha, Xiaobo Guo, Qiongxu Ma 외

Multi-task learning (MTL) has been successfully used in many real-world applications, which aims to simultaneously solve multiple tasks with a single model. The general idea of multi-task learning is designing kinds of g…

Multi-Task LearningRepresentation Learning

Adaptive Knowledge Sharing in Multi-Task Learning: Improving Low-Resource Neural Machine Translation

2018-07-01 · ACL 2018 7 · Poorya Zaremoodi, Wray Buntine, Gholamreza Haffari

Neural Machine Translation (NMT) is notorious for its need for large amounts of bilingual data. An effective approach to compensate for this requirement is Multi-Task Learning (MTL) to leverage different linguistic resou…

Inductive BiasLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine Translation+3

Graph Convolutional Networks via Adaptive Filter Banks

2021-09-29 · Xing Gao, Wenrui Dai, Chenglin Li, Junni Zou 외

Graph convolutional networks have been a powerful tool in representation learning of networked data. However, most architectures of message passing graph convolutional networks (MPGCNs) are limited as they employ a singl…

Representation Learning

ARCO-BO: Adaptive Resource-aware COllaborative Bayesian Optimization for Heterogeneous Multi-Agent Design

2025-10-18 · Zihan Wang, Yi-Ping Chen, Tuba Dolar, Wei Chen arxiv

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agent…

Distributed Optimization