paper-with-me

Papers

Cross-Task Affinity Learning for Multitask Dense Scene Predictions

2024-01-20 · Dimitrios Sinodinos, Narges Armanfard

Multitask learning (MTL) has become prominent for its ability to predict multiple tasks jointly, achieving better per-task performance with fewer parameters than single-task learning. Recently, decoder-focused architectures have significantly improved multitask performance by refining task predictions using features from related tasks. However, most refinement methods struggle to efficiently capture both local and long-range dependencies between task-specific representations and cross-task patterns. In this paper, we introduce the Cross-Task Affinity Learning (CTAL) module, a lightweight framework that enhances task refinement in multitask networks. CTAL effectively captures local and long-range cross-task interactions by optimizing task affinity matrices for parameter-efficient grouped convolutions without concern for information loss. Our results demonstrate state-of-the-art MTL performance for both CNN and transformer backbones, using significantly fewer parameters than single-task learning. Our code is publicly available at https://github.com/Armanfard-Lab/EMA-Net.

📄 PDF Abstract BibTeX arXiv:2401.11124

Code (1)

armanfard-lab/ema-net 공식 구현 pytorch

Tasks

Decoder

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
CTAL CTAL is a pre-training framework for strong audio-and-language representations with a Transformer, which aims to learn the…

Similar Papers 제목 키워드 기반

Boosting Multitask Learning on Graphs through Higher-Order Task Affinities

2023-06-24 · Dongyue Li, Haotian Ju, Aneesh Sharma, Hongyang R. Zhang

Predicting node labels on a given graph is a widely studied problem with many applications, including community detection and molecular graph prediction. This paper considers predicting multiple node labeling functions o…

Community DetectionNode Classification

Scalable Multitask Learning Using Gradient-based Estimation of Task Affinity

2024-09-09 · Dongyue Li, Aneesh Sharma, Hongyang R. Zhang

Multitask learning is a widely used paradigm for training models on diverse tasks, with applications ranging from graph neural networks to language model fine-tuning. Since tasks may interfere with each other, a key noti…

GPUMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONTAG

Channel Exchanging Networks for Multimodal and Multitask Dense Image Prediction

2021-12-04 · Yikai Wang, Fuchun Sun, Wenbing Huang, Fengxiang He 외

Multimodal fusion and multitask learning are two vital topics in machine learning. Despite the fruitful progress, existing methods for both problems are still brittle to the same challenge -- it remains dilemmatic to int…

Semantic Segmentation

STRAP: Structured Object Affordance Segmentation with Point Supervision

2023-04-17 · Leiyao Cui, Xiaoxue Chen, Hao Zhao, Guyue Zhou 외

With significant annotation savings, point supervision has been proven effective for numerous 2D and 3D scene understanding problems. This success is primarily attributed to the structured output space; i.e., samples wit…

ObjectScene Understanding

Identification of Negative Transfers in Multitask Learning Using Surrogate Models

2023-03-25 · Dongyue Li, Huy L. Nguyen, Hongyang R. Zhang

Multitask learning is widely used in practice to train a low-resource target task by augmenting it with multiple related source tasks. Yet, naively combining all the source tasks with a target task does not always improv…

Multi-Task Learning