paper-with-me

홈 › Papers

MTLSI-Net: A Linear Semantic Interaction Network for Parameter-Efficient Multi-Task Dense Prediction

2026-04-02 · Chen Liu, Hengyu Man, Xiaopeng Fan, Debin Zhao arxiv

Multi-task dense prediction aims to perform multiple pixel-level tasks simultaneously. However, capturing global cross-task interactions remains non-trivial due to the quadratic complexity of standard self-attention on high-resolution features. To address this limitation, we propose a Multi-Task Linear Semantic Interaction Network (MTLSI-Net), which facilitates cross-task interaction through linear attention. Specifically, MTLSI-Net incorporates three key components: a Multi-Task Multi-scale Query Linear Fusion Block, which captures cross-task dependencies across multiple scales with linear complexity using a shared global context matrix; a Semantic Token Distiller that compresses redundant features into compact semantic tokens, distilling essential cross-task knowledge; and a Cross-Window Integrated attention Block that injects global semantics into local features via a dual-branch architecture, preserving both global consistency and spatial precision. These components collectively enable the network to capture comprehensive cross-task interactions at linear complexity with reduced parameters. Extensive experiments on NYUDv2 and PASCAL-Context demonstrate that MTLSI-Net achieves state-of-the-art performance, validating its effectiveness and efficiency in multi-task learning.

📄 PDF Abstract BibTeX arXiv:2604.01995

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task Learning

Similar Papers 제목 키워드 기반

SemaMIL: Semantic-Aware Multiple Instance Learning with Retrieval-Guided State Space Modeling for Whole Slide Images

2025-08-30 · Lubin Gan, Xiaoman Wu, Jing Zhang, Zhifeng Wang 외 arxiv

Multiple instance learning (MIL) has become the leading approach for extracting discriminative features from whole slide images (WSIs) in computational pathology. Attention-based MIL methods can identify key patches but …

Multiple Instance Learning

Semantic Softmax Loss for Zero-Shot Learning

2017-05-22 · Zhong Ji, Yunxin Sun, Yulong Yu, Jichang Guo 외

A typical pipeline for Zero-Shot Learning (ZSL) is to integrate the visual features and the class semantic descriptors into a multimodal framework with a linear or bilinear model. However, the visual features and the cla…

ClassificationGeneral ClassificationMulti-class ClassificationRetrieval+2

Graph-Based Multi-Modal Light-weight Network for Adaptive Brain Tumor Segmentation

2025-07-14 · Guohao Huo, Ruiting Dai, Zitong Wang, Junxin Kong 외 arxiv

Multi-modal brain tumor segmentation remains challenging for practical deployment due to the high computational costs of mainstream models. In this work, we propose GMLN-BTS, a Graph-based Multi-modal interaction Lightwe…

Brain Tumor Segmentation

Compact Trilinear Interaction for Visual Question Answering

2019-09-26 · ICCV 2019 10 · Tuong Do, Thanh-Toan Do, Huy Tran, Erman Tjiputra 외

In Visual Question Answering (VQA), answers have a great correlation with question meaning and visual contents. Thus, to selectively utilize image, question and answer information, we propose a novel trilinear interactio…

BenchmarkingKnowledge DistillationQuestion AnsweringVisual Question Answering+1

X-Linear Attention Networks for Image Captioning

2020-03-31 · CVPR 2020 6 · Yingwei Pan, Ting Yao, Yehao Li, Tao Mei

Recent progress on fine-grained visual recognition and visual question answering has featured Bilinear Pooling, which effectively models the 2$^{nd}$ order interactions across multi-modal inputs. Nevertheless, there has …

DecoderFine-Grained Visual RecognitionImage CaptioningQuestion Answering+3