paper-with-me

Papers

Learning to Route: Per-Sample Adaptive Routing for Multimodal Multitask Prediction

2025-09-06 · Marzieh Ajirak, Oded Bein, Ellen Rose Bowen, Dora Kanellopoulos, Avital Falk, Faith M. Gunning, Nili Solomonov, Logan Grosenick arxiv

We propose a unified framework for adaptive routing in multitask, multimodal prediction settings where data heterogeneity and task interactions vary across samples. Motivated by applications in psychotherapy where structured assessments and unstructured clinician notes coexist with partially missing data and correlated outcomes, we introduce a routing-based architecture that dynamically selects modality processing pathways and task-sharing strategies on a per-sample basis. Our model defines multiple modality paths, including raw and fused representations of text and numeric features and learns to route each input through the most informative expert combination. Task-specific predictions are produced by shared or independent heads depending on the routing decision, and the entire system is trained end-to-end. We evaluate the model on both synthetic data and real-world psychotherapy notes predicting depression and anxiety outcomes. Our experiments show that our method consistently outperforms fixed multitask or single-task baselines, and that the learned routing policy provides interpretable insights into modality relevance and task structure. This addresses critical challenges in personalized healthcare by enabling per-subject adaptive information processing that accounts for data heterogeneity and task correlations. Applied to psychotherapy, this framework could improve mental health outcomes, enhance treatment assignment precision, and increase clinical cost-effectiveness through personalized intervention strategies.

📄 PDF Abstract BibTeX arXiv:2509.12227

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning

2026-05-10 · Xing Han, Shravan Chaudhari, Tanvi Ranade, Rama Chellappa 외 arxiv

Real-world model deployment across multiple domains requires multimodal models to operate under two complementary regimes: (1) multi-task pretraining, tasks are co-available at design time where related tasks could borro…

Multi-Task LearningContinual Learning

Beyond One-Size-Fits-All: Sample-Adaptive Strategy Routing for Vision Token Pruning in MLLMs

2026-09-09 · Haiji Liang, Pengfei Zhou, Zhenglin Wan, Wei Wang 외 arxiv

Multimodal large language models (MLLMs) process hundreds or thousands of visual tokens per image, incurring prohibitive inference costs. While existing vision token pruning methods mitigate this overhead, they implicitl…

Before Thinking, Learn to Decide: Proactive Routing for Efficient Visual Reasoning

2026-06-29 · Yinan Zhou, Haokun Lin, Yichen Wu, Yuxin Chen 외 arxiv

Large multimodal models have achieved strong reasoning on complex visual tasks, but their inference efficiency is often restricted by long chains of thought. A promising solution is to pair a small draft model with a lar…

Multimodal ReasoningVisual Reasoning

VL-RouterBench: A Benchmark for Vision-Language Model Routing

2025-12-29 · Zhehao Huang, Baijiong Lin, Jingyuan Zhang, Jingying Wang 외 arxiv

Multi-model routing has evolved from an engineering technique into essential infrastructure, yet existing work lacks a systematic, reproducible benchmark for evaluating vision-language models (VLMs). We present VL-Router…

Towards Resource-Efficient Multimodal Intelligence: Learned Routing among Specialized Expert Models

2025-11-09 · Mayank Saini, Arit Kumar Bishwas arxiv

As AI moves beyond text, large language models (LLMs) increasingly power vision, audio, and document understanding; however, their high inference costs hinder real-time, scalable deployment. Conversely, smaller open-sour…

Visual Question Answering