TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendation
Multi-modal recommenders fuse user-item interaction signals with item modalities such as text, images, and audio, but the usefulness of each drifts over time and at different rates. For example, around Valentine's Day, chocolate purchases become less driven by textual ingredient cues and more by visual packaging and ambient audio. This \emph{modality time-scale mismatch} gives rise to two coupled challenges: (1) users with different temporal behavior profiles require different modality proportions, and (2) less relevant modalities are more likely to introduce outdated or misleading signals into the recommender. We address both challenges within a unified diffusion-based recommender, \textbf{TimeRoute}. A temporal-aware modal router maps each user's aggregated temporal profile to a personalized modality distribution, replacing the globally shared fusion weights used in prior work. The diffusion-based graph reconstructor is conditioned on the same profile through Feature-wise Linear Modulation (FiLM) with dual-stream long- and short-term denoising heads. This design captures both slowly and rapidly evolving temporal dynamics to suppress outdated modality edges before they enter the propagation graph. Experiments on TikTok, Amazon-Baby, and Amazon-Sports, averaged over 10 seeds, demonstrate consistent improvements over strong baselines across Recall@K, Precision@K, and NDCG@K, reaching up to 9.8\% (P@20 on Amazon-Baby). Controlled attribution studies further show that these gains require both the proposed mechanisms and temporal input: naively granting the backbone the same temporal profile yields no benefit, and feeding the router random noise performs no better than removing the router entirely. Code is available at https://anonymous.4open.science/r/TimeRoute.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-modal RecommendationSimilar Papers 제목 키워드 기반
TimeRouter: Efficient and Adaptive Routing of Time-Series Foundation Models
Time-series foundation models (TSFMs) are increasingly explored as predictive experts within emerging agentic time-series systems. However, TSFMs exhibit heterogeneous inductive biases, and no single model consistently d…
MRUF: Multi-granularity Routing with Uncertainty-Aware Fusion for Robust Multimodal Sentiment Analysis
Multimodal sentiment analysis relies on language, visual, and acoustic cues, but utterance-level modality quality may vary due to occlusion, background noise, motion blur, or imperfect transcripts, causing conventional f…
Multimodal Sentiment AnalysisBackbone-Conditional Behavior of Modality Gating in Multi-Modal Prostate MRI Segmentation: A 5-Fold Cross-Validation and Gate Mechanism Analysis
Robust segmentation of clinically significant prostate cancer (csPCa) on multi-parametric MRI must tolerate frequent degradation of its most informative diffusion sequences. Multi-modal fusion commonly employs learned mo…
MedMix: Specialization-Consistent Federated Sparse MoEs under Modality Heterogeneity
Federated multimodal medical AI faces modality heterogeneity at both the client and sample levels: clients may systematically lack access to specific modality types, while individual records within the same client may co…
Federated LearningSMAR: Soft Modality-Aware Routing Strategy for MoE-based Multimodal Large Language Models Preserving Language Capabilities
Mixture of Experts (MoE) architectures have become a key approach for scaling large language models, with growing interest in extending them to multimodal tasks. Existing methods to build multimodal MoE models either inc…
Mixture-of-Experts