paper-with-me

홈 › Papers

Multi-modality Meets Re-learning: Mitigating Negative Transfer in Sequential Recommendation

2023-09-18 · Bo Peng, Srinivasan Parthasarathy, Xia Ning

Learning effective recommendation models from sparse user interactions represents a fundamental challenge in developing sequential recommendation methods. Recently, pre-training-based methods have been developed to tackle this challenge. Though promising, in this paper, we show that existing methods suffer from the notorious negative transfer issue, where the model adapted from the pre-trained model results in worse performance compared to the model learned from scratch in the task of interest (i.e., target task). To address this issue, we develop a method, denoted as ANT, for transferable sequential recommendation. ANT mitigates negative transfer by 1) incorporating multi-modality item information, including item texts, images and prices, to effectively learn more transferable knowledge from related tasks (i.e., auxiliary tasks); and 2) better capturing task-specific knowledge in the target task using a re-learning-based adaptation strategy. We evaluate ANT against eight state-of-the-art baseline methods on five target tasks. Our experimental results demonstrate that ANT does not suffer from the negative transfer issue on any of the target tasks. The results also demonstrate that ANT substantially outperforms baseline methods in the target tasks with an improvement of as much as 15.2%. Our analysis highlights the superior effectiveness of our re-learning-based strategy compared to fine-tuning on the target tasks.

📄 PDF Abstract BibTeX arXiv:2309.10195

Code (1)

ninglab/ant 공식 구현 pytorch

Tasks

Sequential Recommendation

Similar Papers 제목 키워드 기반

Frequency-Domain Multi-Modality Transportation Modeling

2026-07-09 · Jiewen Deng, Hangchen Liu, Junchen Li, Boyuan Zhang 외 arxiv

Multi-modality transportation refers to urban systems composed of multiple transportation modes, such as traffic flow and public transit, whose dynamics are coupled by shared temporal patterns. Accurate multi-modality tr…

Mitigating Negative Transfer via Reducing Environmental Disagreement

2025-10-28 · Hui Sun, Zheng Xie, Hao-Yuan He, Ming Li arxiv

Unsupervised Domain Adaptation~(UDA) focuses on transferring knowledge from a labeled source domain to an unlabeled target domain, addressing the challenge of \emph{domain shift}. Significant domain shifts hinder effecti…

Unsupervised Domain Adaptation

Catastrophic Forgetting Meets Negative Transfer: Batch Spectral Shrinkage for Safe Transfer Learning

2019-12-01 · NeurIPS 2019 12 · Xinyang Chen, Sinan Wang, Bo Fu, Mingsheng Long 외

Before sufficient training data is available, fine-tuning neural networks pre-trained on large-scale datasets substantially outperforms training from random initialization. However, fine-tuning methods suffer from two di…

Transfer Learning

MultiMAE Meets Earth Observation: Pre-training Multi-modal Multi-task Masked Autoencoders for Earth Observation Tasks

2025-05-20 · Jose Sosa, Danila Rukhovich, Anis Kacem, Djamila Aouada

Multi-modal data in Earth Observation (EO) presents a huge opportunity for improving transfer learning capabilities when pre-training deep learning models. Unlike prior work that often overlooks multi-modal EO data, rece…

Earth ObservationTransfer Learning

Debiasing Multimodal Large Language Models via Noise-Aware Preference Optimization

2025-03-23 · CVPR 2025 1 · Zefeng Zhang, Hengzhu Tang, Jiawei Sheng, Zhenyu Zhang 외

Multimodal Large Language Models excel in various tasks, yet often struggle with modality bias, where the model tends to rely heavily on a single modality and overlook critical information in other modalities, which lead…