paper-with-me

홈 › Papers

Generating Negative Samples for Multi-Modal Recommendation

2025-01-25 · Yanbiao Ji, Yue Ding, Dan Luo, Chang Liu, Jing Tong, Shaokai Wu, Hongtao Lu

Multi-modal recommender systems (MMRS) have gained significant attention due to their ability to leverage information from various modalities to enhance recommendation quality. However, existing negative sampling techniques often struggle to effectively utilize the multi-modal data, leading to suboptimal performance. In this paper, we identify two key challenges in negative sampling for MMRS: (1) producing cohesive negative samples contrasting with positive samples and (2) maintaining a balanced influence across different modalities. To address these challenges, we propose NegGen, a novel framework that utilizes multi-modal large language models (MLLMs) to generate balanced and contrastive negative samples. We design three different prompt templates to enable NegGen to analyze and manipulate item attributes across multiple modalities, and then generate negative samples that introduce better supervision signals and ensure modality balance. Furthermore, NegGen employs a causal learning module to disentangle the effect of intervened key features and irrelevant item attributes, enabling fine-grained learning of user preferences. Extensive experiments on real-world datasets demonstrate the superior performance of NegGen compared to state-of-the-art methods in both negative sampling and multi-modal recommendation.

📄 PDF Abstract BibTeX arXiv:2501.15183

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-modal RecommendationRecommendation Systems

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendations

2025-01-21 · Jin Li, Shoujin Wang, Qi Zhang, Shui Yu 외

Incomplete scenario is a prevalent, practical, yet challenging setting in Multimodal Recommendations (MMRec), where some item modalities are missing due to various factors. Recently, a few efforts have sought to improve …

counterfactualFairnessMultimodal Recommendation

Generating Negative Samples for Sequential Recommendation

2022-08-07 · Yongjun Chen, Jia Li, Zhiwei Liu, Nitish Shirish Keskar 외

To make Sequential Recommendation (SR) successful, recent works focus on designing effective sequential encoders, fusing side information, and mining extra positive self-supervision signals. The strategy of sampling nega…

Sequential Recommendation

Enhancing Multimodal Compositional Reasoning of Visual Language Models with Generative Negative Mining

2023-11-07 · Ugur Sahin, Hang Li, Qadeer Khan, Daniel Cremers 외

Contemporary large-scale visual language models (VLMs) exhibit strong representation capacities, making them ubiquitous for enhancing image and text understanding tasks. They are often trained in a contrastive manner on …

Bootstrap Latent Representations for Multi-modal Recommendation

2022-07-13 · Xin Zhou, HongYu Zhou, Yong liu, Zhiwei Zeng 외

This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item inte…

Multi-modal Recommendation

Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning

2023-09-20 · Chen Jiang, Hong Liu, Xuzheng Yu, Qing Wang 외

In recent years, the explosion of web videos makes text-video retrieval increasingly essential and popular for video filtering, recommendation, and search. Text-video retrieval aims to rank relevant text/video higher tha…

Contrastive LearningRetrievalSemantic SimilaritySemantic Textual Similarity+2