Collaborative Multi-modal deep learning for the personalized product retrieval in Facebook Marketplace

2018-05-31 · Zheng Lu, Tan Zhao, Han Kun, Mao Ren

Facebook Marketplace is quickly gaining momentum among consumers as a favored customer-to-customer (C2C) product trading platform. The recommendation system behind it helps to significantly improve the user experience. Building the recommendation system for Facebook Marketplace is challenging for two reasons: 1) Scalability: the number of products in Facebook Marketplace is huge. Tens of thousands of products need to be scored and recommended within a couple hundred milliseconds for millions of users every day; 2) Cold start: the life span of the C2C products is very short and the user activities on the products are sparse. Thus it is difficult to accumulate enough product level signals for recommendation and we are facing a significant cold start issue. In this paper, we propose to address both the scalability and the cold-start issue by building a collaborative multi-modal deep learning based retrieval system where the compact embeddings for the users and the products are trained with the multi-modal content information. This system shows significant improvement over the benchmark in online and off-line experiments: In the online experiment, it increases the number of messages initiated by the buyer to the seller by +26.95%; in the off-line experiment, it improves the prediction accuracy by +9.58%.

📄 PDF Abstract BibTeX arXiv:1805.12312

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Multi-Objective Personalized Product Retrieval in Taobao Search

2022-10-09 · Yukun Zheng, Jiang Bian, Guanghao Meng, Chao Zhang 외

In large-scale e-commerce platforms like Taobao, it is a big challenge to retrieve products that satisfy users from billions of candidates. This has been a common concern of academia and industry. Recently, plenty of wor…

Collaborative Filtering Retrieval

Graph Contrastive Learning with Multi-Objective for Personalized Product Retrieval in Taobao Search

2023-07-10 · Longbin Li, Chao Zhang, Sen Li, Yun Zhong 외

In e-commerce search, personalized retrieval is a crucial technique for improving user shopping experience. Recent works in this domain have achieved significant improvements by the representation learning paradigm, e.g.…

Collaborative Filtering Contrastive Learning Graph Learning Representation Learning+1

Entity-Graph Enhanced Cross-Modal Pretraining for Instance-level Product Retrieval

2022-06-17 · Xiao Dong, Xunlin Zhan, Yunchao Wei, XiaoYong Wei 외

Our goal in this research is to study a more realistic environment in which we can conduct weakly-supervised multi-modal instance-level product retrieval for fine-grained product categories. We first contribute the Produ…

Retrieval

Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generation

2025-04-08 · Teng Shi, Jun Xu, Xiao Zhang, Xiaoxue Zang 외

Recently, the personalization of Large Language Models (LLMs) to generate content that aligns with individual user preferences has garnered widespread attention. Personalized Retrieval-Augmented Generation (RAG), which r…

Collaborative Filtering Contrastive Learning RAG Recommendation Systems+4

TailorMind: Towards Preference-Aligned Multimodal Content Generation

2026-06-22 · Hengji Zhou, Ye Liu, Yufeng Liu, Si Wu 외 arxiv

Personalized content systems depend on available UGC and struggle when suitable content is absent, delayed, or costly to create. Although multimodal generators can synthesize content on demand, how to translate behaviora…

Collaborative Filtering multimodal generation