paper-with-me

홈 › Papers

Macro Graph of Experts for Billion-Scale Multi-Task Recommendation

2025-06-12 · Hongyu Yao, Zijin Hong, Hao Chen, Yuanchen Bei, Zhiqing Li, Qijie Shen, Zuobin Ying, Huan Gong, Feiran Huang

Graph-based multi-task learning at billion-scale presents a significant challenge, as different tasks correspond to distinct billion-scale graphs. Traditional multi-task learning methods often neglect these graph structures, relying solely on individual user and item embeddings. However, disregarding graph structures overlooks substantial potential for improving performance. In this paper, we introduce the Macro Graph of Expert (MGOE) framework, the first approach capable of leveraging macro graph embeddings to capture task-specific macro features while modeling the correlations between task-specific experts. Specifically, we propose the concept of a Macro Graph Bottom, which, for the first time, enables multi-task learning models to incorporate graph information effectively. We design the Macro Prediction Tower to dynamically integrate macro knowledge across tasks. MGOE has been deployed at scale, powering multi-task learning for the homepage of a leading billion-scale recommender system. Extensive offline experiments conducted on three public benchmark datasets demonstrate its superiority over state-of-the-art multi-task learning methods, establishing MGOE as a breakthrough in multi-task graph-based recommendation. Furthermore, online A/B tests confirm the superiority of MGOE in billion-scale recommender systems.

📄 PDF Abstract BibTeX arXiv:2506.10520

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task LearningRecommendation Systems

Similar Papers 제목 키워드 기반

Macro Graph Neural Networks for Online Billion-Scale Recommender Systems

2024-01-26 · Hao Chen, Yuanchen Bei, Qijie Shen, Yue Xu 외

Predicting Click-Through Rate (CTR) in billion-scale recommender systems poses a long-standing challenge for Graph Neural Networks (GNNs) due to the overwhelming computational complexity involved in aggregating billions …

Recommendation Systems

CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Experts

2026-06-11 · Bo Liu, Di Dai, Jingwei Liu, Jiarui Jin 외 arxiv

Granger Causal Discovery (GCD) is fundamental for analyzing temporal dependencies in complex systems. However, existing neural GCD methods predominantly rely on a "one-size-fits-all" paradigm, struggling to capture distr…

FinTeamExperts: Role Specialized MOEs For Financial Analysis

2024-10-28 · Yue Yu, Prayag Tiwari

Large Language Models (LLMs), such as ChatGPT, Phi3 and Llama-3, are leading a significant leap in AI, as they can generalize knowledge from their training to new tasks without fine-tuning. However, their application in …

Financial AnalysisMixture-of-Experts

Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs

2025-03-07 · Ling Team, Binwei Zeng, Chao Huang, Chao Zhang 외

In this technical report, we tackle the challenges of training large-scale Mixture of Experts (MoE) models, focusing on overcoming cost inefficiency and resource limitations prevalent in such systems. To address these is…

Knowledge GraphsMixture-of-Experts

Micro- and Macro-Level Churn Analysis of Large-Scale Mobile Games

2019-01-14 · Xi Liu, Muhe Xie, Xidao Wen, Rui Chen 외

As mobile devices become more and more popular, mobile gaming has emerged as a promising market with billion-dollar revenues. A variety of mobile game platforms and services have been developed around the world. A critic…

Attribute