paper-with-me

홈 › Papers

Double-Wing Mixture of Experts for Streaming Recommendations

2020-09-14 · Yan Zhao, Shoujin Wang, Yan Wang, Hongwei Liu, Weizhe Zhang

Streaming Recommender Systems (SRSs) commonly train recommendation models on newly received data only to address user preference drift, i.e., the changing user preferences towards items. However, this practice overlooks the long-term user preferences embedded in historical data. More importantly, the common heterogeneity in data stream greatly reduces the accuracy of streaming recommendations. The reason is that different preferences (or characteristics) of different types of users (or items) cannot be well learned by a unified model. To address these two issues, we propose a Variational and Reservoir-enhanced Sampling based Double-Wing Mixture of Experts framework, called VRS-DWMoE, to improve the accuracy of streaming recommendations. In VRS-DWMoE, we first devise variational and reservoir-enhanced sampling to wisely complement new data with historical data, and thus address the user preference drift issue while capturing long-term user preferences. After that, we propose a Double-Wing Mixture of Experts (DWMoE) model to first effectively learn heterogeneous user preferences and item characteristics, and then make recommendations based on them. Specifically, DWMoE contains two Mixture of Experts (MoE, an effective ensemble learning model) to learn user preferences and item characteristics, respectively. Moreover, the multiple experts in each MoE learn the preferences (or characteristics) of different types of users (or items) where each expert specializes in one underlying type. Extensive experiments demonstrate that VRS-DWMoE consistently outperforms the state-of-the-art SRSs.

📄 PDF Abstract BibTeX arXiv:2009.06327

Code (0)

등록된 구현이 없습니다.

Tasks

Ensemble LearningMixture-of-ExpertsRecommendation Systems

Similar Papers 제목 키워드 기반

Double Deep Q-Learning in Opponent Modeling

2022-11-24 · Yangtianze Tao, John Doe

Multi-agent systems in which secondary agents with conflicting agendas also alter their methods need opponent modeling. In this study, we simulate the main agent's and secondary agents' tactics using Double Deep Q-Networ…

Mixture-of-ExpertsQ-Learning

SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR

2024-06-26 · Shuaishuai Ye, Shunfei Chen, Xinhui Hu, Xinkang Xu

In this work, we propose a Switch-Conformer-based MoE system named SC-MoE for unified streaming and non-streaming code-switching (CS) automatic speech recognition (ASR), where we design a streaming MoE layer consisting o…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Computational EfficiencyDecoder+4

Plasticity-Aware Mixture of Experts for Learning Under QoE Shifts in Adaptive Video Streaming

2025-04-14 · Zhiqiang He, Zhi Liu

Adaptive video streaming systems are designed to optimize Quality of Experience (QoE) and, in turn, enhance user satisfaction. However, differences in user profiles and video content lead to different weights for QoE fac…

Mixture-of-Experts

Double-Stage Feature-Level Clustering-Based Mixture of Experts Framework

2025-03-12 · Bakary Badjie, José Cecílio, António Casimiro

The Mixture-of-Experts (MoE) model has succeeded in deep learning (DL). However, its complex architecture and advantages over dense models in image classification remain unclear. In previous studies, MoE performance has …

ClusteringDiversityimage-classificationImage Classification+2

Building a great multi-lingual teacher with sparsely-gated mixture of experts for speech recognition

2021-12-10 · Kenichi Kumatani, Robert Gmyr, Felipe Cruz Salinas, Linquan Liu 외

The sparsely-gated Mixture of Experts (MoE) can magnify a network capacity with a little computational complexity. In this work, we investigate how multi-lingual Automatic Speech Recognition (ASR) networks can be scaled …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)DecoderMixture-of-Experts+2