paper-with-me

Papers

Plasticity-Aware Mixture of Experts for Learning Under QoE Shifts in Adaptive Video Streaming

2025-04-14 · Zhiqiang He, Zhi Liu

Adaptive video streaming systems are designed to optimize Quality of Experience (QoE) and, in turn, enhance user satisfaction. However, differences in user profiles and video content lead to different weights for QoE factors, resulting in user-specific QoE functions and, thus, varying optimization objectives. This variability poses significant challenges for neural networks, as they often struggle to generalize under evolving targets - a phenomenon known as plasticity loss that prevents conventional models from adapting effectively to changing optimization objectives. To address this limitation, we propose the Plasticity-Aware Mixture of Experts (PA-MoE), a novel learning framework that dynamically modulates network plasticity by balancing memory retention with selective forgetting. In particular, PA-MoE leverages noise injection to promote the selective forgetting of outdated knowledge, thereby endowing neural networks with enhanced adaptive capabilities. In addition, we present a rigorous theoretical analysis of PA-MoE by deriving a regret bound that quantifies its learning performance. Experimental evaluations demonstrate that PA-MoE achieves a 45.5% improvement in QoE over competitive baselines in dynamic streaming environments. Further analysis reveals that the model effectively mitigates plasticity loss by optimizing neuron utilization. Finally, a parameter sensitivity study is performed by injecting varying levels of noise, and the results align closely with our theoretical predictions.

📄 PDF Abstract BibTeX arXiv:2504.09906

Code (0)

등록된 구현이 없습니다.

Tasks

Mixture-of-Experts

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Dynamic Mixture of Experts Against Severe Distribution Shifts

2025-11-24 · Donghu Kim arxiv

The challenge of building neural networks that can continuously learn and adapt to evolving data streams is central to the fields of continual learning (CL) and reinforcement learning (RL). This lifelong learning problem…

Reinforcement LearningContinual Learning

Plasticity-Enhanced Multi-Agent Mixture of Experts for Dynamic Objective Adaptation in UAVs-Assisted Emergency Communication Networks

2026-04-10 · Wen Qiu, Zhiqiang He, Wei Zhao, Hiroshi Masui arxiv

Unmanned aerial vehicles serving as aerial base stations can rapidly restore connectivity after disasters, yet abrupt changes in user mobility and traffic demands shift the quality of service trade-offs and induce strong…

Reinforcement Learning

SPHERE: Mitigating the Loss of Spectral Plasticity in Mixture-of-Experts for Deep Reinforcement Learning

2026-05-06 · Lirui Luo, Guoxi Zhang, Hongming Xu, Cong Fang 외 arxiv

In deep reinforcement learning (DRL), an agent is trained from a stream of experience. In a continual learning setting, such agents can suffer from plasticity loss: their ability to learn new skills from new experiences …

Reinforcement LearningContinual Learning

Dynamic TMoE: A Drift-Aware Dynamic Mixture of Experts Framework for Non-Stationary Time Series Forecasting

2026-05-20 · Jiawen Zhu, Shuhan Liu, Di Weng, Yingcai Wu arxiv

Non-stationary time series forecasting is challenged by evolving distribution shifts that static models struggle to capture. While Mixture-of-Experts (MoE) architectures offer a promising paradigm for decoupling complex …

Time Series Forecasting

Sparsity-Driven Plasticity in Multi-Task Reinforcement Learning

2025-08-09 · Aleksandar Todorov, Juan Cardenas-Cartagena, Rafael F. Cunha, Marco Zullich 외 arxiv

Plasticity loss, a diminishing capacity to adapt as training progresses, is a critical challenge in deep reinforcement learning. We examine this issue in multi-task reinforcement learning (MTRL), where higher representat…

Reinforcement Learning