Deep Reinforcement Learning for Adaptive Learning Systems

2020-04-17 · Xiao Li, Hanchen Xu, Jinming Zhang, Hua-hua Chang

In this paper, we formulate the adaptive learning problem---the problem of how to find an individualized learning plan (called policy) that chooses the most appropriate learning materials based on learner's latent traits---faced in adaptive learning systems as a Markov decision process (MDP). We assume latent traits to be continuous with an unknown transition model. We apply a model-free deep reinforcement learning algorithm---the deep Q-learning algorithm---that can effectively find the optimal learning policy from data on learners' learning process without knowing the actual transition model of the learners' continuous latent traits. To efficiently utilize available data, we also develop a transition model estimator that emulates the learner's learning process using neural networks. The transition model estimator can be used in the deep Q-learning algorithm so that it can more efficiently discover the optimal learning policy for a learner. Numerical simulation studies verify that the proposed algorithm is very efficient in finding a good learning policy, especially with the aid of a transition model estimator, it can find the optimal learning policy after training using a small number of learners.

📄 PDF Abstract BibTeX arXiv:2004.08410

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Value Driven Representation for Human-in-the-Loop Reinforcement Learning

2020-04-02 · Ramtin Keramati, Emma Brunskill

Interactive adaptive systems powered by Reinforcement Learning (RL) have many potential applications, such as intelligent tutoring systems. In such systems there is typically an external human system designer that is cre…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning for Adaptive Optimal Stationary Control of Linear Stochastic Systems

2021-07-16 · Bo Pang, Zhong-Ping Jiang

This paper studies the adaptive optimal stationary control of continuous-time linear stochastic systems with both additive and multiplicative noises, using reinforcement learning techniques. Based on policy iteration, a …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Meta-Reinforcement Learning with Discrete World Models for Adaptive Load Balancing

2025-03-11 · Cameron Redovian

We integrate a meta-reinforcement learning algorithm with the DreamerV3 architecture to improve load balancing in operating systems. This approach enables rapid adaptation to dynamic workloads with minimal retraining, ou…

Management Meta Reinforcement Learning reinforcement-learning Reinforcement Learning

Explaining Online Reinforcement Learning Decisions of Self-Adaptive Systems

2022-10-12 · Felix Feit, Andreas Metzger, Klaus Pohl

Design time uncertainty poses an important challenge when developing a self-adaptive system. As an example, defining how the system should adapt when facing a new environment state, requires understanding the precise eff…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Self Adaptive System

Adaptive PD Control using Deep Reinforcement Learning for Local-Remote Teleoperation with Stochastic Time Delays

2023-05-26 · Luc McCutcheon, Saber Fallah

Local-remote systems allow robots to execute complex tasks in hazardous environments such as space and nuclear power stations. However, establishing accurate positional mapping between local and remote devices can be dif…

Deep Reinforcement Learning Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning