Adapting User Interfaces with Model-based Reinforcement Learning

2021-03-11 · Kashyap Todi, Gilles Bailly, Luis A. Leiva, Antti Oulasvirta

Adapting an interface requires taking into account both the positive and negative effects that changes may have on the user. A carelessly picked adaptation may impose high costs to the user -- for example, due to surprise or relearning effort -- or "trap" the process to a suboptimal design immaturely. However, effects on users are hard to predict as they depend on factors that are latent and evolve over the course of interaction. We propose a novel approach for adaptive user interfaces that yields a conservative adaptation policy: It finds beneficial changes when there are such and avoids changes when there are none. Our model-based reinforcement learning method plans sequences of adaptations and consults predictive HCI models to estimate their effects. We present empirical and simulation results from the case of adaptive menus, showing that the method outperforms both a non-adaptive and a frequency-based policy.

📄 PDF Abstract BibTeX arXiv:2103.06807

Code (0)

등록된 구현이 없습니다.

Tasks

modelModel-based Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Designing Deep Reinforcement Learning for Human Parameter Exploration

2019-07-01 · Hugo Scurto, Bavo Van Kerrebroeck, Baptiste Caramiaux, Frédéric Bevilacqua

Software tools for generating digital sound often present users with high-dimensional, parametric interfaces, that may not facilitate exploration of diverse sound designs. In this paper, we propose to investigate artific…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Computational Adaptation of XR Interfaces Through Interaction Simulation

2022-04-19 · Kashyap Todi, Ben Lafreniere, Tanya Jonker

Adaptive and intelligent user interfaces have been proposed as a critical component of a successful extended reality (XR) system. In particular, a predictive system can make inferences about a user and provide them with …

Position

Accessible Gesture-Driven Augmented Reality Interaction System

2025-06-18 · Yikan Wang

Augmented reality (AR) offers immersive interaction but remains inaccessible for users with motor impairments or limited dexterity due to reliance on precise input methods. This study proposes a gesture-based interaction…

Federated Learning Gesture Recognition Graph Attention Privacy Preserving

Face valuing: Training user interfaces with facial expressions and reinforcement learning

2016-06-09 · Vivek Veeriah, Patrick M. Pilarski, Richard S. Sutton

An important application of interactive machine learning is extending or amplifying the cognitive and physical capabilities of a human. To accomplish this, machines need to learn about their human users' intentions and a…

BIG-bench Machine Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Adaptation of Tongue Ultrasound-Based Silent Speech Interfaces Using Spatial Transformer Networks

2023-05-30 · László Tóth, Amin Honarmandi Shandiz, Gábor Gosztolya, Csapó Tamás Gábor

Thanks to the latest deep learning algorithms, silent speech interfaces (SSI) are now able to synthesize intelligible speech from articulatory movement data under certain conditions. However, the resulting models are rat…