Towards Physiologically Sensible Predictions via the Rule-based Reinforcement Learning Layer

2025-01-31 · Lingwei Zhu, Zheng Chen, Yukie Nagai, Jimeng Sun

This paper adds to the growing literature of reinforcement learning (RL) for healthcare by proposing a novel paradigm: augmenting any predictor with Rule-based RL Layer (RRLL) that corrects the model's physiologically impossible predictions. Specifically, RRLL takes as input states predicted labels and outputs corrected labels as actions. The reward of the state-action pair is evaluated by a set of general rules. RRLL is efficient, general and lightweight: it does not require heavy expert knowledge like prior work but only a set of impossible transitions. This set is much smaller than all possible transitions; yet it can effectively reduce physiologically impossible mistakes made by the state-of-the-art predictor models. We verify the utility of RRLL on a variety of important healthcare classification problems and observe significant improvements using the same setup, with only the domain-specific set of impossibility changed. In-depth analysis shows that RRLL indeed improves accuracy by effectively reducing the presence of physiologically impossible predictions.

📄 PDF Abstract BibTeX arXiv:2501.19055

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Deep reinforcement learning for irrigation scheduling using high-dimensional sensor feedback

2023-01-02 · Yuji Saikai, Allan Peake, Karine Chenu

Deep reinforcement learning has considerable potential to improve irrigation scheduling in many cropping systems by applying adaptive amounts of water based on various measurements over time. The goal is to discover an i…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Scheduling+1

Learning to Run challenge: Synthesizing physiologically accurate motion using deep reinforcement learning

2018-03-31 · Łukasz Kidziński, Sharada P. Mohanty, Carmichael Ong, Jennifer L. Hicks 외

Synthesizing physiologically-accurate human movement in a variety of conditions can help practitioners plan surgeries, design experiments, or prototype assistive devices in simulated environments, reducing time and costs…

Deep Reinforcement Learning Navigate reinforcement-learning Reinforcement Learning+1

Sensible adversarial learning

2019-09-25 · Jungeum Kim, Xiao Wang

The trade-off between robustness and standard accuracy has been consistently reported in the machine learning literature. Although the problem has been widely studied to understand and explain this trade-off, no studies …

Modeling the Long Term Future in Model-Based Reinforcement Learning

2019-05-01 · ICLR 2019 5 · Nan Rosemary Ke, Amanpreet Singh, Ahmed Touati, Anirudh Goyal 외

In model-based reinforcement learning, the agent interleaves between model learning and planning. These two components are inextricably intertwined. If the model is not able to provide sensible long-term prediction, th…

Imitation Learning Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning+3

3KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentations

2021-04-21 · Bryan Gopal, Ryan W. Han, Gautham Raghupathi, Andrew Y. Ng 외

We propose 3KG, a physiologically-inspired contrastive learning approach that generates views using 3D augmentations of the 12-lead electrocardiogram. We evaluate representation quality by fine-tuning a linear layer for …

Contrastive Learning Rhythm Time Series Analysis